[NCO Bug] Add restart capability for GFS wave post processing jobs

[KateFriedman-NOAA]

Bugzilla #1368

Details from NCO in bugzilla:

Please add the restart capability for GFS wave postprocessing jobs, 

-  gfs_wave_postsbs
-  gfs_wave_post_bndpnt
-  gfs_wave_post_bndpntbll

referred to the "NCEP Central Operations WCOSS Implementation Standards, version 11.0.0", page 13, 
https://www.nco.ncep.noaa.gov/idsb/implementation_standards/ImplementationStandards.v11.0.0.pdf?

During the catchup process after system issue, gfs atmos/wave post processing jobs could fail on waiting upstream 
files. Each time the gfs atmos/wave post processing jobs will processed from the very beginning. 

For the restart capability, suggest to add checking if the product is produced then skip logic in the jobs to avoid 
multiple alerts in rerun. Also it will be best use of the system resource and delivery product efficiently.

[HuiyaChuang-NOAA]

@KateFriedman-NOAA @JessicaMeixner-NOAA I believe Jessica has agreed to the the POC for this

[JessicaMeixner-NOAA]

I can be the POC for this. At some point we'll need to find someone who can help with the non-wave job: gfs_atmos_postsnd as I am not the right person to do that technical work but can certainly serve as a POC.

[HuiyaChuang-NOAA]

I think that's been re-assigned to Bo Cui. Is it no? Huiya

…

On Thu, Jan 19, 2023 at 11:54 AM Jessica Meixner ***@***.***> wrote: I can be the POC for this. At some point we'll need to find someone who can help with the non-wave job: gfs_atmos_postsnd as I am not the right person to do that technical work but can certainly serve as a POC. — Reply to this email directly, view it on GitHub <#1251 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ANQZ2VDZCAC3O2GBZHUNKODWTFWVDANCNFSM6AAAAAAT7PZKW4> . You are receiving this because you commented.Message ID: ***@***.***>

--

-------------------------------------------------------------- Physical Scientist Environmental Modeling Center, NCEP, NWS, NOAA 301-683-3716 Office 2068 5830 University Research Court College Park. MD 20740

[KateFriedman-NOAA]

The other bugzilla assigned to Bo (#1245) is unrelated to adding restart capability to the bufr sounding job.

We could assign both @BoCui-NOAA and @JessicaMeixner-NOAA to this issue or I could split the bufr sounding aspect into it's own global-workflow issue. Thoughts from folks?

Either way, I'll need to go through @ShelleyMelchior-NOAA before I can assign @BoCui-NOAA to this or a new one split from this. :)

[WalterKolczynski-NOAA]

Soundings should be a separate issue

[KateFriedman-NOAA]

Alrighty, I split the bufr sounding aspect of this bugzilla into a new issue #1257 .

[WalterKolczynski-NOAA]

#2290 will render this one moot

[WalterKolczynski-NOAA]

Misspoke, #2290 will only update the gridded job. The point jobs will need similar updates.

[JessicaMeixner-NOAA]

There's a plan in place to completely reingineer the point post job. We will ensure in the design it's either under 15 minutes or has a restart capability.