Re: [gembud] GDBIINT bug or corrupt NOAA grib2 file?

• To: "gembud@xxxxxxxxxxxxxxxx" <gembud@xxxxxxxxxxxxxxxx>
• Subject: Re: [gembud] GDBIINT bug or corrupt NOAA grib2 file?
• From: Steven Decker <sgdecker@xxxxxxxxxxxxxxxxxx>
• Date: Mon, 24 Jun 2019 16:06:51 +0000
• Authentication-results: spf=none (sender IP is ) smtp.mailfrom=sgdecker@xxxxxxxxxxxxxxxxxx;

This looks like a GEMPAK bug to me.  The loop at line 123 of dppgrb.f 
does not terminate for one of the grids in the file that hangs.  One of 
the if statements preceding that line must not be catching all 
situations where the do-while loop will be infinite.

Steve

On 6/20/19 7:51 PM, elowery@xxxxxxxxxxxx wrote:
> Hello all,
> 
> I have a legacy processes which is still using 2.50 degree GFS data 
> (being phased out). NOAA stopped creating the files several years ago, 
> and I've been using NAGRIB2 and GDBIINT to convert 1.00, 0.50, or 0.25 
> degree grib2 -> 2.50 degree grid data.
> 
> Occasionally, GDBIINT will hang at ~98% CPU when converting a file. 
> Testing this across both older and newer versions of GEMPAK results in 
> the same hung GDBIINT process. Attached is a link to some test files 
> which GDBIINT handles flawlessly, and one file which it does not.
> 
> *Source:*
> https://nomads.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gfs.20190616/00/
> 
> *Files (GDBIINT status)*
> gfs.t00z.pgrb2.1p00.f159 (ok)
> gfs.t00z.pgrb2.1p00.f162 (hangs)
> gfs.t00z.pgrb2.1p00.f357 (ok)
> gfs.t00z.pgrb2.0p50.f162 (ok)
> 
> Google drive link (gfs_sample_files.zip 
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdrive.google.com%2Ffile%2Fd%2F1rXC8Y8UaRa7FHzUe9-Hgiv2QJVBhtnUG%2Fview%3Fusp%3Dsharing&data=02%7C01%7Csgdecker%40envsci.rutgers.edu%7C7074cde7102a4190266a08d6f5da39cb%7Cb92d2b234d35447093ff69aca6632ffe%7C1%7C1%7C636966714966523229&sdata=sIahh0S62h0lornH62id9qAMkH1RWvjU1PLk%2BqhioEU%3D&reserved=0>)
> 
> *Sample script*
> convert_1p00_2p50.sh {res} {hhh}
> 
> *Sample command (convert 1p00 159 file to 2p50)*
> convert_1p00_2p50.sh 1p00 159
> 
> Has anyone come across this? My assumption is that it's a corrupt grib2 
> file from NOAA and should be brought to their attention as well, but 
> maybe it could be handled gracefully in GDBIINT?
> 
> This error randomly occurs and is not consistent with a specific file or 
> resolution.
> 
> Thanks in advance,
> 
> Evan Lowery
> 
> 
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web.  Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
> 
> 
> gembud mailing list
> gembud@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit: 
> https://nam02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.unidata.ucar.edu%2Fmailing_lists%2F&amp;data=02%7C01%7Csgdecker%40envsci.rutgers.edu%7C7074cde7102a4190266a08d6f5da39cb%7Cb92d2b234d35447093ff69aca6632ffe%7C1%7C0%7C636966714966543256&amp;sdata=eRp2O%2FIGjv0rfEDAFMQ4%2FIwcdVUlvsFxN3C3rEni0IQ%3D&amp;reserved=0
> 

-- 
Steve Decker, Associate Teaching Professor
Director, Meteorology Undergraduate Program
Department of Environmental Sciences           Phone: (848) 932-5750
Rutgers University                               Fax: (732) 932-8644
14 College Farm Rd                  Email: decker@xxxxxxxxxxxxxxxxxx
New Brunswick, NJ  08901-8551

• References:
  • [gembud] GDBIINT bug or corrupt NOAA grib2 file?
    • From: elowery