NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Patrick Finnegan wrote:
Hi all,I seem to be having some problems downloading data via ldm from the new Super Res sites. Unfortunately, a person who has moved on set up our LDM infrastructure, and I don't have a very thorough understanding of all of the bits of it.All of the "Super Res" sites are downloading their data, and either the files are not completely downloading, or are not properly getting renamed after they download... For example, an ls -ga of KABR's directory looks like this:-rw------- 1 ldm 1266789 Jul 4 17:08 .KABR_20080704_2059 -rw------- 1 ldm 1266485 Jul 4 17:18 .KABR_20080704_2108 -rw------- 1 ldm 1266864 Jul 4 17:27 .KABR_20080704_2118 -rw------- 1 ldm 1262873 Jul 4 17:36 .KABR_20080704_2127 -rw------- 1 ldm 1262526 Jul 4 17:46 .KABR_20080704_2136 -rw------- 1 ldm 1260206 Jul 4 17:55 .KABR_20080704_2146 ,,,I tried upgrading ldm to the newest version (6.6.5), keeping the same configuration files as before, but it didn't help any.Does anyone here have any idea what could be wrong, or what else I could look at?
SuperRes ("Build 10") changed a number of things, including the filenames.I'm glad to look at your ldmd.conf and the appropriate pqact.conf files, having recently fought this battle and won.
In general, the pqact incantation looks something like this:CRAFT ^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-9])
FILE data/gempak/nexrad/craft/\1/\1_\2_\3In older incantations, we stored the 100-radial scans in an intermediate hidden file 'til the whole volume scan was completed, as indicated by a "/E" as the last character of a radial scan filename. The End-Of-Scan "E" is now embedded in the middel of the name, making its capture a little more interesting. What we do here, then, is to ignore it, and just expose the incomplete volume scan as it's filled.
To trigger image-making sprees based on a completed volume scan (using Gempak 5.11.1) we have 2 pqactions: one for BUILD 9 filenames and one for BUILD 10 filenames:
CRAFT ^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E$
EXEC scripts/\1.sh \3/\4CRAFT ^L2-BZIP2/(K...)/([0-9][0-9][0-9][0-9][0-1][0-9])([0-3][0-9])([0-2][0-9][0-5][0-9])([0-9][0-9]).*/E/
EXEC scripts/\1.sh \3/\4The regex substitution identifies the appropriate site, AND includes the RADTIM file designation.
Gerry -- Gerry Creager -- gerry.creager@xxxxxxxx Texas Mesonet -- AATLT, Texas A&M University Cell: 979.229.5301 Office: 979.458.4020 FAX: 979.862.3983 Office: 1700 Research Parkway Ste 160, TAMU, College Station, TX 77843
ldm-users
archives: