Pattern in Late Data

• To: ldm-users@xxxxxxxxxxxxxxxx
• Subject: Pattern in Late Data
• From: owner-ldm-users@xxxxxxxxxxxxxxxx
• Date: Wed, 9 Oct 2002 18:24:42 -0000

Larry et al,

All seems to be well here at Purdue (feeding from UIUC).  From time to
time, my SAO's aren't filed until :45 after the hour (normally filed at
:07 after), but there is no pattern there that I can see.  I'd suspect a
local issue.

Ben

===================================================
Benjamin J. Cotton
LDM/Forecast Game Administrator
Department of Earth and Atmospheric Science,
Purdue University

165 Cary Quadrangle                         cell: (502) 551-5403
West Lafayette, IN  47906         campus: (765) 49-52298

bcotton@xxxxxxxxxxxxxx                     www.eas.purdue.edu/ldm
www.eas.purdue.edu/~bcotton           www.eas.purdue.edu/forecast


-----Original Message-----
[mailto:owner-ldm-users@xxxxxxxxxxxxxxxx] On Behalf Of Larry Riddle
Sent: Wednesday, October 09, 2002 15:07
Cc: Larry Riddle; support@xxxxxxxxxxxxxxxx

For the last few weeks, I've been noticing a pattern in late or missing 
data here at SIO.  Between about 02Z and 05Z my product queue frequently

gets well behind the power curve.  The METARs (and, probably, every
other 
obs type) can be as much as 90 minutes late getting into the hourly
files.

Most of the time the system is able to handle this acceptably but, on 
occasion, many of the observations are lost.  This occurred again last 
night.  My 20021009 03Z METAR file, which should be around 550,000
bytes, 
is only 211,206 bytes.  All of today's files from 02Z (possibly as early
as 
01Z) through 04Z are significantly smaller than I would normally expect.

This is probably not a CPU usage problem as the IDD machine 
(aeolus.ucsd.edu) has no other function in life.  All it does is process

the LDM and build some text files for our weather web page.

Is this problem unique to SIO (and my downstream nodes)?  If so, I'll
look 
for a solution locally.  Is anybody else experiencing delays like 
this?  Does this have anything to do with the 00Z HDS product cycle?  If

this problem isn't unique to the SIO branch of the IDD tree, then I'll
buck 
this up to the Unidata support people.

Larry


 
---===---=-=-=-=-=-=-=-=-=-=-=====[\/]=====-=-=-=-=-=-=-=-=-=-=---===---
    -----===(*  Climate's what we expect, but weather's what we 
get.  *)===-----
   Larry Riddle : Climate Research Division : Scripps Institution of 
Oceanography
       University of California, San Diego : La Jolla, California
92093-0224
       Phone: (858) 534-1869 : Fax: (858) 534-8561 : E-Mail:
lriddle@xxxxxxxx

• References:
  • Pattern in Late Data
    • From: Larry Riddle