NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: 20020425: RAP IIDA Icing product to FSL questions again (fwd)



---------- Forwarded message ----------
Date: Wed, 8 May 2002 10:43:21 -0600 (MDT)
From: Celia Chen <address@hidden>
To: Jeff Weber <address@hidden>
Subject: Re: 20020425: RAP IIDA Icing product to FSL questions again

Yes, we are using pqinsert instead of ldmsend now. 

Thanks again.

Celia

> 
> Hi Celia, 
> 
> Still using pqinsert instead of ldmsend?
> 
> If so, the bigger queue would make sense, otherwise I do not think we have
> resolved the issue...
> 
> Glad to hear things are working.
> 
> Thanks for the update,
> 
> -Jeff
> ____________________________                  _____________________
> Jeff Weber                                    address@hidden
> Unidata Support                               PH:303-497-8676 
> NWS-COMET Case Study Library                  FX:303-497-8690
> University Corp for Atmospheric Research      3300 Mitchell Ln
> http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000
> ________________________________________      ______________________
> 
> On Wed, 8 May 2002, Celia Chen wrote:
> 
> > Hi Jeff,
> > 
> > The files seem to be sent okay now.  I am not sure what did it.  One thing
> > I did was to increase the pq_size. 
> > 
> > To answer your question about the feedtype, all the products are sent as
> > EXP type.
> > 
> > Thanks for your help.
> > 
> > Celia
> > 
> > 
> > > 
> > > On Tue, 7 May 2002, Celia Chen wrote:
> > > 
> > > > Hi Jeff,
> > > > 
> > > > We have been sending those two different types of products out for 
> > > > sometime
> > > > now without problems. I asked the person who wrote the script to use 
> > > > pqinsert 
> > > > instead of ldmsend yesterday. Do you think that would make a difference?
> > > 
> > > pqinsert is more robust, ldmsend is a one shot deal, if it does not
> > > transfer...it does not transfer. pqinsert at least puts it in the queue so
> > > multiple attempts to send can be carried out if a packet drops.
> > > 
> > >  I
> > > > still see missing products when I do ldmadmin watch. I have also asked
> > > > the user to save the data files on the disk for a longer period 
> > > > of time - to make sure the file is there when needed to be. 
> > > > 
> > > > Also, people use front to send out two other grb products in addition
> > > > to these two. Could this be the reason that causes data not to be
> > > > delevered?
> > > 
> > > On the same feedtype?
> > > 
> > > 
> > > It could be consuming bandwidth if they are large, or if you have a slow
> > > machine..and w/ldmsend they are not resent. Between here and FSL one would
> > > not think bandwidth should be an issue...
> > > 
> > > 
> > > 
> > > Jeff Weber
> > > Unidata Support
> > > 
> > > 
> > > > Thanks.
> > > > 
> > > > Celia
> > > > 
> > > > > 
> > > > > HI Celia, 
> > > > > 
> > > > > Something I just noticed:
> > > > > 
> > > > >  May 06 20:26:10 front iita(noti)[9725]: 2002050620f00_IIDA.grb: RPC:
> > > > > Unable to receive
> > > > > 
> > > > > oppossed to
> > > > > 
> > > > > request  EXP   "RAP\.Icing\.IIDA\.ASCII
> > > > > 
> > > > > one is looking for .ascii and the other is .grb...could be an issue.
> > > > > 
> > > > > Thank you,
> > > > > 
> > > > > -Jeff
> > > > > ____________________________                  _____________________
> > > > > Jeff Weber                                    address@hidden
> > > > > Unidata Support                               PH:303-497-8676 
> > > > > NWS-COMET Case Study Library                  FX:303-497-8690
> > > > > University Corp for Atmospheric Research      3300 Mitchell Ln
> > > > > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000
> > > > > ________________________________________      ______________________
> > > > > 
> > > > > On Mon, 6 May 2002, Celia Chen wrote:
> > > > > 
> > > > > > Jeff,
> > > > > > 
> > > > > > I setup to request the Icing product from iita and here is what I 
> > > > > > got:
> > > > > > 
> > > > > > May 06 20:26:10 front iita(noti)[9725]: 2002050620f00_IIDA.grb: 
> > > > > > RPC: Unable to receive
> > > > > > May 06 20:26:10 front iita(noti)[9725]: pq_sequence failed: I/O 
> > > > > > error (errno = 5)
> > > > > > May 06 20:26:10 front iita(noti)[9725]: Exiting 
> > > > > > 
> > > > > > Please advise.
> > > > > > 
> > > > > > Thanks.
> > > > > > 
> > > > > > Celia
> > > > > > 
> > > > > > > 
> > > > > > > He Jeff, 
> > > > > > > 
> > > > > > > Here is what I got from the FSL last week - I asked for a copy of 
> > > > > > > the
> > > > > > > ldmd.conf file:
> > > > > > > > > Here is our request line for the IIDA/IIFA data:
> > > > > > > > >
> > > > > > > > > request  EXP   "RAP\.Icing\.IIDA\.ASCII"        
> > > > > > > > > front.rap.ucar.edu               
> > > > > > > 
> > > > > > > Is there an LDM command that I can use to see if the product is 
> > > > > > > indeed sent out 
> > > > > > > from front?
> > > > > > > 
> > > > > > > Thanks.
> > > > > > > 
> > > > > > > Celia
> > > > > > > 
> > > > > > > > 
> > > > > > > > Hi Jeff,
> > > > > > > > 
> > > > > > > > As you can see I am still working on this problem.  I tried to 
> > > > > > > > get a copy of
> > > > > > > > the ldmd.conf file from FSL but have not received one yet. Can 
> > > > > > > > you tell me  what
> > > > > > > > "Connection reset by peer" mean, as shown in the following log 
> > > > > > > > messages?
> > > > > > > > Looks like the following 3 lines appeared when the prduct 
> > > > > > > > didn't get to
> > > > > > > > FSL.
> > > > > > > > 
> > > > > > > > 
> > > > > > > > May 06 20:03:38 front localhost[9404]: hiya: 20020506190338.844 
> > > > > > > > TS_ENDT {{EXP,  ".*"}}
> > > > > > > > May 06 20:03:38 front localhost[9404]: Connection reset by peer
> > > > > > > > May 06 20:03:38 front localhost[9404]: Exiting    
> > > > > > > > 
> > > > > > > > 
> > > > > > > > Thanks.
> > > > > > > > 
> > > > > > > > Celia
> > > > > > > > 
> > > > > > > > > 
> > > > > > > > > Hi Celia, 
> > > > > > > > > 
> > > > > > > > > nullproc(gobbo.fsl.noaa.gov): RPC: Timed out
> > > > > > > > > 
> > > > > > > > > Yes, this could cause you to lose products..
> > > > > > > > > 
> > > > > > > > > I am guessing here, because (I assume) gobbo has removed the 
> > > > > > > > > ALLOW
> > > > > > > > > *.unidata.ucar.edu line from their ldmd.conf so I cannot 
> > > > > > > > > query gobbo.
> > > > > > > > > 
> > > > > > > > > I am also guessing, but suspect strongly, that this section 
> > > > > > > > > has been
> > > > > > > > > incorrectly modified..
> > > > > > > > > 
> > > > > > > > > ###############################################################################
> > > > > > > > > 
> > > > > > > > > # send anything to your own machine
> > > > > > > > > allow   ANY
> > > > > > > > > 
> > > > > > > > > ^((localhost|loopback)|(127\.0\.0\.1\.?$)|([a-z].*\.unidata\.ucar\.edu\.?$))
> > > > > > > > > 
> > > > > > > > > ###############################################################################
> > > > > > > > > # ACCEPT: Who can feed us
> > > > > > > > > #
> > > > > > > > > # accept <feedset> <pattern> <hostname pattern>
> > > > > > > > > ###############################################################################
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > # accept anything from yourself
> > > > > > > > > accept  ANY     .*      
> > > > > > > > > ^((localhost|loopback)|(127\.0\.0\.1\.?$))
> > > > > > > > > ------------------------------------------------------------------------------
> > > > > > > > > 
> > > > > > > > > Can you get a copy of their ldmd.conf to confirm or dissolve 
> > > > > > > > > this
> > > > > > > > > hypothesis..
> > > > > > > > > 
> > > > > > > > > Thank you,
> > > > > > > > > 
> > > > > > > > > -Jeff
> > > > > > > > > ____________________________                  
> > > > > > > > > _____________________
> > > > > > > > > Jeff Weber                                    address@hidden
> > > > > > > > > Unidata Support                               PH:303-497-8676 
> > > > > > > > > NWS-COMET Case Study Library                  FX:303-497-8690
> > > > > > > > > University Corp for Atmospheric Research      3300 Mitchell Ln
> > > > > > > > > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 
> > > > > > > > > 80307-3000
> > > > > > > > > ________________________________________      
> > > > > > > > > ______________________
> > > > > > > > > 
> > > > > > > > > On Thu, 25 Apr 2002, Unidata Support wrote:
> > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > ------- Forwarded Message
> > > > > > > > > > 
> > > > > > > > > > >To: address@hidden
> > > > > > > > > > >cc: address@hidden (Celia Chen)
> > > > > > > > > > >From: Celia Chen <address@hidden>
> > > > > > > > > > >Subject: Re: RAP IIDA Icing (fwd)
> > > > > > > > > > >Organization: UCAR/Unidata
> > > > > > > > > > >Keywords: 200204251739.g3PHdFa00107
> > > > > > > > > > 
> > > > > > > > > > Dear Support,
> > > > > > > > > > 
> > > > > > > > > > We are using the LDM to send the Icing product to FSL and 
> > > > > > > > > > having
> > > > > > > > > > missing data problems recently.  I noticed the following 
> > > > > > > > > > from this
> > > > > > > > > > morning's ldmd.log:
> > > > > > > > > > 
> > > > > > > > > > Apr 25 15:42:32 front gobbo[2448]: Connection from 
> > > > > > > > > > gobbo.fsl.noaa.gov
> > > > > > > > > > Apr 25 15:42:36 front gobbo[2448]: Connection reset by peer
> > > > > > > > > > Apr 25 15:42:36 front gobbo[2448]: Exiting  
> > > > > > > > > > 
> > > > > > > > > > and
> > > > > > > > > > 
> > > > > > > > > > Apr 25 15:48:46 front gobbo(feed)[384]: 
> > > > > > > > > > nullproc(gobbo.fsl.noaa.gov): RPC: Timed out
> > > > > > > > > > Apr 25 15:48:46 front gobbo(feed)[384]: Exiting
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > Please tell me what these messages mean and are they the 
> > > > > > > > > > reasons that FSL
> > > > > > > > > > didn't get the feed?
> > > > > > > > > > 
> > > > > > > > > > Thanks in advance.
> > > > > > > > > > 
> > > > > > > > > > Celia
> > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > On Thu, 2002-04-25 at 15:39, Jonathan Auerbach wrote:
> > > > > > > > > > > > RAP IIDA Icing last received at 04/25/02 12:18Z. Uptime 
> > > > > > > > > > > > unknown.
> > > > > > > > > > > >  
> > > > > > > > > > > 
> > > > > > > > > > > Celia/Frank,
> > > > > > > > > > > 
> > > > > > > > > > > We are still getting rather inconsistent delivery of IDDA 
> > > > > > > > > > > icing
> > > > > > > > > > > products. Here's our local dir listing:
> > > > > > > > > > > 
> > > > > > > > > > > /public/data/grids/ruc2/40km_fsl-conus_icing/iida/ascii/*
> > > > > > > > > > > Expected frequency: 1.0 hour
> > > > > > > > > > > 
> > > > > > > > > > > Modify Time           Size        Filename
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > 04/24/02 17:19      11329832      2002042417
> > > > > > > > > > > 04/24/02 18:18      11329832      2002042418
> > > > > > > > > > > * Have a gap... deltaT = 300 min   #missed = 4
> > > > > > > > > > > 
> > > > > > > > > > > 04/24/02 23:18      11329832      2002042423
> > > > > > > > > > > 04/25/02 00:18      11329832      2002042500
> > > > > > > > > > > 04/25/02 01:18      11329832      2002042501
> > > > > > > > > > > * Have a gap... deltaT = 420 min   #missed = 6
> > > > > > > > > > > 
> > > > > > > > > > > 04/25/02 08:18      11329832      2002042508
> > > > > > > > > > > 04/25/02 09:18      11329832      2002042509
> > > > > > > > > > > * Have a gap... deltaT = 180 min   #missed = 2
> > > > > > > > > > > 
> > > > > > > > > > > 04/25/02 12:18      11329832      2002042512
> > > > > > > > > > > 
> > > > > > > > > > > 
> > > > > > > > > > > The NCAR web page shows 15z has been produced but we are 
> > > > > > > > > > > not showing
> > > > > > > > > > > notifications coming from front via ldm since delivery of 
> > > > > > > > > > > the 12z file.
> > > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > > ------- End of Forwarded Message
> > > > > > > > > > 
> > > > > > > > > > 
> > > > > > > > > 
> > > > > > > > > 
> > > > > > > > 
> > > > > > > > 
> > > > > > > > -- 
> > > > > > > > Celia Chen
> > > > > > > > RAP/NCAR
> > > > > > > > 
> > > > > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > > > > >                                         - Dove Milk Promises
> > > > > > > > 
> > > > > > > > 
> > > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > > -- 
> > > > > > > Celia Chen
> > > > > > > RAP/NCAR
> > > > > > > 
> > > > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > > > >                                   - Dove Milk Promises
> > > > > > > 
> > > > > > > 
> > > > > > > 
> > > > > > 
> > > > > > 
> > > > > > -- 
> > > > > > Celia Chen
> > > > > > RAP/NCAR
> > > > > > 
> > > > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > > > >                                     - Dove Milk Promises
> > > > > > 
> > > > > > 
> > > > > > 
> > > > > 
> > > > > 
> > > > 
> > > > 
> > > > -- 
> > > > Celia Chen
> > > > RAP/NCAR
> > > > 
> > > > "Nothing is as strong as gentleness or as gentle as strength."
> > > >                                         - Dove Milk Promises
> > > > 
> > > > 
> > > > 
> > > 
> > > 
> > 
> > 
> > -- 
> > Celia Chen
> > RAP/NCAR
> > 
> > "Nothing is as strong as gentleness or as gentle as strength."
> >                                     - Dove Milk Promises
> > 
> > 
> > 
> 
> 


-- 
Celia Chen
RAP/NCAR

"Nothing is as strong as gentleness or as gentle as strength."
                                        - Dove Milk Promises