[ldm-users] Missing Data Using Primary/Alternate Hosts

• To: ldm-users@xxxxxxxxxxxxxxxx
• Subject: [ldm-users] Missing Data Using Primary/Alternate Hosts
• From: Shelly Knight <sknight@xxxxxxxx>
• Date: Tue, 04 Dec 2007 10:58:16 -0700

Hi,

We currently have 2 project machines (kitty and hawk) running an ldm and
ingesting data from our divisions' main ldm server (awl). Kitty and hawk
then feed about 5-6 project machines.

We'd like kitty and hawk to serve as primary and alternate feeds, so I
have the ldmd.conf file setup like this on the project's downstream hosts:

request EXP     "^([0-9]{12})_NCV_"   kitty.rap.ucar.edu
request EXP     "^([0-9]{12})_NCV_"   hawk.rap.ucar.edu

For this particular dataset, we should be receiving files every 5
minutes. When I have it setup as a primary and alternate feed, the data
comes in sporadically, but roughly every 10 minutes. If I remove one
host, we receive the data every 5 minutes.

What am I doing wrong in my config file? I've attached a copy of the
whole file for you.

Thanks!
Shelly

Shelly Knight
ADDS Development Team
NCAR/RAL
(303)497-2821

#####
# ldmd.conf for ldm5
####

#
# Programs that share a queue with rpc.ldmd
# are started by it and are in the same process group.
#
#exec   "pqbinstats -d /data/ldm"
#exec   "pqbinstats"

#exec   "pqexpire"
exec    "pqbinstats -d /home/ldm/logs"
exec    "pqact  -l /home/ldm/logs/pqact.log -d /home/ldm 
/home/ldm/etc/pqact.conf"

#
# LDM5 servers we ask for data
#
#       request <feedset> <pattern> <hostname pattern>
#

# Primary and alternate RAL top-level LDM hosts
request WMO     ".*"    kitty.rap.ucar.edu 
request WMO     ".*"    hawk.rap.ucar.edu 

# Sat images from Steve Danz - AWC
request IMAGE   ".*"    kitty.rap.ucar.edu
request IMAGE   ".*"    hawk.rap.ucar.edu

# The "OTHER" notifs (grib_notify)
request OTHER   ".*"    kitty.rap.ucar.edu
request OTHER   ".*"    hawk.rap.ucar.edu

# EXP products.  KKCI gets pass through exp feeds from AWC; others from within 
RAL
# KKCI feed includes CIP, GTG, and NCWD/F 
request EXP     " KKCI" kitty.rap.ucar.edu
request EXP     " KKCI" hawk.rap.ucar.edu

# According to unidata folks, it is best to have one specific request line, 
rather than several
# requests, which each creates a new process.
request EXP     "^(FIP_SLD|FIP_ICE|FIP_ICE_SEV|[CF]IP_AK)"      
kitty.rap.ucar.edu
request EXP     "^(FIP_SLD|FIP_ICE|FIP_ICE_SEV|[CF]IP_AK)"      
hawk.rap.ucar.edu

# National Ceiling and Visibility Analysis files.
request EXP     "^([0-9]{12})_NCV_"     kitty.rap.ucar.edu      PRIMARY
request EXP     "^([0-9]{12})_NCV_"     hawk.rap.ucar.edu       ALTERNATE

# EXP products direct from RAL hosts
request EXP     "^ITFA" owpdt-turb.rap.ucar.edu
#request        EXP     "^([0-9]{8})_([0-9]{4})_(OWCTOP)"       
owpdt-turb.rap.ucar.edu

###############################################################################
# Begin Access control
###############################################################################

###############################################################################
# ALLOW: Who we are willing to feed
#
# allow <feedset> <hostname pattern>
###############################################################################

# send anything to your own machine
allow   ANY     
^((localhost|loopback)|(127\.0\.0\.1\.?$)|(.*\.rap\.ucar\.edu\.?$))

###############################################################################
# ACCEPT: Who can feed us
#
# accept <feedset> <pattern> <hostname pattern>
###############################################################################

# accept anything from yourself
accept  ANY "" ^((localhost|loopback)|(127\.0\.0\.1\.?$))

###############################################################################
# End Access control
###############################################################################

• Follow-Ups:
  • Re: [ldm-users] Missing Data Using Primary/Alternate Hosts
    • From: Gerry Creager