NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
uggh.. I just built what I thought was a pretty bullet proof LDM server 2x Quad core, 8gb ram, 2 500gb SATA2 HDD's 64bit CentOS 5.5 after setting up the ldmadmin-pl.conf for 3gb of a queue .. started it up, memory with in 30 minutes wax maxed out, so I added 4 more for a total of 12gb.. took the server a little longer this time, abt 3 hrs, now its running right at 10-11gb of memory.. is this normal ?? attached is my ldmd.conf, as I've read most memory usage can be traced to bad REQUEST lines.. anybody give me some help?? Jeff Lake K8JSL MichiganWxSystem.com WeatherMichigan.net
##### # $Id: ldmd.conf,v 1.18.12.5 2007/02/16 17:29:47 steve Exp $ # Sample ldmd.conf for ldm #### # # This is the main configuration file for the LDM server. All lines that start # with a "#" sign are comments. # # To debug an LDM that hangs on start up, run the following from LDM home: # % bin/rpc.ldmd -vl - -q data/ldm.pq etc/ldmd.conf # # If the LDM still hangs, comment out all lines in this file except noted # allow line entry below, try again. # ############################################################################### # WARNING: Pathological Product-ID Patterns ############################################################################### # # The REQUEST and ACCEPT entries both have product-ID patterns that are regular # expressions (RE-s). It is EXTREMELY IMPORTANT that these patterns not have a # ".*" prefix because: 1) such a prefix accomplishes nothing (i.e., the set of# possible matches is unaltered by the prefix); and 2) such a prefix causes the # RE to take MUCH, MUCH LONGER TO EXECUTE (by 3 orders of magnitude in some
# cases). Therefore, DO NOT USE RE-s like # # ".*UFPBA" # # Instead, simply use # # "UFPBA" # # The regex(1) utility of this package can be used to examine the efficiency # of an RE. # ############################################################################### # Include Statements ############################################################################### # # It's possible to include other files by uncommented-out statements # like the following: # #INCLUDE pathname #INCLUDE "pathname with spaces" # # Non-absolute pathnames are relative to the directory that contains the # configuration-file with the include statement. # ############################################################################### # Exec Entries ############################################################################### # # Programs that can share a queue with rpc.ldmd server, these programs # are started by the "exec" command and are in the same process group. # EXEC "pqact -v" EXEC "pqact -f DDPLUS etc/pqactb.conf" # # rtstats uses the LDM to send product latency statistics to the UPC. # For more info on rtstats please see the man page. EXEC "rtstats -f ANY -h rtstats.unidata.ucar.edu" #EXEC "rtstats -f ANY -h sasquatch.tamu.edu" EXEC "pqsurf -p ^(S[AP]) -Q /usr/local/ldm/data/pqsurf.pq -d /usr/local/ldm /usr/local/ldm/etc/pqsurf.conf" # ############################################################################### # Request Entries ############################################################################### # # Request data-products from upstream LDM-s. The syntax is # # REQUEST <feedset> <pattern> <host>[:<port>] # # where: # <feedset> Is the union of feedtypes to request. # <pattern> Is an extended regular-expression for the product- # identifiers to match. # <host> Is the host identifier: either a hostname or IP # address in "dotted-quad" format. # <port> Is the (optional) port on <host> to which to connect # (the square brackets denote an option and should be # omitted). # # If the same feedtype and pattern is requested from multiple hosts, then # the host of the first such request will be the initial primary source # of data-products (i.e., data-products will be rapidly sent using the # HEREIS message) and the other hosts will initially be alternate sources of # data-products (i.e., data will be sent using the COMMINGSOON and BLKDATA # messages). The primary host will probably change over time -- depending on # which host can deliver the data-products most quickly on average. # #REQUEST WMO ".*" initial-primary-host.some.domain:388 #REQUEST WMO ".*" initial-secondary-host.another.domain #REQUEST WMO ".*" another-secondary-host.yet_another.domain:3152 REQUEST NEXRAD3 ".*" weather.admin.niu.edu:388 REQUEST NEXRAD3 ".*" bigbird.tamu.edu:388 #REQUEST NEXRAD2 ".*" bigbird.tamu.edu:388 REQUEST IDS|DDPLUS ".*" bigbird.tamu.edu:388 REQUEST IDS|DDPLUS ".*" sasquatch.tamu.edu:388 REQUEST IDS|DDPLUS ".*" idd.aos.wisc.edu:388 REQUEST IDS|DDPLUS ".*" weather.admin.niu.edu:388 REQUEST HDS "KWNS" bigbird.tamu.edu:388 REQUEST HDS "HAXA.. K..." bigbird.tamu.edu:388 REQUEST HDS "SDUS." bigbird.tamu.edu:388 REQUEST HDS "KWBQ" bigbird.tamu.edu:388 REQUEST HDS "L[A-Y]U." bigbird.tamu.edu:388 #REQUEST HDS "(RUC|SST)" bigbird.tamu.edu:388 #REQUEST HDS "(/mNAM|/mNMM).*#211" bigbird.tamu.edu:388 REQUEST HDS "H.[A-W]... K" bigbird.tamu.edu:388 #REQUEST HDS "\/GFS\/#211" bigbird.tamu.edu:388 #REQUEST HDS "KNHC" bigbird.tamu.edu:388 REQUEST NGRID "KNHC" bigbird.tamu.edu:388 REQUEST NGRID "KWNO" bigbird.tamu.edu:388 #REQUEST CONDUIT "KWNO" bigbird.tamu.edu:388 REQUEST NGRID "KNHC" idd.aos.wisc.edu:388 REQUEST NGRID "KWNO" idd.aos.wisc.edu:388 #REQUEST CONDUIT "KWNO" idd.aos.wisc.edu:388 REQUEST CONDUIT "YKUZ98" idd.aos.wisc.edu:388 ## HURRICANE SECTOR GFS #REQUEST HDS "\/GFS\/#201.*APCP" bigbird.tamu.edu:388 #REQUEST HDS "\/GFS\/#201.*PRMSL" bigbird.tamu.edu:388 REQUEST NGRID "KNHC" sasquatch.tamu.edu:388 #REQUEST CONDUIT "KWNO" bigbird.tamu.edu:388 #REQUEST CONDUIT "YKUZ98" bigbird.tamu.edu:388 REQUEST NGRID "KNHC" bigbird.tamu.edu:388 REQUEST HDS "KWNS" idd.aos.wisc.edu:388 REQUEST HDS "HAXA.. K..." idd.aos.wisc.edu:388 #REQUEST HDS "(RUC|SST)" idd.aos.wisc.edu:388 #REQUEST HDS "L[A-Y]U.*" idd.aos.wisc.edu:388 #REQUEST HDS "KWBQ" idd.aos.wisc.edu:388 #REQUEST HDS "SDUS.*" idd.aos.wisc.edu:388 #REQUEST HDS "\/GFS\/#211" idd.aos.wisc.edu:388 #REQUEST HDS "(/mNAM|/mNMM).*#211" idd.aos.wisc.edu:388 REQUEST NIMAGE ".*" bigbird.tamu.edu:388 REQUEST NIMAGE ".*" weather.admin.niu.edu:388 # northern hemi #REQUEST NIMAGE "TIGF[01|02|05]" bigbird.tamu.edu:388 #REQUEST NIMAGE "TIGF[01|02|05]" weather.admin.niu.edu:388 # PR #REQUEST NIMAGE "TIGQ0[1-5]" bigbird.tamu.edu:388 #REQUEST NIMAGE "TIGP0[1-5]" weather.admin.niu.edu:388 #REQUEST UNIWISC ".*" bigbird.tamu.edu:388 REQUEST FNEXRAD ".*" bigbird.tamu.edu:388 REQUEST FNEXRAD ".*" sasquatch.tamu.edu:388 #REQUEST FNEXRAD ".*" idd.aos.wisc.edu:388 # EMWIN BACKUP REQUEST EXP ".*" ldm.aprsfl.net # USPLN REQUEST LIGHTNING ".*" ldm01.allisonhouse.com REQUEST LIGHTNING ".*" ldm02.allisonhouse.com ############################################################################## # Allow Entries ############################################################################### # # Give permission to downstream LDM-s to request data-products from your LDM. # # ALLOW <feedset> <hostname pattern> [<OK pattern> [<not pattern>]] # # where: # <feedset> is the set of feedtypes for this entry # <hostname pattern> is an extended regular-expression that specifies # which hosts are allowed to receive data-products # whose feedtype is in <feedset>. # <OK pattern> is an optional extended regular-expression that # a product-identifier must match in order to be # sent to the requesting LDM. The default value # is ".*". # <not pattern> is an optional extended regular-expression that # a product-identifier must NOT match in order to # be sent to the requesting LDM. If this field is # empty, then such matching will be disabled for # this entry. # # Under no circumstances comment out the next allow entry to localhost # The LDM will NOT start if the entry is commented-out. ALLOW ANY ^((localhost|loopback)|(127\.0\.0\.1\.?$)) .* # # Give permission to the Unidata Program Center ALLOW ANY ^[a-z].*\.unidata\.ucar\.edu\.?$ .* ALLOW ANY ^bigbird\.tamu\.edu$ .* ALLOW ANY ^sasquatch\.tamu\.edu$ .* ALLOW ANY ^wanderer.tamu.edu$ .* ALLOW ANY ^n5jxs\.dsl\.tamu\.edu$ .* ALLOW ANY ^64\.15\.155\.13$ .* ^EMWIN ALLOW ANY ^64\.34\.161\.113$ .* ^EMWIN ALLOW EXP ^.*\.edu$ .* ALLOW IDS|DDPLUS ^.*\.wxdata\.us$ .* ALLOW ANY ^67\.215\.181\.42$ .* ALLOW ANY ^70\.38\.71\.84$ .* ALLOW IDS|DDPLUS ^wxfeeds\.weatherserver\.net$ .* # ############################################################################### # Accept Entries ############################################################################### # ACCEPT: Who can feed us without be requested by a REQUEST entry, currently # this action is ONLY needed for WSI data # # ACCEPT <feedset> <pattern> <hostname pattern> # # ACCEPT anything from yourself # #ACCEPT ANY ".*" ^((localhost|loopback)|(127\.0\.0\.1\.?$)) # # accept from your upstream site # # WSI is using ldm4 protocol so the accept is still required #ACCEPT WSI # .* # ^[a-z].*\.uni\.wsicorp\.com$ # ################################################################################ End ###############################################################################
ldm-users archives: