Re: [ldm-users] NEXRAD3 & NEXRAD2

• To: "daryl herzmann" <akrherz@xxxxxxxxxxx>
• Subject: Re: [ldm-users] NEXRAD3 & NEXRAD2
• From: "Jeff Lake - Admin" <admin@xxxxxxxxxxxxxxxxxxxx>
• Date: Mon, 12 Apr 2010 14:43:32 -0400

Hi Daryl ..

I just have the following in my pqact.conf

   FILE    data/raw/level2/\1/\1_\2_\3


didn't know, (or read) about entries in the pq exec lines

and yes .. it has become pretty busy ..

-Jeff



Subject: Re: [ldm-users] NEXRAD3 & NEXRAD2

On Mon, 12 Apr 2010, Jeff Lake - Admin wrote:

I have been watching the server in my system that receives NEXRAD2 & 3 during our mini severe outbreak Easter Weekend it fell drastically behind in storing NEXRAD2 (on the tune of 30-45 minutes) at that time it had 4gb RAM on a 10Mbit port ..

Jeff,

Do you have your pqact split across multiple files? Each pqact process can only take up 32 child processes, so if you have a busy system, pqact will wait for "slots" to open up before it can start a new write or process. So I do something like this in ldmd.conf

exec    "pqact -p BZIP2/K[A-D] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[E-H] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[I-K] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[L-O] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[P-R] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[S-Z] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/[NTP] -f CRAFT etc/pqact.CRAFT"

Notice how the regex splits up the processing, eventhough I use the same pqact config file in each.

daryl

• References:
  • [ldm-users] NEXRAD3 & NEXRAD2
    • From: Jeff Lake - Admin
  • Re: [ldm-users] NEXRAD3 & NEXRAD2
    • From: daryl herzmann