NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[GEMPAK #DXU-339106]: gempak stopped making images



Leonard,

if "kill pid" doesn't succeed in killing a process, then "kill -9 pid"
should kill the process. 

In your case, the zombie processes may still be trying to either talk to a 
devide driver,
such as "xw", "gf" or "ps", or waiting for a response from the message queue
(the ipcs command will show message queues in use).

I cannot tell you at what point you ran out of resources. If your script is 
unable to
connect to a DISPLAY that it was using, then that would be a problem. 
Otherwise, the use of cntl-C
is bad since it doesn't remove the message queues.

After running "cleanup -c" if message queues still exist, and gplt and devices
still exist, then a reboot is the simplest solution- but you still need to
examine the running plot script to determine if the error condition still 
exists.

Steve Chiswell
Unidata User SUpport




> I tried that but no luck.
> I tried to kill all the gplt prcesses, but they won't stop. The I ran cleanup 
> -c and re-ran the script, but it still had the same error. I used cntrl-C to 
> kill my gempak process.
> 
> wrf@localhost-> ps -ax | grep gplt
> Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.6/FAQ
> 5587 ?        Z      0:00 [gplt] <defunct>
> 8679 ?        Z      0:00 [gplt] <defunct>
> 9675 ?        Z      0:00 [gplt] <defunct>
> 19504 ?        Z      0:00 [gplt] <defunct>
> 25470 ?        Z      0:00 [gplt] <defunct>
> 3158 ?        Z      0:00 [gplt] <defunct>
> 4793 pts/1    S+     0:00 grep gplt
> wrf@localhost-> kill 5587
> wrf@localhost-> ps -ax | grep gplt
> Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.6/FAQ
> 5587 ?        Z      0:00 [gplt] <defunct>
> 8679 ?        Z      0:00 [gplt] <defunct>
> 9675 ?        Z      0:00 [gplt] <defunct>
> 19504 ?        Z      0:00 [gplt] <defunct>
> 25470 ?        Z      0:00 [gplt] <defunct>
> 3158 ?        Z      0:00 [gplt] <defunct>
> 4796 pts/1    S+     0:00 grep gplt
> wrf@localhost->
> 
> 
> wrf@localhost-> script_drvr.csh 
> /home/wrf/wrf/runs/fortuna/wrfpost/gempak/2007070412_wrf_d01.gem
> 
> Begin script_drvr.csh
> 
> Creating process: gplt for queue 786432
> GDATTIM   Grid date/time                    LAST
> GLEVEL    Grid level                        500
> GVCORD    Grid vertical coordinate          PRES
> GFUNC     Scalar grid                       TMPC
> GDFILE    Grid file                         $GEMDATA/HRCBOB.GRD
> CINT      Contour interval/min/max          0
> LINE      Color/type/width/label/smth/fltr  3
> MAP       Map color/dash/width/filter flag  1
> MSCALE    fgc;bgc;mask/units/lat;hide/valu  0
> TITLE     Title color/line/title            1
> DEVICE    Device|name|x size;y size|color   XW
> SATFIL    Satellite image filename(s)
> RADFIL    Radar image filename(s)
> IMCBAR    Color/ornt/anch/x;y/ln;wd/freq
> PROJ      Map projection/angles/margins|dr  MER
> GAREA     Graphics area                     WV
> IJSKIP    Iskp;Istrt;Istp/Jskp;Jstrt;Jstp
> CLEAR     Clear screen flag                 YES
> PANEL     Panel loc/color/dash/width/regn   0
> TEXT      Size/fnt/wdth/brdr/N-rot/just/hw  1
> SCALE     Scalar scale / vector scale       999
> LATLON    Line color/dash/width/freq/inc/l
> HILO      Color/symbol/rng/rad/cnt/intp
> HLSYM     HILO txt size/posn/font/wdth/hw
> CLRBAR    Color/ornt/anch/x;y/ln;wd/freq|t
> CONTUR    Subbox/smooth                     0
> SKIP      Skip_cntr/skip_plt_x;skip_plt_y   0
> FINT      Fill interval/min/max             0
> FLINE     Fill colors/fill types            10-20
> CTYPE     Contour type:  C/F                C
> LUTFIL    Enhancement lookup table filenam
> STNPLT    Txtc/txt attr|marker attr|stnfil
> Parameters requested: GDATTIM,GLEVEL,GVCORD,GFUNC,GDFILE,CINT,LINE,MAP,
> MSCALE,TITLE,DEVICE,SATFIL,RADFIL,IMCBAR,PROJ,GAREA,IJSKIP,CLEAR,PANEL,TEXT,
> SCALE,LATLON,HILO,HLSYM,CLRBAR,CONTUR,SKIP,FINT,FLINE,CTYPE,LUTFIL,STNPLT.
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR>Creating process: 
> gf for queue 819201
> *** glibc detected *** gdcntr: double free or corruption (out): 
> 0x000000000171aa20 ***
> ======= Backtrace: =========
> /lib64/libc.so.6[0x36fd96d7a3]
> /lib64/libc.so.6(__libc_free+0x84)[0x36fd96d924]
> gdcntr[0x48e62c]
> gdcntr[0x48c37f]
> gdcntr[0x48abba]
> gdcntr[0x479507]
> gdcntr[0x4788a7]
> gdcntr[0x4782f5]
> gdcntr[0x46f043]
> gdcntr[0x42d01a]
> gdcntr[0x42a511]
> gdcntr[0x42a2a4]
> gdcntr[0x436108]
> gdcntr[0x4292f7]
> gdcntr[0x422626]
> gdcntr[0x406f7a]
> gdcntr[0x404387]
> gdcntr[0x4fa9c6]
> /lib64/libc.so.6(__libc_start_main+0xf4)[0x36fd91d084]
> gdcntr[0x403759]
> ======= Memory map: ========
> 00400000-00534000 r-xp 00000000 fd:00 3178607                            
> /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> 00633000-00639000 rw-p 00133000 fd:00 3178607                            
> /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> 00639000-0172b000 rw-p 00639000 00:00 0                                  
> [heap]
> 36fd700000-36fd719000 r-xp 00000000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd819000-36fd81a000 r--p 00019000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd81a000-36fd81b000 rw-p 0001a000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd900000-36fda3f000 r-xp 00000000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fda3f000-36fdb3f000 ---p 0013f000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb3f000-36fdb43000 r--p 0013f000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb43000-36fdb44000 rw-p 00143000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb44000-36fdb49000 rw-p 36fdb44000 00:00 0
> 36fdc00000-36fdc80000 r-xp 00000000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdc80000-36fdd80000 ---p 00080000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdd80000-36fdd81000 r--p 00080000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdd81000-36fdd82000 rw-p 00081000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 3703d00000-3703d0d000 r-xp 00000000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 3703d0d000-3703e0d000 ---p 0000d000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 3703e0d000-3703e0e000 rw-p 0000d000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 2afc1ca47000-2afc1ca4b000 rw-p 2afc1ca47000 00:00 0
> 2afc1ca5d000-2afc1ca5e000 rw-p 2afc1ca5d000 00:00 0
> 2afc1ca5e000-2afc1ca7b000 r-xp 00000000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1ca7b000-2afc1cb7b000 ---p 0001d000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1cb7b000-2afc1cb7c000 rw-p 0001d000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1cb7c000-2afc1cb82000 rw-p 2afc1cb7c000 00:00 0
> 2afc1cc00000-2afc1cc21000 rw-p 2afc1cc00000 00:00 0
> 2afc1cc21000-2afc1cd00000 ---p 2afc1cc21000 00:00 0
> 7fffffe77000-7fffffe8e000 rw-p 7fffffe77000 00:00 0                      
> [stack]
> ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0                  
> [vdso]
> IOT Trap
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> -----Original Message-----
> From: Unidata GEMPAK Support [mailto:address@hidden]
> Sent: Tue 7/3/2007 12:31 PM
> To: Leonard H. Montenegro
> Cc: address@hidden
> Subject: [GEMPAK #DXU-339106]: gempak stopped making images
> 
> 
> If you kill a program, or one dies unexpectedly, ensure you haven't
> hung any message queues or left devide drivers and gplt processes running.
> 
> Run the cleanup script to remove message queues and kill gplt
> and device processes, eg: "cleanup -c"
> 
> Steve Chiswell
> Unidata User Support
> 
> > Hello,
> >
> > Our GEMPAK setup has stopped making images and the process needs to be
> > killed.
> >
> > The last few lines of our log files are below.
> >
> > I would appreciate any help in this matter.
> >
> > Cordially,
> >
> > Leonard
> >
> >
> >
> > ...
> >
> > gdcntr[0x404387]
> >
> > gdcntr[0x4fa9c6]
> >
> > /lib64/libc.so.6(__libc_start_main+0xf4)[0x36fd91d084]
> >
> > gdcntr[0x403759]
> >
> > ======= Memory map: ========
> >
> > 00400000-00534000 r-xp 00000000 fd:00 3178607
> > /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> >
> > 00633000-00639000 rw-p 00133000 fd:00 3178607
> > /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> >
> > 00639000-0172b000 rw-p 00639000 00:00 0
> > [heap]
> >
> > 36fd700000-36fd719000 r-xp 00000000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd819000-36fd81a000 r--p 00019000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd81a000-36fd81b000 rw-p 0001a000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd900000-36fda3f000 r-xp 00000000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fda3f000-36fdb3f000 ---p 0013f000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb3f000-36fdb43000 r--p 0013f000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb43000-36fdb44000 rw-p 00143000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb44000-36fdb49000 rw-p 36fdb44000 00:00 0
> >
> > 36fdc00000-36fdc80000 r-xp 00000000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdc80000-36fdd80000 ---p 00080000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdd80000-36fdd81000 r--p 00080000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdd81000-36fdd82000 rw-p 00081000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 3703d00000-3703d0d000 r-xp 00000000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 3703d0d000-3703e0d000 ---p 0000d000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 3703e0d000-3703e0e000 rw-p 0000d000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 2ba6626c6000-2ba6626ca000 rw-p 2ba6626c6000 00:00 0
> >
> > 2ba6626dc000-2ba6626dd000 rw-p 2ba6626dc000 00:00 0
> >
> > 2ba6626dd000-2ba6626fa000 r-xp 00000000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6626fa000-2ba6627fa000 ---p 0001d000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6627fa000-2ba6627fb000 rw-p 0001d000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6627fb000-2ba662801000 rw-p 2ba6627fb000 00:00 0
> >
> > 2ba662900000-2ba662921000 rw-p 2ba662900000 00:00 0
> >
> > 2ba662921000-2ba662a00000 ---p 2ba662921000 00:00 0
> >
> > 7fffffc32000-7fffffc48000 rw-p 7fffffc32000 00:00 0
> > [stack]
> >
> > ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0
> > [vdso]
> >
> > IOT Trap
> >
> > **********************************************************************
> > NOTICE: This e-mail (and any attachments) may contain PRIVILEGED OR 
> > CONFIDENTIAL information and is intended only for the use of the specific 
> > individual(s) to whom it is addressed.  It may contain information that is 
> > privileged and confidential under state and federal law.  This information 
> > may be used or disclosed only in accordance with law, and you may be 
> > subject to penalties under law for improper use or further disclosure of 
> > the information in this e-mail and its attachments. If you have received 
> > this e-mail in error, please immediately notify the person named above by 
> > reply e-mail, and then delete the original e-mail.  Thank you.
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: DXU-339106
> Department: Support GEMPAK
> Priority: Normal
> Status: Closed
> 
> 
> **********************************************************************
> NOTICE: This e-mail (and any attachments) may contain PRIVILEGED OR 
> CONFIDENTIAL information and is intended only for the use of the specific 
> individual(s) to whom it is addressed.  It may contain information that is 
> privileged and confidential under state and federal law.  This information 
> may be used or disclosed only in accordance with law, and you may be subject 
> to penalties under law for improper use or further disclosure of the 
> information in this e-mail and its attachments. If you have received this 
> e-mail in error, please immediately notify the person named above by reply 
> e-mail, and then delete the original e-mail.  Thank you.
> 


Ticket Details
===================
Ticket ID: DXU-339106
Department: Support GEMPAK
Priority: Normal
Status: Closed