NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Michael, I had turned off the LDM and the files were not being purged. I have a 1 TB SSD drive. It appears there were two main culprits: grid (460G) and radar (395G). Searching the log files it appears all of the feed types were exceeding their failure limit. Just reset the purge via your command, but it doesn’t appear to have made a difference in purge behavior of grid and radar in the last hour. Other purge threads appear to be operating normally. Looking at the purge log file, I don’t see any reference to purging the grid or radar threads. -Kevin On 14 August 2017 at 7:14:10 PM, Michael James (mjames@xxxxxxxx) wrote: Are you certain that hdf5 files are being retained longer than their purge files specify? What size disk is filling up? You can run "du -h" on any of the hdf5/ subdirectories (such as satellite, radar, grid) to see if any of these are unusually large. If, for example, the satellite directory is taking up the bulk of space in /awips2/edex/data/hdf5, we can check the satellitePurgeRules.xml first to confirm the rules exist, and then check the edex-ingest-purge log for any telltale messages: grep ERROR /awips2/edex/log/edex-ingest-purge-20170815.log For example, some data plugins may encounter an error which will disable purging and print a message to edex-ingest-purge such as: ERROR 2017-08-15 00:00:00,025 3622 [DefaultQuartzScheduler_Worker-3] PurgeLogger: EDEX - SATELLITE::Purger for this plugin has reached or exceeded consecutive failure limit of 3. Data will no longer being purged for this plugin. The workaround if you see this error message is the following command (as root): edex purge reset Michael James Unidata Program Center Boulder, CO On Mon, Aug 14, 2017 at 4:48 PM, Kevin Goebbert <kevin.goebbert@xxxxxxxxx> wrote: > Dave, > > I am having a similar issue…thanks for reporting! I haven’t had any luck > finding a solution either. > > Regards, > Kevin > > On 14 August 2017 at 5:38:18 PM, David Fitzgerald ( > david.fitzgerald@xxxxxxxxxxxxxxxx) wrote: > > Hello everyone, > > > > I am having trouble getting the data in /awips2/edex/data/hdf5 to purge; > this of course causes the disk to fill up quite rapidly. I modified the > xml files in /awips2/edex/data/utility/common_static/base/purge but have > not seen any change. I also do not see any references to the hdf5 > directory in the edex-ingest-purge logs either. Could someone point me in > the right direction to start debugging this? Are there other files to > modify other than in /awips2/edex/data/utility/common_static/base/purge? > > > > Thanks! > > > > Dave > > > > +++++++++++++++++++++++++++ > > David Fitzgerald > > Department of Earth Science > > Millersville University > > Millersville, PA 17551 > > > > 717-871-7436 <(717)%20871-7436> > > > _______________________________________________ > NOTE: All exchanges posted to Unidata maintained email lists are > recorded in the Unidata inquiry tracking system and made publicly > available through the web. Users who post to any of the lists we > maintain are reminded to remove any personal information that they > do not want to be made public. > > > awips2-users mailing list > awips2-users@xxxxxxxxxxxxxxxx > For list information, to unsubscribe, or change your membership options, > visit: http://www.unidata.ucar.edu/mailing_lists/ > > -- > Kevin Goebbert, Ph.D. > Associate Professor of Meteorology > Kallay-Christopher Hall, 201-F > 1809 Chapel Drive > Valparaiso, IN 46383 > > (219) 464-5517 <//(219)%20464-5517> > fax: (219) 548-7738 <//(219)%20548-7738> > > https://kevingoebbert.youcanbook.me/ > > _______________________________________________ > NOTE: All exchanges posted to Unidata maintained email lists are > recorded in the Unidata inquiry tracking system and made publicly > available through the web. Users who post to any of the lists we > maintain are reminded to remove any personal information that they > do not want to be made public. > > > awips2-users mailing list > awips2-users@xxxxxxxxxxxxxxxx > For list information, to unsubscribe, or change your membership options, > visit: http://www.unidata.ucar.edu/mailing_lists/ > > _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. awips2-users mailing list awips2-users@xxxxxxxxxxxxxxxx For list information, to unsubscribe, or change your membership options, visit: http://www.unidata.ucar.edu/mailing_lists/ -- Kevin Goebbert, Ph.D. Associate Professor of Meteorology Kallay-Christopher Hall, 201-F 1809 Chapel Drive Valparaiso, IN 46383 (219) 464-5517 <//(219)%20464-5517> fax: (219) 548-7738 <//(219)%20548-7738> https://kevingoebbert.youcanbook.me/
awips2-users archives: