NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

[thredds] Time Partition Syntax
Got a (hopefully) quick question regarding setting up the Time Partition for a GRIB collection. I don't seem to be making headway with it and I hoped someone might be able to help me sort it out. 

I have files in a path structure like:

/glade/p/rda/data/ds083.2/grib1/yyyy/yyyy.MM/fnl_yyyyMMdd_HH_mm[_c]

Where the _c shows up after a certain date.

I have my collection set up as follows:

spec="/glade/p/rda/data/ds083.2/grib1/**/fnl_*"
               timePartition="1 day"
               dateFormatMark="fnl_#yyyyMMdd_HH_mm#"
When I go to the collection folder, I'm getting a 404 on the catalog. The featurecollectionScan.log file shows a null pointer exception:
[2013-04-12T09:14:37.958-0600] INFO thredds.inventory.CollectionUpdater: Schedule startup scan for /glade/p/rda/data/ds083.2/grib1/**/fnl_* at Fri Apr 12 09:14:47 MDT 2013 [2013-04-12T09:14:37.968-0600] INFO thredds.inventory.CollectionUpdater: Schedule recurring scan for /glade/p/rda/data/ds083.2/grib1/**/fnl_* cronExpr=0 0 0 * * ? * [2013-04-12T09:14:57.443-0600] INFO thredds.inventory.MFileCollectionManager: NCEP_FNL : was scanned MCollection{name='/glade/p/rda/data/ds083.2/grib1', dirName='/glade/p/rda/data/ds083.2/grib1', wantSubdirs=true, ff=WildcardMatchOnPath{wildcard=null regexp=fnl_*}} [2013-04-12T09:15:01.816-0600] INFO thredds.inventory.MFileCollectionManager: NCEP_FNL : was scanned MCollection{name='/glade/p/rda/data/ds083.2/grib1', dirName='/glade/p/rda/data/ds083.2/grib1', wantSubdirs=true, ff=WildcardMatchOnPath{wildcard=null regexp=fnl_*}} [2013-04-12T09:15:01.818-0600] INFO ucar.nc2.grib.grib1.Grib1TimePartitionBuilder: TimePartitionBuilder createIndex /usr/share/tomcat6/content/thredds/cache/grib/glade-p-rda-data-ds083.2-grib1-NCEP_FNL.ncx [2013-04-12T09:15:24.270-0600] ERROR thredds.catalog.InvDatasetFcGrib: Error making catalog for FNLCollection 
java.lang.NullPointerException
at thredds.catalog.InvDatasetFcGrib.makeCatalogTop(InvDatasetFcGrib.java:454) at thredds.catalog.InvDatasetFcGrib.makeCatalog(InvDatasetFcGrib.java:378) at thredds.servlet.DataRootHandler.makeDynamicCatalog(DataRootHandler.java:1469) at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1432) at thredds.server.catalogservice.LocalCatalogServiceController.handleRequestInternal(LocalCatalogServiceController.java:191) at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153) at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) 


I've tried a number of different combinations:

   <collection spec="/glade/p/rda/data/ds083.2/grib1/**/fnl_*"
               dateFormatMark="#fnl_#yyyyMMdd_HH_mm"
               timePartition="1 day"
<collection spec="/glade/p/rda/data/ds083.2/grib1/**/fnl_#yyyyMMdd_HH_mm#" 
               timePartition="1 day"
<collection spec="/glade/p/rda/data/ds083.2/grib1/**/'fnl_'#yyyyMMdd_HH_mm#" 
               timePartition="1 day"

   <collection spec="/glade/p/rda/data/ds083.2/grib1/**/fnl_*"
               dateFormatMark="'fnl_'#yyyyMMdd_HH_mm#"
               timePartition="1 day"

   <collection spec="/glade/p/rda/data/ds083.2/grib1/**/fnl_*"
               dateFormatMark="#fnl_#yyyyMMdd_HH_mm"
               timePartition="1 day"
And in (almost) each case, when I click on the catalog I an entry in the featureCollectionScan.log file reads:
[2013-04-12T14:17:33.591-0600] INFO ucar.nc2.grib.grib1.Grib1TimePartitionBuilder: TimePartitionBuilder createIndex /usr/share/tomcat6/content/thredds/cache/grib/glade-p-rda-data-ds083.2-grib1-NCEP_FNL.ncx 

and I get an Internal Server Error (500) from the website.
The file: /usr/share/tomcat6/content/thredds/cache/grib/glade-p-rda-data-ds083.2-grib1-NCEP_FNL.ncx is never written
If I then click reload on the page, I get the NullPointerException - I'm guessing because that file isn't written. 

Any idea what I'm doing wrong here?

-kevin.


--
Kevin Manross
NCAR/CISL/Data Support Section
Phone: (303)-497-1218
Email:manross@xxxxxxxx <mailto:manross@xxxxxxxx>
Web:http://rda.ucar.edu
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: