NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
-------- Original Message -------- Subject: RE: [thredds] grib2 feature collection on TDS 4.5 dev Date: Mon, 9 Jun 2014 11:36:36 -0400 From: Guan Wang <gwang@xxxxxxx> To: 'John Caron' <caron@xxxxxxxxxxxxxxxx> Hi John, Thank you so much for the prompt reply!You are absolutely right! Regular Exp '.*' instead of '*' is the fix. Now TDS can find the files and I can see ncx2 files created.
Guan*From:*thredds-bounces@xxxxxxxxxxxxxxxx [mailto:thredds-bounces@xxxxxxxxxxxxxxxx] *On Behalf Of *John Caron
*Sent:* Monday, June 9, 2014 11:11 AM *To:* thredds@xxxxxxxxxxxxxxxx *Subject:* Re: [thredds] grib2 feature collection on TDS 4.5 dev Hi Guan:<collection spec="/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t*z.grib2$"
is a regular expression, not a glob it probably should be /var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t.*z.grib2$ John On 6/9/2014 8:47 AM, Guan Wang wrote: Hi, I have trouble to make TDS 4.5 dev work with grib2 feature collection. The WaveWatch III grib2 file can be served individually in TDS 4.5 but the feature collection doesn't work. I guess I must miss something in the xml. Could you please shed some light on this? Here is the xml: <?xml version="1.0" encoding="UTF-8"?> <catalog name="WWIII GL"xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
<http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0> xmlns:xlink="http://www.w3.org/1999/xlink"; <http://www.w3.org/1999/xlink>> <service name="latest" serviceType="Resolver" base="" /> <service name="both" serviceType="Compound" base=""> <service name="ncdods" serviceType="OPENDAP" base="/thredds/dodsC/" /> <service name="HTTPServer" serviceType="HTTPServer" base="/thredds/fileServer/" /> </service> <dataset name="Great Lakes WWIII"> <metadata inherited="true"> <serviceName>both</serviceName> <authority>edu.ucar.unidata</authority> <dataFormat>GRIB-2</dataFormat> <documentation type="rights">Freely available</documentation> <documentation xlink:href=" " xlink:title=" "></documentation> <creator> <name vocabulary="DIF"> </name> <contact url=" " email=" " /> </creator> <publisher> <name vocabulary="DIF"> </name> <contact url="http://www.unidata.ucar.edu/"; <http://www.unidata.ucar.edu/> email="support@xxxxxxxxxxxxxxxx" <mailto:support@xxxxxxxxxxxxxxxx> /> </publisher> </metadata> <featureCollection name="WWIII-GL" featureType="GRIB2" harvest="true" path="glww3/"> <metadata inherited="true"> <!--<dataFormat>GRIB2</dataFormat>--> <documentation type="summary"> WWIII GL Test </documentation> </metadata> <collection spec="/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t*z.grib2$" timePartition="directory" olderThan="5 min" dateFormatMark="#ww3_#yyyy-MM-ddTHH:mm:ssZ"/> <update startup="true" trigger="allow"/> <tdm rescan="0 0/15 * * * ? *" trigger="allow"/> <gribConfig datasetTypes="TwoD Best LatestFile Files" /> </featureCollection> </dataset> </catalog> Here is the traceback stack: 2014-06-06T20:10:33.535 +0000 INFO - FeatureCollection added = name ='WWIII_GL' type='GRIB2' spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$' olderThan =5 min timePartition =none updateConfig =UpdateConfig{userDefined=false, recheckAfter='null', rescan='null', triggerOk=true, updateType=test} tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null', rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test} ProtoConfig{choice=Penultimate, change='null', param='null', outerNcml='null', cacheAll=true} hasInnerNcml =false GribConfig{datasets=[TwoD, Best, Latest], pdsHash={useGenType=false, intvMerge=true, useTableVersion=true}, filesSortIncreasing=true} 2014-06-06T20:10:33.613 +0000 INFO - Schedule startup scan force=test for 'WWIII_GL' at 2014-06-06T20:10:36.607+0000 2014-06-06T20:10:36.641 +0000 WARN - No records found in files. Check Grib1/Grib2 for collection WWIII_GL-testdata. If wrong, delete gbx9. 2014-06-06T20:10:36.642 +0000 ERROR - UpdateCollectionJob.execute startup failed collection=WWIII_GL java.lang.IllegalStateException: No records found in dataset WWIII_GL-testdata at ucar.nc2.grib.collection.Grib2CollectionBuilder.makeGroups(Grib2CollectionBuilder.java:157) ~[grib-4.5.0.jar:4.5.0] at ucar.nc2.grib.collection.GribCollectionBuilder.createIndex(GribCollectionBuilder.java:117) ~[grib-4.5.0.jar:4.5.0] at ucar.nc2.grib.collection.GribCdmIndex.updateGribCollection(GribCdmIndex.java:243) ~[grib-4.5.0.jar:4.5.0] at ucar.nc2.grib.collection.GribCdmIndex.openGribCollection(GribCdmIndex.java:461) ~[grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFcGrib.updateCollection(InvDatasetFcGrib.java:151) ~[grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:294) ~[cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313) ~[cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230) ~[cdm-4.5.0.jar:4.5.0] at thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207) [cdm-4.5.0.jar:4.5.0] at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [quartz-2.2.0.jar:?] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560) [quartz-2.2.0.jar:?] 2014-06-06T20:13:20.577 +0000 INFO - FeatureCollection added = name ='WWIII_GL' type='GRIB2' spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$' olderThan =5 min timePartition =none updateConfig =UpdateConfig{userDefined=true, recheckAfter='null', rescan='null', triggerOk=true, updateType=never} tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null', rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test} ProtoConfig{choice=Penultimate, change='null', param='null', outerNcml='null', cacheAll=true} hasInnerNcml =false GribConfig{datasets=[TwoD, Best, Files, Latest], pdsHash={useGenType=false, intvMerge=true, useTableVersion=true}, filesSortIncreasing=true} 2014-06-06T20:13:20.659 +0000 INFO - Schedule startup scan force=never for 'WWIII_GL' at 2014-06-06T20:13:23.653+0000 2014-06-06T20:13:23.667 +0000 INFO - updateGribCollection WWIII_GL changed false took 3 msecs 2014-06-06T20:13:23.670 +0000 WARN - GribCdmIndex.openCdmIndex failed on /var/lib/tomcat7054/content/thredds/public/testdata/WWIII_GL.ncx2 java.io.FileNotFoundException: /var/lib/tomcat7054/content/thredds/public/testdata/WWIII_GL.ncx2 (No such file or directory) at java.io.RandomAccessFile.open(Native Method) ~[?:1.7.0_60] at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241) ~[?:1.7.0_60] at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122) ~[?:1.7.0_60] at ucar.unidata.io.RandomAccessFile.<init>(RandomAccessFile.java:279) ~[cdm-4.5.0.jar:4.5.0] at ucar.unidata.io.RandomAccessFile.<init>(RandomAccessFile.java:261) ~[cdm-4.5.0.jar:4.5.0] at ucar.nc2.grib.collection.GribCdmIndex.openCdmIndex(GribCdmIndex.java:109) [grib-4.5.0.jar:4.5.0] at ucar.nc2.grib.collection.GribCdmIndex.openGribCollection(GribCdmIndex.java:464) [grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFcGrib.updateCollection(InvDatasetFcGrib.java:151) [grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:294) [cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313) [cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230) [cdm-4.5.0.jar:4.5.0] at thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207) [cdm-4.5.0.jar:4.5.0] at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [quartz-2.2.0.jar:?] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560) [quartz-2.2.0.jar:?] 2014-06-06T20:13:23.673 +0000 ERROR - InvDatasetFcGrib.updateCollection failed name ='WWIII_GL' type='GRIB2' spec='/var/lib/tomcat7054/content/thredds/public/testdata/glw.grl.t??z.grib2$' olderThan =5 min timePartition =none updateConfig =UpdateConfig{userDefined=true, recheckAfter='null', rescan='null', triggerOk=true, updateType=never} tdmConfig =UpdateConfig{userDefined=true, recheckAfter='null', rescan='0 0/15 * * * ? *', triggerOk=true, updateType=test} ProtoConfig{choice=Penultimate, change='null', param='null', outerNcml='null', cacheAll=true} hasInnerNcml =false GribConfig{datasets=[TwoD, Best, Files, Latest], pdsHash={useGenType=false, intvMerge=true, useTableVersion=true}, filesSortIncreasing=true} 2014-06-06T20:13:23.674 +0000 ERROR - UpdateCollectionJob.execute startup failed collection=WWIII_GL java.lang.NullPointerException at thredds.catalog.InvDatasetFcGrib.makeDatasetFromCollection(InvDatasetFcGrib.java:183) ~[grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFcGrib.makeDatasetTop(InvDatasetFcGrib.java:516) ~[grib-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.checkState(InvDatasetFeatureCollection.java:295) ~[cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.update(InvDatasetFeatureCollection.java:313) ~[cdm-4.5.0.jar:4.5.0] at thredds.catalog.InvDatasetFeatureCollection.sendEvent(InvDatasetFeatureCollection.java:230) ~[cdm-4.5.0.jar:4.5.0] at thredds.inventory.CollectionUpdater$UpdateCollectionJob.execute(CollectionUpdater.java:207) [cdm-4.5.0.jar:4.5.0] at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [quartz-2.2.0.jar:?] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:560) [quartz-2.2.0.jar:?] It appears that the index file can not be built for feature collection. But, I bet it's not the root cause. Thanks a lot! Guan _______________________________________________ thredds mailing list thredds@xxxxxxxxxxxxxxxx <mailto:thredds@xxxxxxxxxxxxxxxx>For list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/
thredds archives: