Re: TDS Fmrc aggregation problem

• To: "Steven.Anthony" <Steven.Anthony@xxxxxxxx>
• Subject: Re: TDS Fmrc aggregation problem
• From: John Caron <caron@xxxxxxxxxxxxxxxx>
• Date: Thu, 30 Nov 2006 15:00:51 -0700

Hi Steven:

You have to use the <datasetFmrc> element, but then there is a bug in the 
MetdaaDataextraot. Its been fixed in the latest release 3.14.rc5. try it and let me 
know if it works. Thanks!

Steven.Anthony wrote:

Hey,

I installed the TDS version 3.14.rc2 and I'm having trouble getting these FMRC datasets to work. Ive started off with a simple set of gfs_3 data (one day, in grib1 format) in hopes of minimizing complications.

from catalog.xml:

<dataset name="gfs3 test" ID="gfs3/test" urlPath="gfs3/test" dataType="Grid" serviceName="dods-http">

<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>

<aggregation dimName="run" type="forecastModelRunSingleCollection" timeUnitsChange="true" > <scanFmrc location="/nomads3_data/raid2/noaaport/merged/gfs-hi/200611/20061129"

        regExp=".*\.grb$"
        runDateMatcher="#gfs_3_#yyyyMMdd_HH"
        forecastOffsetMatcher="HHH#.grb#"/>
    </aggregation>
</netcdf>
</dataset>

This works in that I can get to the opendap browser, however, when I try to ascii dump a variable that uses the "run" dimension, I get an error:

Error {
    code = 0;
    message = "Connection cannot be read 
http://nomads-d.ncdc.noaa.gov:8081/thredds/dodsC/gfs3/test.dods?latLonCoordSys,Temperature[0:1:3][0:1:60][0:1:25][0:1:180][0:1:359]
 The descriptor object returned from the dataset was null
Check that the URL is correct.";
};


However, if I encapsulate the NCML in <datasetFmrc> tags instead, it fails to 
generate html output.
When I check the log file (threddsServlet.log) it ends with a exception.

2006-11-30T09:53:06.240 -0500 [    783735][      26] INFO  - thredds.servlet.ServletUtil 
- Remote host: 192.153.129.158 - Request: "GET 
/thredds/catalog/gfs3/testFmrc/catalog.html HTTP/1.1"
2006-11-30T09:53:06.252 -0500 [    783747][      26] ERROR - 
thredds.catalog.InvDatasetFmrc - Error making catalog for gfs3/testFmrc
java.lang.NullPointerException
        at 
ucar.nc2.thredds.MetadataExtractor.extractVariables(MetadataExtractor.java:181)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:273)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:141)
        at 
thredds.servlet.DataRootHandler.makeDynamicCatalog(DataRootHandler.java:1107)
        at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1075)
        at 
thredds.servlet.DataRootHandler.processReqForCatalog(DataRootHandler.java:991)
        at thredds.servlet.CatalogServlet.doGet(CatalogServlet.java:78)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
        at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
        at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
        at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
        at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
        at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432)
        at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
        at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
        at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
        at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
        at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
        at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
        at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
        at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
        at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
        at java.lang.Thread.run(Thread.java:595)
2006-11-30T09:53:06.267 -0500 [    783762][      26] INFO  - 
thredds.servlet.ServletUtil - Request Completed - 404 - 0 - 27

It looks as if there is a problem reading the variables (I think the same way that the opendap server fails to read variables with the new dimension.)

Let me know If I can provide any more information.

Thanks,
 - Steven Anthony




--
Steven Anthony
Computer Systems Analyst
NOMADS Project
STG Inc. Federal Contractor
Veach-Baley Federal Building
151 Patton Avenue
Asheville, NC 28801-5001
Phone: 828.271.4474

http://nomads.ncdc.noaa.gov