[thredds] Join Existing aggregations with ncml in TDS 4.2 and 4.3

• To: THREDDS community <thredds@xxxxxxxxxxxxxxxx>, support@xxxxxxxxxxxxxxxx
• Subject: [thredds] Join Existing aggregations with ncml in TDS 4.2 and 4.3
• From: Roland Schweitzer - NOAA Affiliate <roland.schweitzer@xxxxxxxx>
• Date: Thu, 10 Jan 2013 14:05:30 -0600

Hi,

In TDS version 4.2.5 - 20110302.2315 we would do aggregations with this
sort of ncml specification and things worked as we expected, but with
TDS Version 4.3.15 - 20121218.1126 when use the exact same catalog we get
the following error:

Error {
    code = 500;
    message = 
"http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
is not a valid URL, return status=400";
};


2013-01-10T12:01:00.718 -0800 [    971459][      22] ERROR -
thredds.server.opendap.OpendapServlet - path=
/Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation.html
java.io.IOException:
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
is not a valid URL, return status=400
        at 
ucar.nc2.dataset.NetcdfDataset.disambiguateHttp(NetcdfDataset.java:725)
        at 
ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:674)
        at ucar.nc2.dataset.NetcdfDataset.acquireFile(NetcdfDataset.java:628)
        at ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:634)
        at 
ucar.nc2.ncml.AggregationExisting.buildNetcdfDataset(AggregationExisting.java:74)

        [...]


I know FMRC aggregations changed, but I thought something along the
lines of the catalog below would still work in 4.3.  What's the right
way to do this sort of aggrgation in 4.3?

Roland


<?xml version="1.0" encoding="UTF-8"?>
<catalog xmlns="
http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
xmlns:xlink="http://www.w3.org/1999/xlink"; version="1.0.1">
  <service name="compound" serviceType="compound" base="">
    <service name="dods" base="/thredds/dodsC/" serviceType="OPeNDAP" />
  </service>
  <dataset name="pressure"
ID="PSDgriddedData/ncep.reanalysis2.dailyavgs/pressure">
    <metadata inherited="true">
      <dataType>GRID</dataType>
    </metadata>
    <dataset name="air" ID="
PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc"
urlPath="Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation">
      <documentation type="Notes" xlink:href="
http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html";
xlink:title="Aggregated from catalog
http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.htmlstarting
with
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure";
/>
      <property name="eastwestPropertyNumberOfPoints" value="144" />
      <property name="eastwestResolution" value="2.5" />
      <property name="eastwestStart" value="0.0" />
      <property name="northsouthPropertyNumberOfPoints" value="73" />
      <property name="northsouthResolution" value="2.5" />
      <property name="northsouthStart" value="-90.0" />
      <property name="updownValues" value="1000.0 925.0 850.0 700.0 600.0
500.0 400.0 300.0 250.0 200.0 150.0 100.0 70.0 50.0 30.0 20.0 10.0" />
      <property name="hasZ" value="air" />
      <property name="hasT" value="air" />
      <property name="timeAxisUnits" value="hours since 1800-1-1 00:00:0.0"
/>
      <property name="timeCoverageStart" value="1979-01-01 00:00:00Z" />
      <property name="timeCoverageNumberOfPoints" value="12235" />
      <timeCoverage>
        <start>1979-01-01 00:00:00Z</start>
        <end>1982-12-31 00:00:00Z</end>
      </timeCoverage>
      <geospatialCoverage zpositive="down">
        <northsouth>
          <start>-90.0</start>
          <size>180.0</size>
          <units>degrees_north</units>
        </northsouth>
        <eastwest>
          <start>0.0</start>
          <size>357.5</size>
          <units>degrees_east</units>
        </eastwest>
        <updown>
          <start>10.0</start>
          <size>990.0</size>
          <units>millibar</units>
        </updown>
      </geospatialCoverage>
      <serviceName>compound</serviceName>
      <metadata inherited="true">
        <variables vocabulary="netCDF_contents">
          <variable name="air" units="degK" vocabulary_name="Daily Air
Temperature on Pressure Levels" />
        </variables>
      </metadata>
      <dataSize units="Mbytes">130.4</dataSize>
      <date type="modified">2011-06-14 00:26:25Z</date>
      <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2
">
        <aggregation type="joinExisting" dimName="time">
          <netcdf location="
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1979.nc";
ncoords="365" />
          <netcdf location="
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1980.nc";
ncoords="366" />
          <netcdf location="
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc";
ncoords="365" />
          <netcdf location="
http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1982.nc";
ncoords="365" />
        </aggregation>
      </netcdf>
    </dataset>
  </dataset>
</catalog>

• Follow-Ups:
  • Re: [thredds] Join Existing aggregations with ncml in TDS 4.2 and 4.3
    • From: John Caron