Re: [thredds] Netcdf-Java and TDS v4.6.4 Stable Release

• To: Michael McDonald <mcdonald@xxxxxxxxxxxxx>
• Subject: Re: [thredds] Netcdf-Java and TDS v4.6.4 Stable Release
• From: Christian Ward-Garrison <cwardgar@xxxxxxxx>
• Date: Wed, 24 Feb 2016 17:48:48 -0700

Hi Michael,

I can't reproduce this problem locally, using a joinExisting aggregation
that I just created with dummy data. What steps are you taking to cause it?

For the datasets in an aggregation, we try to avoid opening as many of them
as possible. In most cases, we can get by with only opening a single
"representative" dataset, which we use to extrapolate the metadata for the
entire aggregation. That is why you're only seeing cached values for one
dataset in tds v4.6.4. If you want to see data cached for all datasets, you
need to submit a query that asks for all values of the joinExisting
coordinate variable. That'll cause TDS to open and read every dataset in
the aggregation, since those values haven't been cached previously (in
v4.6.4, at least). In other words, submit an opendap query for all values
of "MT".

Cheers,
Christian

On Tue, Feb 23, 2016 at 11:41 AM, Michael McDonald <mcdonald@xxxxxxxxxxxxx>
wrote:

> Support:
>
> This latest version of tds (v4.6.4) is breaking our cached
> aggregations. The  <cache varName='MT' > ###.# </cache> is not getting
> stored in the cache file for each aggregation as it did in the last
> v4.6.3 release. See attached files. Consequently, when we query the
> opendap URL it is returning an error regarding the date index (which
> is missing from the cache).
>
> tds v4.6.3
>
> <?xml version='1.0' encoding='UTF-8'?>
> <aggregation xmlns='http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2
> '
> version='3' type='joinExisting' dimName='MT' recheckEvery='120 min' >
>   <netcdf id='/hycom/ftp/datasets/GOMl0.04/expt_32.5/data/2016/
> archv.2016_001_00_3z.nc'
> ncoords='1' >
>     <cache varName='MT' >42004.0 </cache>
>   </netcdf>
> ...
>   <netcdf id='/hycom/ftp/datasets/GOMl0.04/expt_32.5/data/2016/
> archv.2016_080_00_3z.nc'
> ncoords='1' >
>     <cache varName='MT' >42083.0 </cache>
>   </netcdf>
> </aggregation>
>
>
> tds v4.6.4
>
> <?xml version='1.0' encoding='UTF-8'?>
>
> <aggregation xmlns='http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2
> '
> version='3' type='joinExisting' dimName='MT' recheckEvery='120 min' >
>   <netcdf id='/hycom/ftp/datasets/GOMl0.04/expt_32.5/data/2016/
> archv.2016_001_00_3z.nc'
> ncoords='1' >
>   </netcdf>
> ...
>   <netcdf id='/hycom/ftp/datasets/GOMl0.04/expt_32.5/data/2016/
> archv.2016_079_23_3z.nc'
> ncoords='1' >
>   </netcdf>
>   <netcdf id='/hycom/ftp/datasets/GOMl0.04/expt_32.5/data/2016/
> archv.2016_080_00_3z.nc'
> ncoords='1' >
>     <cache varName='MT' >42083.0 </cache>
>   </netcdf>
> </aggregation>
>
>
>
> On Tue, Feb 16, 2016 at 5:37 PM, Sean Arms <sarms@xxxxxxxx> wrote:
> >
> > The Unidata THREDDS Development Team is happy to announce that the
> > NetCDF-Java/Common Data Model (CDM) library and THREDDS Data Server (TDS)
> > version 4.6.4 were released on February 12th, 2016. These are both stable
> > releases, and as such, the development team recommends these upgrades to
> > anyone using the CDM or TDS.
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>

• References:
  • [thredds] Netcdf-Java and TDS v4.6.4 Stable Release
    • From: Sean Arms
  • Re: [thredds] Netcdf-Java and TDS v4.6.4 Stable Release
    • From: Michael McDonald