Re: [thredds] Pb between OpenDap and THREDDS when netcdf file are modifed

• To: "Ethan Davis" <edavis@xxxxxxxxxxxxxxxx>, <thredds@xxxxxxxxxxxxxxxx>
• Subject: Re: [thredds] Pb between OpenDap and THREDDS when netcdf file are modifed
• From: "Claude DEROGNAT" <cderognat@xxxxxxx>
• Date: Fri, 2 Mar 2012 17:33:48 +0100

Hi,

This is ok but too sophisticated for my application, no? 
Is there any simple way to perform a "simple refresh" of the TDS without 
restart the tomcat server?

Claude   

Ing. Claude DEROGNAT, PhD
ARIA TECHNOLOGIES SA
8-10, rue de la Ferme - 92100  Boulogne-Billancourt  - France
tél. / phone: 33 (0)1 46 08 68 60
ligne directe / direct line: 33 (0)1 46 08 68 65
fax: 33 (0)1 41 41 93 17
e-mail: cderognat@xxxxxxx - http : www.aria.fr 
 Avant d'imprimer ce courriel, réfléchissez à l'impact sur l'environnement, et 
dans la mesure du possible éditez les documents en recto verso, merci!



-----Message d'origine-----
De : thredds-bounces@xxxxxxxxxxxxxxxx [mailto:thredds-bounces@xxxxxxxxxxxxxxxx] 
De la part de Ethan Davis
Envoyé : jeudi 23 février 2012 22:19
À : thredds@xxxxxxxxxxxxxxxx
Objet : Re: [thredds] Pb between OpenDap and THREDDS when netcdf file are 
modifed

Hi Claude,

The version of the TDS running at http://web.aria.fr:443/thredds/ is several 
years old (Version 4.0.26 - 20090831.2140). The current stable release is 4.2.9 
(20111108.1758). You should probably upgrade as there have been lots of 
improvements.

The TDS does some dataset caching which can greatly improve the performance for 
static datasets but causes some problems for dynamic datasets. The datasetScan 
configuration construct you are using does not deal specifically with dynamic 
datasets. A more recently introduced (in TDS 4.2) configuration construct, 
featureCollection, can deal with dynamic datasets. Here's a link to the 
featureCollection documentation:

> http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.2/reference/col
> lections/FeatureCollections.html

Hope that helps,

Ethan

On 2/22/2012 8:20 AM, Claude DEROGNAT wrote:
> I have used OpenDap and THREDDS server to provide netcdf data since à long 
> time.
> I currently develop a system that will model plumes in real time.
> The model runs every 30 minutes. At the beginning of each day, it creates a 
> result file then every 30 minutes the result file is overwritten with a new 
> one containing the additional time frame.
> 
> I observed a strange behavior between Opendap and THREDDS in this case:
>       - The file is continuously updated in the OpenDap server. 
>       - The THREDDS catalog notices in the 'Dates' field that the file is 
> updated (modified) 
>       - but the Access/OpenDap target file are not modified and the available 
> time frame stay the same since the last tomcat reboot. May I have to perform 
> any modification in the thredds  configuration ? A attached you my 
> threddsConfig.xml file...
> 
> Regards       
> 
> Ing. Claude DEROGNAT, PhD

Claude also wrote:
> My IT said that the file I send you is an old one. My problem is 
> probably link to my THREEDS catalog. The question is so probably to 
> threeds mailing list. I send them my question on Monday just after 
> your message and I still have no response back ...
>
> So, I send you my catalog if you can have a look to it you may find 
> why there a mismatch between
>
> 
>http://web.aria.fr:443/thredds/dodsC/CHIMERE@CAMAC@reference@p02/CF_CHI
>MERE_20120115_d03.nc.html
>and
> 
>http://web.aria.fr:443/LENVIS/CHIMERE/CAMAC/reference/p02/CF_CHIMERE_20
>120115_d03.nc.html
>
> For instance,
>
> why the second is continuously updated but doesn't allow the access to 
> the whole set of variables stored in NetCdf file.
>
> Why the first one are not continuously updated even if the date in the 
> threeds catalogs presentation always mentioned the right modified time 
> ...

catalog.xml:
> [snip]
>   <service name="multiService" base="" serviceType="compound">
>     <service name="ncdods" serviceType="OPENDAP" base="/thredds/dodsC/" />
>     <service name="httpService" serviceType="HTTPServer" 
> base="/thredds/fileServer/" />
>     <service name="wcsService" serviceType="WCS" base="/thredds/wcs/" />
>   </service>
> [snip]
>     <datasetScan name="CF_CHIMERE_@YYYYMMDD@_d01.nc"
>                  ID="/LENVIS/CHIMERE/CAMAC/reference/p00/dataset"
>                  path="CHIMERE@CAMAC@reference@p00"
>                  location="/data/nc/LENVIS/CHIMERE/CAMAC/reference/p00"
>                  harvest="true">
>        <sort>
>          <lexigraphicByName increasing="false"/>
>        </sort>
>      </datasetScan>
> [snip]


_______________________________________________
thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/ 

• References:
  • Re: [thredds] Pb between OpenDap and THREDDS when netcdf file are modifed
    • From: Claude DEROGNAT
  • Re: [thredds] Pb between OpenDap and THREDDS when netcdf file are modifed
    • From: Ethan Davis