NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Vincent,I'm attaching a tile aggregation where the lon coordinate, and the respective data array, are changed from 0 360 range to -180 180.
Best regards Antonio -- Antonio S. Cofiño Associate Professor and Researcher Grupo de Meteorología de Santander Dep. of Applied Mathematics and Computer Sciences Universidad de Cantabria (Spain) Academic Visitor National Centre for Atmospheric Science Department of Meteorology School of Mathematical, Physical and Computational Sciences University of Reading (UK) http://antonio.cofino.es On 21/12/16 14:56, Vincent THIERION wrote:
I well undertand the benefit of virtual datasets.Even I chose a physical aggregation, do you think, it's possible to send / show me a NCML example of tiled aggregation you made ?Regards Vincent Le 21/12/2016 à 15:40, Antonio S. Cofiño a écrit :Yes, if you have already a clear data structure it's better to persist the view as an physical case.In my case I have some dataset defined in longitude from -180 to 180, but some users want it from 0 to 360 ... then I create a virtual dataset, with 2 logical views from the data and one tiled aggregation of them. This provided to me 2 views served from TDS but from the same physical dataset without replication.Regards Antonio On 21/12/16 14:25, Vincent THIERION wrote:Antonio, Thank you for your answer.I think my best option is to stich / spatially aggregate individual files (not virtually) and serve the aggregated image with TDS.Vincent Le 21/12/2016 à 11:22, Antonio S. Cofiño a écrit :Vicent, On 21/12/16 08:58, Vincent THIERION wrote:Hello,By reading different posts on tiled aggregation (i.e. aggregation along longitude and latitude dimensions), such as :* http://www.unidata.ucar.edu/mailing_lists/archives/thredds/2011/msg00270.html * http://www.unidata.ucar.edu/mailing_lists/archives/thredds/2013/msg00500.htmlbetter than "labor-intensive" NCML implementation it looks like this capability is handled by GridDataset and the Netcdf SubsetService object : http://www.unidata.ucar.edu/mailing_lists/archives/netcdfgroup/2011/msg00133.html, only accessible with java library while I work with the python library.All these posts are quite old and I ask me what the better way is now ? Maybe stich all the netcdf files in one NetCDF before serve on TDS ?The tiled aggregation it's one problem and subsetting is different one. To aggregate on non-outer dimensions the only existing in netcdf-java it's tiled one. Never released with full support but it's there and working. The most common cases are aggregation on outer-dimensions or non-existing ones.This aggregation could be made using netcdf-java ncml and serving, using TDS, as opendap/netcdfsubsetting endpoints.To subsetting dataset (aggregated on non-aggregated) relies on tool/client side. Python pyDap or Netcd4 packages are able to access opendap services to subsetting purposes. Please note that the Netcdf4 package needs to access to netcdf library compiled with opendap reading capabilities.Only specific implementation like x-array python packages has some multifile aggregationhttp://xarray.pydata.org/en/stable/generated/xarray.open_mfdataset.html#xarray.open_mfdatasetNcML aggregation is general specification but only netcdf-java has full support of it. Some other implemetations exist:https://github.com/axiom-data-science/pyncml or the BES implemetation: http://docs.opendap.org/index.php/BES_-_Modules_-_NcML_Module But neither of them supports Tiled aggregation. Regards Antonio S. CofiñoThank you for your useful feedbacks -- ------------------------------- Vincent THIERION Ingénieur de recherche - THEIA - CES OSO vincent.thierion [at] cesbio.cnes.fr vincent.thierion [at] inra.fr CESBIO (Bureau 123) (UMR 5126 CNRS/CNES/UPS/IRD) Bpi 2801 18 Av. Edouard BELIN 31401 TOULOUSE CEDEX 9 INRA - Toulouse - Dynafor (UMR 1201 INRA/INP-ENSAT/INP-EI Purpan) 24 chemin de Borde-Rouge Auzeville BP 52627 31326 CASTANET-TOLOSAN CEDEX ------------------------------- _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. thredds mailing list thredds@xxxxxxxxxxxxxxxxFor list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/_______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. thredds mailing list thredds@xxxxxxxxxxxxxxxxFor list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/-- ------------------------------- Vincent THIERION Ingénieur de recherche - THEIA - CES OSO vincent.thierion [at] cesbio.cnes.fr vincent.thierion [at] inra.fr T. +33.(0)5.61.55.85.34 -https://dynafor.toulouse.inra.fr/dynafornet/index.php/fre/Collaborateurs/Permanents/Thierion CESBIO (Bureau 123) (UMR 5126 CNRS/CNES/UPS/IRD) Bpi 2801 18 Av. Edouard BELIN 31401 TOULOUSE CEDEX 9 INRA - Toulouse - Dynafor (UMR 1201 INRA/INP-ENSAT/INP-EI Purpan) 24 chemin de Borde-Rouge Auzeville BP 52627 31326 CASTANET-TOLOSAN CEDEX ------------------------------- _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. thredds mailing list thredds@xxxxxxxxxxxxxxxxFor list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/_______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. thredds mailing list thredds@xxxxxxxxxxxxxxxxFor list information or to unsubscribe, visit:http://www.unidata.ucar.edu/mailing_lists/-- ------------------------------- Vincent THIERION Ingénieur de recherche - THEIA - CES OSO vincent.thierion [at] cesbio.cnes.fr vincent.thierion [at] inra.fr T. +33.(0)5.61.55.85.34 -https://dynafor.toulouse.inra.fr/dynafornet/index.php/fre/Collaborateurs/Permanents/Thierion CESBIO (Bureau 123) (UMR 5126 CNRS/CNES/UPS/IRD) Bpi 2801 18 Av. Edouard BELIN 31401 TOULOUSE CEDEX 9 INRA - Toulouse - Dynafor (UMR 1201 INRA/INP-ENSAT/INP-EI Purpan) 24 chemin de Borde-Rouge Auzeville BP 52627 31326 CASTANET-TOLOSAN CEDEX ------------------------------- _______________________________________________ NOTE: All exchanges posted to Unidata maintained email lists are recorded in the Unidata inquiry tracking system and made publicly available through the web. Users who post to any of the lists we maintain are reminded to remove any personal information that they do not want to be made public. thredds mailing list thredds@xxxxxxxxxxxxxxxx For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/
<?xml version='1.0' encoding='UTF-8'?> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";> <variable name='lon' type='double' shape='lon' > <attribute name='standard_name' value='longitude' /> <attribute name='long_name' value='longitude' /> <attribute name='units' value='degrees_east' /> <attribute name='axis' value='X' /> <attribute name='bounds' value='lon_bnds' /> <attribute name='original_units' value='degrees_east' /> <values> -180.0, -176.25, -172.5, -168.75, -165.0, -161.25, -157.5, -153.75, -150.0, -146.25, -142.5, -138.75, -135.0, -131.25, -127.5, -123.75, -120.0, -116.25, -112.5, -108.75, -105.0, -101.25, -97.5, -93.75, -90.0, -86.25, -82.5, -78.75, -75.0, -71.25, -67.5, -63.75, -60.0, -56.25, -52.5, -48.75, -45.0, -41.25, -37.5, -33.75, -30.0, -26.25, -22.5, -18.75, -15.0, -11.25, -7.5, -3.75, 0.0, 3.75, 7.5, 11.25, 15.0, 18.75, 22.5, 26.25, 30.0, 33.75, 37.5, 41.25, 45.0, 48.75, 52.5, 56.25, 60.0, 63.75, 67.5, 71.25, 75.0, 78.75, 82.5, 86.25, 90.0, 93.75, 97.5, 101.25, 105.0, 108.75, 112.5, 116.25, 120.0, 123.75, 127.5, 131.25, 135.0, 138.75, 142.5, 146.25, 150.0, 153.75, 157.5, 161.25, 165.0, 168.75, 172.5, 176.25 </values> </variable> <variable name='lon_bnds' type='double' shape='lon bnds'> <values> -181.875 -178.125 -178.125 -174.375 -174.375 -170.625 -170.625 -166.875 -166.875 -163.125 -163.125 -159.375 -159.375 -155.625 -155.625 -151.875 -151.875 -148.125 -148.125 -144.375 -144.375 -140.625 -140.625 -136.875 -136.875 -133.125 -133.125 -129.375 -129.375 -125.625 -125.625 -121.875 -121.875 -118.125 -118.125 -114.375 -114.375 -110.625 -110.625 -106.875 -106.875 -103.125 -103.125 -99.375 -99.375 -95.625 -95.625 -91.875 -91.875 -88.125 -88.125 -84.375 -84.375 -80.625 -80.625 -76.875 -76.875 -73.125 -73.125 -69.375 -69.375 -65.625 -65.625 -61.875 -61.875 -58.125 -58.125 -54.375 -54.375 -50.625 -50.625 -46.875 -46.875 -43.125 -43.125 -39.375 -39.375 -35.625 -35.625 -31.875 -31.875 -28.125 -28.125 -24.375 -24.375 -20.625 -20.625 -16.875 -16.875 -13.125 -13.125 -9.375 -9.375 -5.625 -5.625 -1.875 -1.875 1.875 1.875 5.625 5.625 9.375 9.375 13.125 13.125 16.875 16.875 20.625 20.625 24.375 24.375 28.125 28.125 31.875 31.875 35.625 35.625 39.375 39.375 43.125 43.125 46.875 46.875 50.625 50.625 54.375 54.375 58.125 58.125 61.875 61.875 65.625 65.625 69.375 69.375 73.125 73.125 76.875 76.875 80.625 80.625 84.375 84.375 88.125 88.125 91.875 91.875 95.625 95.625 99.375 99.375 103.125 103.125 106.875 106.875 110.625 110.625 114.375 114.375 118.125 118.125 121.875 121.875 125.625 125.625 129.375 129.375 133.125 133.125 136.875 136.875 140.625 140.625 144.375 144.375 148.125 148.125 151.875 151.875 155.625 155.625 159.375 159.375 163.125 163.125 166.875 166.875 170.625 170.625 174.375 174.375 178.125 </values> </variable> <aggregation type="tiled" dimName="lon"> <netcdf section="(0:47)"> <dimension name="lon" length="48"/> <variable name="tasmax" shape="time lat lon"/> <remove name="lon" type="variable"/> <remove name="lon_bnds" type="variable"/> <aggregation type="union"> <netcdf location="dods://www-lscedods.cea.fr/cgi-bin/nph-dods/pmip2_dbext/pmip2_21k_oa/atm/mo/tasmax/tasmax_A_MO_pmip2_21k_oa_IPSL-CM4-V1-MR_0200-0299.nc"> <variable name="tasmax"> <logicalSection section="(:,:,48:95)"/> </variable> </netcdf> </aggregation> </netcdf> <netcdf section="(48:95)"> <dimension name="lon" length="48"/> <variable name="tasmax" shape="time lat lon"/> <remove name="lon" type="variable"/> <remove name="lon_bnds" type="variable"/> <aggregation type="union"> <netcdf location="dods://www-lscedods.cea.fr/cgi-bin/nph-dods/pmip2_dbext/pmip2_21k_oa/atm/mo/tasmax/tasmax_A_MO_pmip2_21k_oa_IPSL-CM4-V1-MR_0200-0299.nc"> <variable name="tasmax"> <logicalSection section="(:,:,0:47)"/> </variable> </netcdf> </aggregation> </netcdf> </aggregation> </netcdf>
thredds archives: