NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Greetings Tony, The capability to do cross grid boundary requests is solved in TDS 5. We are planning on using TDS 5 in our workshop this fall, with the hope of releasing a beta post workshop. As far as I know, github issue 330 has not been ported to TDS 4.6. We are having a THREDDS meeting on Wednesday, and I will bring it up to see where things stand. Cheers, Sean On Tue, Jul 19, 2016 at 6:59 AM, Jolibois Tony <tjolibois@xxxxxx> wrote: > Dear Thredds community, > > I was wondering when 2 issues will be solved, and if it is or will be > solved in which version of TDS. > > > > Many users here in Europe are impacted (CMEMS community), as well as Hycom > users apparently. > > - The capacity of NCSS to manage subset across the grid boundary > > - A bug on netCDF 4 output writing : > https://github.com/Unidata/thredds/issues/330 > > Is the TDS 5.0 the good one ? If yes, is this version considered as a > stable version ? > > Thanks, > > Tony > > > > *-* > > *Tony Jolibois* > > *Product Dissemination Services * > > Space Oceanography > > +33 5 61 39 37 97 > > > > [image: logo_cls_small] > > http://www.cls.fr/ > > > ------------------------------ > > *Ce message et toutes les pièces jointes (ci-après le "message") sont > établis à l'intention exclusive de ses destinataires et sont confidentiels. > Si vous recevez ce message par erreur ou s'il ne vous est pas destiné, > merci de le détruire ainsi que toute copie de votre système et d'en avertir > immédiatement l'expéditeur. Toute lecture non autorisée, toute utilisation > de ce message qui n'est pas conforme à sa destination, toute diffusion ou > toute publication, totale ou partielle, est interdite. L'Internet ne > permettant pas d'assurer l'intégrité de ce message électronique susceptible > d'altération, l’expéditeur (et ses filiales) décline(nt) toute > responsabilité au titre de ce message dans l'hypothèse où il aurait été > modifié ou falsifié.* > > *This message and any attachments (the "message") is intended solely for > the intended recipient(s) and is confidential. If you receive this message > in error, or are not the intended recipient(s), please delete it and any > copies from your systems and immediately notify the sender. Any > unauthorized view, use that does not comply with its purpose, dissemination > or disclosure, either whole or partial, is prohibited. Since the internet > cannot guarantee the integrity of this message which may not be reliable, > the sender (and its subsidiaries) shall not be liable for the message if > modified or falsified. * > > > ---------- Forwarded message ---------- > From: Christian Ward-Garrison <cwardgar@xxxxxxxx> > To: "Don.Murray@xxxxxxxx" <Don.Murray@xxxxxxxx> > Cc: "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx> > Date: Mon, 14 Sep 2015 21:48:13 +0000 > Subject: Re: [thredds] NCSS Queries Not Spaning/Crossing Dateline > Indeed, we have this (mostly) working on our 5.0 development branch. We're > not really sure about when we'll release 5.0, but it should be by the end > of the year at the latest. > > On Mon, Sep 14, 2015 at 3:38 PM, Don Murray (NOAA Affiliate) < > don.murray@xxxxxxxx> wrote: > >> Hi Michael- >> >> In the current versions of TDS/netCDF-Java, you cannot subset across the >> grid boundary. Since your model runs -180 to 180, that's what you are >> running into. For model output that runs 0-360, the problem is at the >> prime meridian. >> >> I think this is to be fixed in the next iteration (5.0?), but I'm sure >> Unidata can verify that. >> >> Don >> >> On 9/14/15 3:25 PM, Michael McDonald wrote: >> >>> Is there some trick I am not understanding for making NCSS queries >>> that span the 180-degree east dateline? We've had users on the >>> HYCOM.org forum asking about this, and I cannot get a netcdf object >>> which does not stop at 180-degrees east. >>> >>> >>> http://www.unidata.ucar.edu/software/thredds/current/tds/reference/NetcdfSubsetServiceReference.html#Subsetting >>> >>> We are using the latest 4.6.3 >>> http://ncss.hycom.org/thredds/catalog.html >>> >>> 1. Start with our HYCOM reanalysis product, >>> http://ncss.hycom.org/thredds/ncss/grid/GLBa0.08/reanalysis/dataset.html >>> >>> 2. See if you can successfully get data that spans the dateline, >>> i.e., West 170 to East 200 >>> >>> If successful, please let me know how to accomplish this. >>> >>> >> -- >> Don Murray >> NOAA/ESRL/PSD and CU-CIRES >> 303-497-3596 >> http://www.esrl.noaa.gov/psd/people/don.murray/ >> >> >> _______________________________________________ >> thredds mailing list >> thredds@xxxxxxxxxxxxxxxx >> For list information or to unsubscribe, visit: >> http://www.unidata.ucar.edu/mailing_lists/ >> > > > > Cliquez ici > <https://www.mailcontrol.com/sr/0rp!JUjVdg7GX2PQPOmvUo1yZ91kITL4y92GS5Ba1a1R!khHnxdqh5TV!DiD!7MCQGpUKsswpNw5N50IUBelLw==> > si ce message est indésirable (pourriel). > > > ---------- Forwarded message ---------- > From: Jolibois Tony <tjolibois@xxxxxx> > To: Ryan May <rmay@xxxxxxxx> > Cc: "joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx" < > joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx>, THREDDS community < > thredds@xxxxxxxxxxxxxxxx> > Date: Mon, 14 Dec 2015 10:25:36 +0000 > Subject: Re: [thredds] TDS NCSS: issue with netCDF4 files as input and > netCDF4 requested as output > > Dear Ryan, > > Ok, new issue. Do you have a planning for the correction ? More > generally, do you have a roadmap for Thredds Data Server developments ? The > next versions, what will be corrected etc ? > > Thanks. > > Best regards, > > Tony > > > > *De :* Ryan May [mailto:rmay@xxxxxxxx] > *Envoyé :* samedi 12 décembre 2015 00:30 > *À :* Jolibois Tony > *Cc :* THREDDS community; joan.sala@xxxxxxxxxxxxxxxxxxxxxxxx > *Objet :* Re: [thredds] TDS NCSS: issue with netCDF4 files as input and > netCDF4 requested as output > > > > Thanks for the files, I'm able to reproduce the problem locally. > Unfortunately, it doesn't appear to be related to the issue #301 as I > thought. > > > > I've opened a new issue: https://github.com/Unidata/thredds/issues/330 > > > > You can follow any progress there as I continue to dig. > > > > Thanks, > > > > Ryan > > > > On Fri, Dec 11, 2015 at 1:45 AM, <tjolibois@xxxxxx> wrote: > > Hi Christian, > Please find some FTP link in the end of this email, to download some > netCDF4 files we've used here for the tests. I've also added part of > catalina.out, the java_opts used, and the Thredds configuration (simple > joinExisting aggregation). > Note that it's only when you request netCDF4 as output that we have an > error. > Best regards, > Tony > > > > Hi Tony, > > Can you provide an example of the NetCDF-4 input file so that we can > recreate the problem locally? > > Thanks, > Christian > > On Thu, Dec 10, 2015 at 8:29 AM, Jolibois Tony wrote: > Hi Thredds team, > > We’re currently testing TDS netCDF Subset Service, its performance, > robustness.. These tests include different netCDF format, to study the > impact on performance and robustness with different compression levels. > To study this impact, we run 4 scenarios for input/output data files for > TDS NCSS. > Input netCDF3 => output netCDF3 > Input netCDF4 => output netCDF3 > Input netCDF3 => output netCDF4 > Input netCDF4 => output netCDF4 > We’re facing an error only with the 4th scenario, netCDF4 => netCDF4 (NCSS > REST parameter &accept=netcdf4). > > java.io.IOException: -101: NetCDF: HDF error > at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2821) > ~[netcdf4-4.6.3.jar:4.6.3] > at ucar.nc2.jni.netcdf.Nc4Iosp.writeData(Nc4Iosp.java:2729) > ~[netcdf4-4.6.3.jar:4.6.3] > at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:953) > ~[cdm-4.6.3.jar:4.6.3] > at ucar.nc2.NetcdfFileWriter.write(NetcdfFileWriter.java:937) > ~[cdm-4.6.3.jar:4.6.3] > at ucar.nc2.FileWriter2.copyAll(FileWriter2.java:427) > ~[cdm-4.6.3.jar:4.6.3] > at ucar.nc2.FileWriter2.copyVarData(FileWriter2.java:380) > ~[cdm-4.6.3.jar:4.6.3] > at ucar.nc2.dt.grid.CFGridWriter2.writeOrTestSize(CFGridWriter2.java:244) > ~[cdm-4.6.3.jar:4.6.3] > at ucar.nc2.dt.grid.CFGridWriter2.writeFile(CFGridWriter2.java:112) > ~[cdm-4.6.3.jar:4.6.3] > at > thredds.server.ncss.controller.GridResponder.writeGridFile(GridResponder.java:250) > ~[classes/:4.6.3] > at > thredds.server.ncss.controller.GridResponder.writeLatLonSubset(GridResponder.java:166) > ~[classes/:4.6.3] > at > thredds.server.ncss.controller.GridResponder.getResponseFile(GridResponder.java:97) > ~[classes/:4.6.3] > at > thredds.server.ncss.controller.NcssController.handleRequestGrid(NcssController.java:175) > ~[classes/:4.6.3] > at > thredds.server.ncss.controller.NcssController.handleRequest(NcssController.java:140) > ~[classes/:4.6.3] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[?:1.8.0_65] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > ~[?:1.8.0_65] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[?:1.8.0_65] > at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_65] > > The error comes from netcdf4 java library used inside TDS version 4.6.3 > (latest stable version). > The error appears only if we have a geographical subset (works with no > subset or temporal aggregation). > Different NetCDF-4 input files have been tested: > • original Netcdf3 files converted with the command nccopy –k4 –d3 > input.nc output.nc4 > • original Netcdf4 generated with python library > For information on software versions: > misgw-qt-new:/home/misgw# ls -ltr > total 246300 > -rw-r--r-- 1 root root 9130958 oct 7 21:09 apache-tomcat-8.0.28.tar.gz > -rw-rw-r-- 1 misgw misgw 181260798 nov 9 10:48 jdk-8u65-linux-x64.gz > -rw-r--r-- 1 root root 61808104 nov 9 11:03 thredds_4.6.3.war > > Thanks for the support. > Tony Jolibois > > - > Tony Jolibois > Product Dissemination Services > Space Oceanography > +33 5 61 39 37 97 > Files attached to this message > > *Filename* > > *Size* > > netCDF4.zip > > 13 MB > > catalina.out > > 6 KB > > java_opts.sh > > 1012.0 B > > m_LR_OBS_nc4.xml > > 2 KB > > m_Surcouf_C4.xml > > 2 KB > > Please click on the following link to download the attachments: > http://ftp-mail.cls.fr/message/XY07Uo3bGqdx38DKHGNgyD > > The attachments are available until: *Friday, 18 December.* > > Message ID: XY07Uo3 > > *CLS — Secure Filetransfer Appliance > <http://www.allardsoft.com/filetransfer>: http://ftp-mail.cls.fr/ > <http://ftp-mail.cls.fr/> * > > > _______________________________________________ > thredds mailing list > thredds@xxxxxxxxxxxxxxxx > For list information or to unsubscribe, visit: > http://www.unidata.ucar.edu/mailing_lists/ > > > > > > -- > > Ryan May > > Software Engineer > > UCAR/Unidata > > Boulder, CO > > > > Cliquez ici <https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ==> si > ce message est indésirable (pourriel). > > _______________________________________________ > NOTE: All exchanges posted to Unidata maintained email lists are > recorded in the Unidata inquiry tracking system and made publicly > available through the web. Users who post to any of the lists we > maintain are reminded to remove any personal information that they > do not want to be made public. > > > thredds mailing list > thredds@xxxxxxxxxxxxxxxx > For list information or to unsubscribe, visit: > http://www.unidata.ucar.edu/mailing_lists/ >
thredds archives: