NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Steve, Let's move this discussion off the thredds mailing list to stackoverflow. http://stackoverflow.com/questions/14776450/is-there-a-hardwired-limit-to-the-ncml-thredds-values-element/14778665#14778665 Ask your followup there. -Rich On Fri, Feb 8, 2013 at 12:29 PM, Steven Baum <baum@xxxxxxxxxxxxxxxx> wrote: > > Rich, > > I just posted the question on stackoverflow - a very interesting and useful > site - under > the netcdf category since that was the only one that was both applicable and > allowed. > > As for your suggestion of using a union, I set up a very long script last > night to use > the NCOs to append the lon/lat arrays to all of the history files, although > it's taking > a good long while to append them to the 13GB history files as well as supply > the > required attribute information. It's only gotten through about 30 of the > files, so if I > stop it and try the union thing, what will happen if I attempt to union the > files to > which I've already added the lon/lat fields with the NetCDF file containing > the lon/lat > files? That is, what happens when the same field is present within both > files that > you're trying to union? > > Steve > > On Fri, 8 Feb 2013 07:46:26 -0500, Signell, Richard wrote >> Steve, >> >> I don't know the answer to your question about the size limit for >> <values>, but there is another way to solve your problem.. >> >> You can write your lon,lat values to a netcdf file, and then use a >> "union" aggregation that aggregates the "joinExisting" >> aggregation with your grid file. >> >> For example, if you have a bunch of files like: >> mod_his_0001.nc >> mod_his_0002.nc >> ... >> and you create a netcdf file that contains the lon,lat variables: >> lonlat.nc >> >> you can aggregate them together like so: >> >> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";> >> <!-- union the (1) time aggregation with the (2) grid file --> >> <aggregation type="union"> >> <!-- (1) time aggregate files like "mod_his_0001.nc" --> >> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";> >> <aggregation dimName="time" type="joinExisting"> >> <scan >> location="/home/baum/models/run01/" >> regExp=".*mod_his_[0-9]{4}\.nc$"/> >> </aggregation> >> </netcdf> >> <!-- (2) grid file --> >> <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2"; >> location="/home/baum/models/lonlat.nc"/> >> </aggregation> >> </netcdf> >> >> Make sense? >> >> -Rich >> >> P.S. Can you please ask the same question on stackoverflow.com and tag >> with "netcdf" and "xml"? I think as a community we should start to >> get info like this captured in a place where others can comment and >> improve the answers, and best answers can rise to the top. It's a lot >> easier than wading through mailing lists. If you ask it, I promise to >> answer. And I need to get up to 1500 points so I can add an "ncml" >> tag. ;-) >> >> On Thu, Feb 7, 2013 at 5:44 PM, Steven Baum <baum@xxxxxxxxxxxxxxxx> wrote: >> > >> > Is there a limit to the size or number of entries that can be placed >> > within the values >> > NcML element? I'm attempting to get a set of NetCDF files without lon/lat >> > variables - >> > but with x/y variables - to be read as a featureCollection by adding NcML >> > entries of the >> > form: >> > >> > <netcdf >> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";> >> > >> > <variable name="lat_rho" shape="eta_rho xi_rho" type="float"> >> > <attribute name="units" type="String" value="degrees_north" /> >> > <values>[671x191 blankspace-separated latitudes here]</values> >> > </variable> >> > >> > The lat and lon variables exist in a separate file and I've extracted them >> > into single >> > strings using ncks which I've stuck between appropriate <values></values> >> > locations. >> > >> > The error messages in featureCollectionScan.log are: >> > >> > [2013-02-07T15:15:37.386-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv >> > java.lang.NullPointerException >> > >> > .... >> > >> > [2013-02-07T15:15:37.388-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: >> > /raid/data/txla_nesting6/.*\.nc$: makeFmrcInv failed >> > java.lang.RuntimeException: java.lang.NullPointerException >> > >> > .... >> > >> > [2013-02-07T15:15:37.694-0600] WARN ucar.nc2.ft.fmrc.GridDatasetInv: >> > GridDatasetInv >> > using gds.getStartDate() for run date =%s >> > [2013-02-07T15:15:37.694-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv >> > java.lang.NullPointerException >> > >> > .... >> > [2013-02-07T15:15:37.695-0600] ERROR ucar.nc2.ft.fmrc.Fmrc: >> > /raid/data/txla_nesting6/.*\.nc$: makeFmrcInv failed >> > java.lang.RuntimeException: java.lang.NullPointerException >> > >> > >> > >> > _______________________________________________ >> > thredds mailing list >> > thredds@xxxxxxxxxxxxxxxx >> > For list information or to unsubscribe, visit: > http://www.unidata.ucar.edu/mailing_lists/ >> >> -- >> Dr. Richard P. Signell (508) 457-2229 >> USGS, 384 Woods Hole Rd. >> Woods Hole, MA 02543-1598 > > > -- > Open WebMail Project (http://openwebmail.org) > -- Dr. Richard P. Signell (508) 457-2229 USGS, 384 Woods Hole Rd. Woods Hole, MA 02543-1598
thredds archives: