NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

[thredds] Writing GRIB Indicies "offline"


Greetings!

I have a relatively large static dataset of grib files that I'm trying to get set up in my TDS. I currently have my tomcat running with 8Gb of heap, but run into heap space problems when trying to create the .ncx files

I think part of my problem is that I'm not partitioning my collection (I'm trying this next).

I have been trying to create the indices "offline" with the following:

java -Xmx512m -classpath netcdfAll-4.3.jar ucar.nc2.grib.grib1.Grib1Index $gribfile

then

java -Xmx12288m -verbose -classpath netcdfAll-4.3.jar ucar.nc2.grib.grib1.Grib1Collection -make collection_name.ncx "/path/to/files/*.grib"

But even with 12 Gb of heap allocated, I am still getting heap dumps.

Even if I am successful at creating the collection index file (collection_name.ncx), will it require massive amounts of heap space to read in the collection by THREDDS?

Is partitioning my best bet?

Thanks!

-kevin.

--
Kevin Manross
NCAR/CISL/Data Support Section
Phone: (303)-497-1218
Email:manross@xxxxxxxx <mailto:manross@xxxxxxxx>
Web:http://rda.ucar.edu
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: