NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Whoops, forgot to attatch the code. Here it is. On Fri, 30 May 2003, Ben Monnahan wrote: > Hi, I'm having some problems with VisAD using seemingly way more memory > than it should. I'm loading a data file that is less than a megabyte, yet > my program wants at least 300MB(it throws an OutOfMemoryError). I figure > I must be doing something wrong. I'm not really sure what it could be > because there just isn't that much data around. In fact all the data > into loaded into an array before the usage starts skyrocketing. When I > start creating all of the VisAD stuff the usage skyrockets. I know people > are using this for large data sets, so I must be doing something wrong. > Can anyone see what might be causing the problem? (Code attatched, if you > need clarification of something, or more of the code let me know) > > The reason I'm using the arrays for everything is that I have a 6 models > that I want to plot data for, but there are a bunch of different views. > There is a separate view for each datatype/forecast time/sample area. I > want to be able to switch between the views quickly so I'm loading all the > data and adding it to the display, and then adding and removing references > to only show the data that I want. So this is much more data than I'm > displaying but still much less than 1 MB total. > > Again if you have any questions I'd be happy to answer them. > > Thanks, > Ben >
/*
* Explanation of implementation:
*
* _data This is a Vector that is used to store the data sets.
* We only need one.
* _cMaps This is where the ConstantMaps are stored. The first
* one is for the indep var, and the second is for the dep
* var.
*
* // stuff for drawing lines
* _lineTypes[] This is where the RealType definitions are stored. The
* first one is the independent variable, the second one
* through the second from last are the dependent
* variables. The last one is the type to use when the
* axis's are combined.
* _lineFuncs[] This is where the FunctionType definitions are store.
* _lineSets[] This is where the sets of numbers used for the
* dependent variable values are stored. We only need
* one.
* _lineFlatFields[] This is where we store the FlatFields.
* _lineDataRefs[] This is where we store DataReferenceImpl.
* _lineSMaps[] This is where the ScalarMaps are stored. The 0'th one
* is for the indep var, and the 1'th through
* totalNumPlots for the dep var. totalNumPlots+1 is the
* generic type for all the dep vars.
* _lineSMaps2[] This is where the ScalarMaps used for selecting a
* display range are stored.
*
* // stuff for drawing points
* _pointTypes[] This is where the RealTupleType definitions are stored.
* The first one is not used(indep type is RealType), the
* second one through the second from last are the
* dependent variables. The last one is the type to use
* when the axis's are combined.
* _pointFuncs[] This is where the FunctionType definitions are store.
* _pointSets[] This is where the sets of numbers used for the
* dependent variable values are stored.
* _pointFlatFields[] This is where we store the FlatFields.
* _pointDataRefs[] This is where we store DataReferenceImpl.
*
*
* _plotCountTotal This is the number of data sets being plotted.
*/
//initialize the point stuff
RealType index = RealType.getRealType("index", SI.second);
_pointSets[0] = (Set) _lineSets[0].cloneButType(index);
for(int i=1; i < _pointTypes.length; i++)
{
_pointTypes[i] = new RealTupleType(_lineTypes[0], _lineTypes[i]);
}
// Create the maps for the independent variable
_lineSMaps[0] = new ScalarMap( _lineTypes[0], Display.XAxis );
_lineSMaps[0].addScalarMapListener(new TickMarkManager(new
DateTickMarkAlgorithm()));
_lineSMaps2[0] = new ScalarMap( _lineTypes[0], Display.SelectRange );
_display.addMap(_lineSMaps[0]);
_display.addMap(_lineSMaps2[0]);
//create the maps for the generic dep variable
_lineSMaps[_lineSMaps.length-1] = new ScalarMap(
_lineTypes[_lineTypes.length-1], Display.YAxis);
_display.addMap(_lineSMaps[_lineSMaps.length-1]);
//do all the dependent variable stuff
for(int i=1; i <= _plotCountTotal; i++)
{
System.out.println(" dep var: " + i);
//- Set up all of the VisAD stuff -//
// Set up the ScalarMaps
_lineSMaps[i] = new ScalarMap( _lineTypes[i], Display.YAxis );
_lineSMaps2[i] = new ScalarMap( _lineTypes[i], Display.SelectRange );
_display.addMap(_lineSMaps[i]);
_display.addMap(_lineSMaps2[i]);
// Set up the functions
_lineFuncs[i-1] = new FunctionType( _lineTypes[0], _lineTypes[i] );
_pointFuncs[i-1] = new FunctionType(index, _pointTypes[i] );
// Set up the flatfields
_lineFlatFields[i-1] = new FlatField( _lineFuncs[i-1], _lineSets[0] );
_lineFlatFields[i-1].setSamples( (float[][]) _data.get(i-1) );
_pointFlatFields[i-1] = new FlatField( _pointFuncs[i-1], _lineSets[0] );
float[][] tmpData2 = (float[][]) _data.get(i-1);
float[][] tmpData = new float[2][tmpData2.length];
tmpData[1] = tmpData2[0];
tmpData2 = _lineSets[0].getSamples();
tmpData[0] = tmpData2[0];
_pointFlatFields[i-1].setSamples( tmpData );
System.out.println(" number of datapoints: " + tmpData.length +
"by " + tmpData[0].length);
// Set up the data references
_lineDataRefs[i-1] = new DataReferenceImpl("line_data"+(i-1)+"_ref_" +
_graphID);
_lineDataRefs[i-1].setData(_lineFlatFields[i-1]);
_pointDataRefs[i-1] = new DataReferenceImpl("point_data"+(i-1)+"_ref_"
+ _graphID);
_pointDataRefs[i-1].setData(_pointFlatFields[i-1]);
//- Add it to the display and set it to be shown -//
showPlot(i-1, true);
//System.out.println(" #### tick");
}
System.out.println(" #### created and added dep smaps");
visad archives: