NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

Re: HDF5 chunking questions...

NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.

Hi John,

> perhaps we should have 3 modes of chunking, that the user can choose:
> 
>     1) preseve the record oriented nature of our current unlimited 
> dimension to optimize sequential reading of the array.
    What does this mean?

>     2) choose an optimal chunk size (some small multiple of disk block 
> size: 8K, 16K, 32K?) and subdivide the dimensions evenly to optimize 
> over all types of subsetting.
    This is similar to the heuristic I suggested to Ed.

>     3) full user spec of chunk size and chunk dimension size.
    Always possible.

        Quincey

  • 2003 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdf-hdf archives: