NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

Re: size limits in HDF5...

NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.

Hi Ed,

On Apr 25, 2007, at 4:08 PM, Ed Hartnett wrote:

Howdy all HDF5 people!

I have a question about the possible sizes of HDF5 datasets.

What is the maximum size of a HDF5 dataset?

I have searched the HDF5 docs and can't find an answer to this
question...

If you can refer me to a place in the docs where this is discussed,
that would be very helpful.

Probably someone else can help you with a citation from the documentation, I'm responding with respect to the library internals: The library currently allows up to 32 dimension dataspaces, and each dimension can have up to an unsigned 64-bit value. Each datatype can be somewhat arbitrarily large, since you can have array datatypes or compound datatypes that are very large. Multiplying those two factors together gives you a theoretical upper limit probably in the thousands of bits of for a dataset's size. However, the library currently only supports 64-bit offsets (although that's easily adjustable when we need files over 16 exabytes... ;-), so that's the practical upper limit.

        Quincey

P.S. - Yes, I really am on vacation, I just am reading some e-mail before going to sleep... :-)

Attachment: smime.p7s
Description: S/MIME cryptographic signature

  • 2007 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdf-hdf archives: