NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.
Hi Ed, On Jul 12, 2007, at 6:42 AM, Ed Hartnett wrote:
Howdy all HDF5ers! I have been asked by a user whether the zlib deflate can be used on scalar datasets. I believe from my experiments in HDF5 that it cannot, because there is no way to set the chunking for a scalar. Is this correct? I don't believe this is discussed in the reference manual - am I missing it? The code below, for example, fails when I try to set the chunking. Is this the correct conclusion, or am I missing something?
Interesting - not something I thought about trying, since it's not very useful in general. I suppose it could be beneficial if the datatype for the dataset was large enough that compression saved some space (although those gains would be offset by the B-tree overhead for indexing the chunks).
It is not currently supported, since a scalar dataspace corresponds to a 0-dimensional "point", and chunks must have dimensions >=1. If this is critically important, I can work on the modifications to the code to allow this to work, but it would require changes in a number of places and I'd rather not go that direction right now... :-)
Quincey
Thanks! Ed printf("*** Checking HDF5 scalar variable compession..."); #define MAX_NAME_LEN 50 #define DEFLATE_LEVEL 3 #define SIMPLE_VAR_NAME1 "punches" { hid_t fapl_id, fcpl_id; hid_t datasetid; hid_t fileid, grpid, spaceid, plistid; int data_in, data_out = 42; hsize_t chunksize = 1; /* Create file, setting latest_format in access propertly list * and H5P_CRT_ORDER_TRACKED in the creation property list. */ if ((fapl_id = H5Pcreate(H5P_FILE_ACCESS)) < 0) ERR; if (H5Pset_latest_format(fapl_id, 1) < 0) ERR; if ((fcpl_id = H5Pcreate(H5P_FILE_CREATE)) < 0) ERR;if (H5Pset_link_creation_order(fcpl_id, H5P_CRT_ORDER_TRACKED| H5P_CRT_ORDER_INDEXED) < 0) ERR; if ((fileid = H5Fcreate(FILE_NAME, H5F_ACC_TRUNC, fcpl_id, fapl_id)) < 0) ERR;if ((grpid = H5Gopen(fileid, "/")) < 0) ERR; if ((spaceid = H5Screate(H5S_SCALAR)) < 0) ERR; /* Create property lust. */ if ((plistid = H5Pcreate(H5P_DATASET_CREATE)) < 0) ERR; if (H5Pset_chunk(plistid, 1, &chunksize) < 0)ERR; /* Set up compression. */ if (H5Pset_deflate(plistid, DEFLATE_LEVEL) < 0) ERR; /* Create the variable. */if ((datasetid = H5Dcreate(grpid, SIMPLE_VAR_NAME1, H5T_NATIVE_INT,spaceid, plistid)) < 0) ERR; /* Write the data. */ if (H5Dwrite(datasetid, H5T_NATIVE_INT, H5S_ALL, H5S_ALL, H5P_DEFAULT, &data_out) < 0) ERR; if (H5Dclose(datasetid) < 0) ERR; if (H5Pclose(fapl_id) < 0 || H5Sclose(spaceid) < 0 || H5Gclose(grpid) < 0 || H5Fclose(fileid) < 0) ERR; /* Now reopen the file and check. */ if ((fapl_id = H5Pcreate(H5P_FILE_ACCESS)) < 0) ERR; if (H5Pset_latest_format(fapl_id, 1) < 0) ERR;if ((fileid = H5Fopen(FILE_NAME, H5F_ACC_RDONLY, fapl_id)) < 0) ERR;if ((grpid = H5Gopen(fileid, "/")) < 0) ERR; if ((datasetid = H5Dopen(grpid, SIMPLE_VAR_NAME1)) < 0) ERR; if ((spaceid = H5Dget_space(datasetid)) < 0) if (H5Dread(datasetid, H5T_NATIVE_INT, H5S_ALL, spaceid, H5P_DEFAULT, &data_in) < 0) ERR; /* Check the data. */ if (data_in != data_out) ERR; if (H5Pclose(fapl_id) < 0 || H5Dclose(datasetid) < 0 || H5Gclose(grpid) < 0 || H5Fclose(fileid) < 0) ERR; } SUMMARIZE_ERR; -- Ed Hartnett -- ed@xxxxxxxxxxxxxxxx====================================================================== ========To unsubscribe netcdf-hdf, visit: http://www.unidata.ucar.edu/mailing-list-delete-form.html====================================================================== ========
Attachment:
smime.p7s
Description: S/MIME cryptographic signature
netcdf-hdf archives: