NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.
robl@xxxxxxxxxxx (Robert Latham) writes: > On Thu, Nov 15, 2007 at 11:06:09AM -0600, Edward (Ted) Mansell wrote: >> I did some compiling of netcdf-4 (both beta 1 and the Oct. 22 >> snapshot with hdf5-1.8.0-of20070814), and while data compression is >> working fine, parallel IO doesn't work (make check fails on the >> parallel tests). Is it safe to say that parallel IO just doesn't >> work yet in netcdf-4? > > Parallel I/O definitely works in netcdf-4, but did need a little bit > of love. > > Here's more or less how to get parallel MPI-IO out of netcdf-4 > - start with hdf5-1.8.0-beta3 for now. > > - configure hdf5 for parallel I/O: (basically build hdf5 with mpicc) > > - get ahold of something newer than the oct 22 netcdf-4 snapshot. Ed > committed some fixes to the configure process which make > parallel-netcdf4 work even better > > ==rob Howdy Rob! Thanks for the kinds words. Some important API changes were made in HDF5 after beta3. The netCDF-4 code has already been changed to handle these HDF5 changes, so the current netCDF-4 snapshot will not build with HDF5-1.8.0 beta3 any longer. There was a minor issue in HDF5-1.8.0-beta4, so that won't work either. Instead, netCDF-4 users need to use the HDF5 snapshot made available on the netCDF-4 download page: http://www.unidata.ucar.edu/software/netcdf/builds/snapshot/netcdf-4/ (Whatever HDF5 version is needed for the netCDF-4 build, it will be found on the netCDF-4 download page.) So, to modify Robert's instructions above: 1 - Get the HDF5 snapshot here: http://www.unidata.ucar.edu/software/netcdf/builds/snapshot/netcdf-4/ (And get and install the zlib library from here too, if you don't already have it.) 2 - Build HDF5 with --enable-parallel (and --with-zlib=/somewhere). Install it somewhere. 3 - Get the netCDF-4 snapshot from: http://www.unidata.ucar.edu/software/netcdf/builds/snapshot/netcdf-4/ 4 - Build netCDF-4 with --with-hdf5=/wherever_parallel_hdf5_is. (If you want netCDF to run parallel tests, and you can run programs from the command line with mpiexec, then add the --enable-parallel-tests option to configure.) For complete instructions on building the netCDF-4 snapshot, you can look at the snapshot Installation and Porting Guide, available on the snapshot documentation page: http://www.unidata.ucar.edu/software/netcdf/netcdf-4/newdocs/ Special thanks to Robert for helping get netCDF-4.0 building and working properly with parallel I/O options. ;-) Any users of netCDF-4 parallel I/O should email me with any problems they encounter. (Or, even better, if they don't encounter any!) I am currently working on benchmarking and further testing of the parallel I/O features of netCDF-4.0, and would be very interested in any user experiences, good or bad. Thanks! Ed -- Ed Hartnett -- ed@xxxxxxxxxxxxxxxx
netcdf-hdf archives: