Re: [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used

• To: Heiko Klein <Heiko.Klein@xxxxxx>, Russ Rew <russ@xxxxxxxxxxxxxxxx>
• Subject: Re: [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used
• From: Orion Poplawski <orion@xxxxxxxxxxxxx>
• Date: Thu, 08 Jan 2015 16:10:27 -0700

On 01/07/2015 02:52 AM, Heiko Klein wrote:
> Hi Russ,
> 
> thanks for your answer and the explanation from the hdfgroup.
> 
> For our purposes, it is not the parallel IO, which is important, but the
> bottleneck is in many cases zlib. Are there other ways to parallelize the
> 'zlib' portion of netcdf/hdf?
> 
> Heiko

Perhaps looking at the pigz code would be useful for this.


-- 
Orion Poplawski
Technical Manager                     303-415-9701 x222
NWRA, Boulder/CoRA Office             FAX: 303-415-9702
3380 Mitchell Lane                       orion@xxxxxxxx
Boulder, CO 80301                   http://www.nwra.com

• Follow-Ups:
  • Re: [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used
    • From: Jim Edwards

• References:
  • [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used
    • From: Heiko Klein
  • Re: [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used
    • From: Russ Rew
  • Re: [netcdfgroup] parallel netcdf4 fails on nc_enddef when deflate-filter is used
    • From: Heiko Klein