[netcdfgroup] Inconsistent arguments to collective routine

• To: netcdfgroup@xxxxxxxxxxxxxxxx
• Subject: [netcdfgroup] Inconsistent arguments to collective routine
• From: "Hernan G. Arango" <arango@xxxxxxxxxxxxxxxxxx>
• Date: Mon, 26 Jan 2009 17:26:49 -0500

Hi All,

I continue my testing of NetCDF-4 parallel I/O in ROMS.
It works fine in several different applications but it is
failing in one with larger grid size. My interface is generic
so all the applications are using the same sequence of calls
but with different grid size.

I am using:

4.0.1-beta2-snapshot2009011202 of Jan 14 2009 10:13:17 $

mpich2-1.0.8 and pgf90 8.0

Linux 2.6.9-42.ELsmp #1 SMP Tue Aug 15 10:35:26 BST 2006 x86_64 x86_64 x86_64
GNU/Linux

Here is the error that I get when writing the first
variable into the created NetCDF-4 file:


      DEF_HIS   - creating history file: latte_his.nc

HDF5-DIAG: Error detected in HDF5 (1.8.2) MPI-process 1:
  #000: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1724 in H5Fflush(): flush
  failed
    major: File accessability
    minor: Unable to initialize object
  #001: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1802 in H5F_flush(): low
  level truncate
failed
    major: Low-level I/O
    minor: Write failed
  #002: /usr/local/src/hdf5-1.8.2/src/H5FD.c line 1979 in H5FD_truncate():
  driver
truncate request failed
    major: Virtual File Layer
    minor: Can't update object
  #003: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
MPI_File_set_size failed
    major: Internal error (too specific to document in detail)
    minor: Some MPI function failed
  #004: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
Invalid argument, error stack:
MPI_FILE_SET_SIZE(73): Inconsistent arguments to collective routine
    major: Internal error (too specific to document in detail)
    minor: MPI Error String
HDF5-DIAG: Error detected in HDF5 (1.8.2) MPI-process 2:
  #000: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1724 in H5Fflush(): flush
  failed
    major: File accessability
    minor: Unable to initialize object
  #001: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1802 in H5F_flush(): low
  level truncate
failed
    major: Low-level I/O
    minor: Write failed
  #002: /usr/local/src/hdf5-1.8.2/src/H5FD.c line 1979 in H5FD_truncate():
  driver
truncate request failed
    major: Virtual File Layer
    minor: Can't update object
  #003: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
MPI_File_set_size failed
    major: Internal error (too specific to document in detail)
    minor: Some MPI function failed
  #004: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
Invalid argument, error stack:
MPI_FILE_SET_SIZE(73): Inconsistent arguments to collective routine
    major: Internal error (too specific to document in detail)
    minor: MPI Error String
HDF5-DIAG: Error detected in HDF5 (1.8.2) MPI-process 3:
  #000: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1724 in H5Fflush(): flush
  failed
    major: File accessability
    minor: Unable to initialize object
  #001: /usr/local/src/hdf5-1.8.2/src/H5F.c line 1802 in H5F_flush(): low
  level truncate
failed
    major: Low-level I/O
    minor: Write failed
  #002: /usr/local/src/hdf5-1.8.2/src/H5FD.c line 1979 in H5FD_truncate():
  driver
truncate request failed
    major: Virtual File Layer
    minor: Can't update object
  #003: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
MPI_File_set_size failed
    major: Internal error (too specific to document in detail)
    minor: Some MPI function failed
  #004: /usr/local/src/hdf5-1.8.2/src/H5FDmpio.c line 1944 in
  H5FD_mpio_truncate():
Invalid argument, error stack:
MPI_FILE_SET_SIZE(73): Inconsistent arguments to collective routine
    major: Internal error (too specific to document in detail)
    minor: MPI Error String


Since the error is internal it is difficult to follow in the
debugger.  I haven't been able to reproduce the error in a
much simpler program.

I was wonder if anybody has seen this problem before.  This seems
to be a HDF5 error, perhaps it needs to be send to that group.

Thank you, H

-----------------------------------------------------------------------

Hernan G. Arango           Institute of Marine and Coastal Sciences
arango@xxxxxxxxxxxxxxxxxx  Rutgers University
off:  (732) 932-6555 x266  71 Dudley Road
FAX:  (732) 932-6520       New Brunswick, NJ 08901-8521, USA

http://marine.rutgers.edu/po/arango
http://marine.rutgers.edu/po/arango/rocco
http://marine.rutgers.edu/roms
http://www.myroms.org
http://www.ocean-modeling.org

• Follow-Ups:
  • Re: [netcdfgroup] Inconsistent arguments to collective routine
    • From: Robert Latham