[netcdfgroup] Content-Based Checksums of a netCDF dataset

• To: netcdfgroup@xxxxxxxxxxxxxxxx
• Subject: [netcdfgroup] Content-Based Checksums of a netCDF dataset
• From: Charlie Zender <zender@xxxxxxx>
• Date: Thu, 24 Aug 2017 12:30:13 -0700

NCO has supported MD5 digests since 2012

http://nco.sf.net/nco.html#md5

If I understand your intent, this might be
part of a suitable solution, since you can
use NCO to compute/print (and, optionally store as attributes)
the MD5 hashes of every field in a file,
and these hashes should agree for the same
data regardless of the underlying storage
compression level etc, filesystem type, etc.
It is a foolproof way to verify data integrity.
And NCO can get the files from remote filesystems
via Opendap or HSI or ESGF or scp/ftp.

Feedback welcome.
--
Charlie Zender, Earth System Sci. & Computer Sci.
University of California, Irvine 949-891-2429 )'(

• Follow-Ups:
  • Re: [netcdfgroup] Content-Based Checksums of a netCDF dataset
    • From: Willi Rath