[netcdfgroup] increment copy of growing netCDF file?

• To: netcdfgroup@xxxxxxxxxxxxxxxx
• Subject: [netcdfgroup] increment copy of growing netCDF file?
• From: Joe VanAndel <vanandel@xxxxxxxx>
• Date: Thu, 17 Apr 2014 11:41:20 -0600

We have a lidar that produces netCDF data files.  We archive these files on a 
server.

We need a reliable mechanism to update the current hourly file as it is being 
updated by the instrument and produce an updated copy on our server.  This 
allows our scientists to see real-time updates from the lidar.

At present, we’re using a homegrown Python script that parses the netCDF file 
and sends the progressively appended UNLIMITED dimension blocks to the server.  
(This code knows just enough about the netCDF3 file structure to detect the 
newly appended blocks.)

I’d appreciate any advice on a better way to copy incremental updates from the 
instrument to the server.

Thanks!