[thredds] Files files everywhere....

• To: THREDDS community <thredds@xxxxxxxxxxxxxxxx>
• Subject: [thredds] Files files everywhere....
• From: Roy Mendelssohn - NOAA Federal <roy.mendelssohn@xxxxxxxx>
• Date: Mon, 1 Jun 2015 16:24:37 -0700

HI All:

I don’t know how many of you get notices like this:

> MODIS Ocean Color and SST Data Users:
> 
> Within the next week, the Ocean Biology Processing Group will begin the ocean 
> color (OC) reprocessing of MODIS on Aqua (MODISA). At that time, we will also 
> make available the fully reprocessed SST from MODIS on Aqua and Terra, and we 
> will start producing forward-stream products in the reprocessing 
> configuration for all four data streams (MODIS SST and OC from both satellite 
> platforms). General information on the reprocessing changes for OC and SST 
> can be found here:

The new format, if you don’t know, are netcdf-4 files,  but they make heavy use 
of groups.  As some of you may remember, a proposal to develop a standard for 
use of groups in CF was put forward by Charlie Zender and Ted Haberman, but got 
shot down.  Be that as it may, the NASA product is what it is, and this raised 
some questions for our data services. To wit:

1. Does anyone know if TDS can handle these files correctly  (because of the 
groups and not being strictly CF)?  toolsUI seems to be able to read them okay, 
but I am not certain that it is picking up the data types properly  (so 
recognizes that something is an array but not necessarily a grid)?  Sample 
files are at:

http://oceancolor.gsfc.nasa.gov/DOCS/FormatChange.html


2. For some of the data we do some further processing and write our own files, 
but some we have in either netcdf3 or HDF4 files in TDS?  Do aggregations work 
over different file types, as long as the variable name and the variable to 
aggregated over are the same?  

3.  In past incarnations, the chlorophyll files did not contain the two carbon 
variables POC, PIC,  these were in separate files.  Now they are included in 
the chlorophyll file.  Is there any way that anyone can think of to continue 
that PIC and POC aggregations with the new files  (remember I have use the same 
files for the chlorophyll aggregations) or I am pretty much stuck having to 
redownload the re-processed files?

Thanks,  

-Roy

**********************
"The contents of this message do not reflect any position of the U.S. 
Government or NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
***Note new address and phone***
110 Shaffer Road
Santa Cruz, CA 95060
Phone: (831)-420-3666
Fax: (831) 420-3980
e-mail: Roy.Mendelssohn@xxxxxxxx www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected" 
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.

• Follow-Ups:
  • Re: [thredds] Files files everywhere....
    • From: John Caron