NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.

Re: [netcdfgroup] (no subject)[excessive bandwidth]

I ran ncdump using your url and
with fetch display enabled. It is
making 24 requests to the server
each of size one float
[Reading a float at a time is a function
of the way ncdump works, not the dap code].


Can you please do the following command and send me the output:

ncdump  
'[log][show=fetch]http://goldsmr2.sci.gsfc.nasa.gov/opendap/hyrax/MERRA/MAT1NXSLV.5.2.0/1990/01/MERRA100.prod\
.assim.tavg1_2d_slv_Nx.19900101.hdf?U50M_EOSGRID_Data_Fields[0:23][282:282][441\
:441]'

=Dennis Heimbigner
 Unidata


Taylor Binnington wrote:
Thank you Dennis.
I'm using version 4.2.1, netcdf-cxx4 by Lynton Appel, on openSUSE 12.1, so
I think it's fairly up-to-date. The problem is not that I am unable to open
the file (I, too, can print out the 24 values), but that doing so
apparently uses ~19 mb of bandwidth, according to the iftop monitoring
utility. This seems quite excessive.
Please let me know if there is specific information that I should provide
here. Much appreciated,
Taylor


On Mon, Feb 18, 2013 at 5:57 PM, Dennis Heimbigner <dmh@xxxxxxxxxxxxxxxx>wrote:

The opendap code in the netcdf-C libraries
(used by the C++ library) will in fact
properly handle the constraint you specified.
I just ran it and as expected, it is only pulling
in the 24 values you requested (took some 5 seconds to
obtain and print out the data).

One possibility is that you are using a rather old version
of the netcdf-C library.

=Dennis Heimbigner
 Unidata

Taylor Binnington wrote:

Hello,

I have an 'understanding' type of question. I have omitted details of my
OS, NetCDF installation, and a minimal example since I do not think they
are important for my question, but I can provide these details if they are
important.

When I attempt to open a MERRA file using the NetCDF C++ libraries, with a
line like the following, in my code:

NcFile datafile("
http://goldsmr2.sci.gsfc.nasa.**gov/opendap/hyrax/MERRA/**
MAT1NXSLV.5.2.0/1990/01/**MERRA100.prod.assim.tavg1_2d_**
slv_Nx.19900101.hdf?U50M_**EOSGRID_Data_Fields[0:23][282:**282][441:441]<http://goldsmr2.sci.gsfc.nasa.gov/opendap/hyrax/MERRA/MAT1NXSLV.5.2.0/1990/01/MERRA100.prod.assim.tavg1_2d_slv_Nx.19900101.hdf?U50M_EOSGRID_Data_Fields[0:23][282:282][441:441]>
",NcFile::read);

...I notice that quite a lot (nearly 20 MB) is being transferred from
Hyrax
to my PC. However, all that I am interested in are the actual array values
(24 separate 32-bit real numbers) of the U50M_EOSGRID_Data_Fields. It has
been suggested that the entire array (of size 24*361*540 32-bit reals) is
being transferred by NetCDF before any subsetting takes place, is this
true? If so, is it then not possible to use OPeNDAP URLs to subset
on-the-fly through the NetCDF libraries?

Thank you for your help!
Taylor



------------------------------**------------------------------**
------------

______________________________**_________________
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit:
http://www.unidata.ucar.edu/**mailing_lists/<http://www.unidata.ucar.edu/mailing_lists/>






  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: