NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.

To learn about what's going on, see About the Archive Site.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #MHJ-258620]: Pydap file server fails



Im getting a 404 from the browser on

 http://portal.nersc.gov/pydap/cpmmjo/wrfidv_d01_2011-11-01_01.nc.dds

but 200 on 

 
http://portal.nersc.gov/pydap/20C_Reanalysis_ensemble/analysis.derived/pwat/pwat_1928.daily.nc.dds

that would imply a server problem. 

did someone seesomething different?

John


> Thanks for passing it along Yuan.
> 
> The 500MB file opens too quick in idv to have been downloaded I think.
> 
> 
> 
> Sent from my iPad
> 
> On May 23, 2013, at 12:10 PM, "Unidata IDV Support" <address@hidden> wrote:
> 
> >> Comments from the PyDAP hosting institution:
> >>
> >> "Let us know if there is anything we can do on our end to help.
> >> Would it be possible to get the underlying HTTP query URL that is 
> >> breaking? That would allow us to determing whether this is a client issue 
> >> or a server side problem.
> >> In other words, I'm looking for the URL that the client sends across, 
> >> including the parameters sent in to the file (stuff after the ? symbol).
> >> eg. 
> >> http://portal.nersc.gov/pydap/cpmmjo/wrfidv_d01_2011-11-01_01.nc?DN[0:1:5][0:1:26]&;
> >> "
> >>
> >>
> >> Is there something else they should be running (like Hyrax instead of 
> >> pydap?)
> >> Are there best practices aspects to this, or do java netCDF library 
> >> authors just
> >> pick their priorities one by one, and this one is a low priority?
> >>
> >>
> >> Thanks
> >> Brian
> >
> > Brian,
> >
> >   I moved this ticket to netCDF-Java group to see if they have any good 
> > solution. My guessing is that when you try to access the small file in the 
> > PyDAP, it is actually downloaded to the local tmp dir and opened in the 
> > IDV, and this doesn't work for the very big one and doesn't matter you 
> > select one field or the whole file.
> >
> >
> > Yuan
> >>
> >> On May 20, 2013, at 1:05 PM, Unidata IDV Support wrote:
> >>
> >>> Brian,
> >>>
> >>> The problem appears to be a function of the file size. The first file you 
> >>> sent us is 3G, the second is 500M. Moreover, IDV support for pydap may be 
> >>> limited.
> >>>
> >>> Best Wishes,
> >>>
> >>> Unidata IDV Support
> >>>
> >>>> But if pydap is the problem, why does this one work OK?
> >>>> It is on the same pydap server, just a different directory path to the 
> >>>> .nc file
> >>>> http://portal.nersc.gov/pydap/20C_Reanalysis_ensemble/analysis.derived/pwat/pwat_1928.daily.nc
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> On May 20, 2013, at 11:56 AM, Unidata IDV Support wrote:
> >>>>
> >>>>>> Hello idv folks.
> >>>>>>
> >>>>>> Any bells ring about why this remote data file fails me?
> >>>>>>
> >>>>>> Thanks for any ideas.
> >>>>>> Brian
> >>>>>
> >>>>> Brian,
> >>>>>    The pydap is quite different comparing to the regular opendap 
> >>>>> dataset. The url is basically a http link and the netCDF java library 
> >>>>> is not ready to access this kind of dataset.
> >>>>>
> >>>>>
> >>>>> Yuan
> >>>>>>> java.io.EOFException.
> >>>>>>> In grads, the reading error appears as
> >>>>>>> gadsdf: SDF file has no discernable X coordinate.
> >>>>>>>
> >>>>>>>
> >>>>>>> ---------------
> >>>>>>> Example of unopenable URL:
> >>>>>>> http://portal.nersc.gov/pydap/cpmmjo/wrfidv_d01_2011-11-01_01.nc
> >>>>>>> But when I download the file
> >>>>>>> Downloads/wrfidv_d01_2011-11-01_01.nc
> >>>>>>> it works OK.
> >>>>>>>
> >>>>>>>
> >>>>>>> So it is a PyDAP serving issue.
> >>>>>>>
> >>>>>>>
> >>>>>>> ------------
> >>>>>>> This file on the same server works:
> >>>>>>> http://portal.nersc.gov/pydap/20C_Reanalysis_ensemble/analysis.derived/pwat/pwat_1928.daily.nc
> >>>>>>> so it seems the PyDAP server itself is OK. Just the files or tree are 
> >>>>>>> not set up right?
> >>>>>
> >>>>>
> >>>>> Ticket Details
> >>>>> ===================
> >>>>> Ticket ID: MHJ-258620
> >>>>> Department: Support IDV
> >>>>> Priority: Normal
> >>>>> Status: Closed
> >>>>
> >>>> Brian Mapes
> >>>> address@hidden or address@hidden
> >>>
> >>>
> >>> Ticket Details
> >>> ===================
> >>> Ticket ID: MHJ-258620
> >>> Department: Support IDV
> >>> Priority: Normal
> >>> Status: Closed
> >>
> >> Brian Mapes
> >> address@hidden or address@hidden
> >
> >
> > Ticket Details
> > ===================
> > Ticket ID: MHJ-258620
> > Department: Support netCDF Java
> > Priority: Normal
> > Status: Open
> >
> 
> 

Ticket Details
===================
Ticket ID: MHJ-258620
Department: Support netCDF Java
Priority: Normal
Status: Open