NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
NOTICE: This version of the NSF Unidata web site (archive.unidata.ucar.edu) is no longer being updated.
Current content can be found at unidata.ucar.edu.
To learn about what's going on, see About the Archive Site.
Hi Kevin: If I understand what you want, you have several options, depending on how much programming you want to do. 1. You can use the ncISO tool at http://www.ngdc.noaa.gov/eds/tds/. However,, while this gives you all the metadata it will not give you the results based on a search response. You would have to implement that. 2. You can use GI-cat, preferably after adding the ncISO service to your thredds (this will produce more metadata than otherwise), have GI-cat harvest this information, and then use one of the services that GI-cat supports to query GI-cat. This will return the URLs of the data that meet your search criteria. You would then have to send those requests to the TDS to actually get the data. HTH, -Roy On Mar 26, 2011, at 8:28 AM, Kevin Manross wrote: > > I've been digging around with GI-cat and it is very impressive. I'm afraid > that it may be a bit to "heavy weighted" for my needs, and/or not quite what > I need. However, there are some features that I may use (i.e., the eXist > library). > > I also stumbled upon the thredds.catalog.crawl and thredds.catalog.query > packages. I'm wondering if I could leverage this to crawl through the > hierarchical THREDDS catalog and extract the products/date-times that I'm > interested in. > > My next step would be to extract a bounding box, and then perform an > operation (i.e. getting the max value at each common gridpoint across all > aggregated netCDF files matching my query). > > Perhaps this question is better suited for the netcdf-java mail list, but is > the crawl and query tools intended to be used this way? How efficient are > they? > > Many thanks! > > -kevin. > > > On Wed, Mar 23, 2011 at 1:16 PM, Kevin Manross <kevin.manross@xxxxxxxxx> > wrote: > Very intriguing!! > > I'm in a meeting and trying to view this on my phone. What output > format(s) does GI-Cat provide? Is it mainly graphical, or can this > produce also produce CF netCDF? > > -kevin. > > (Sent from my iPhone) > > On Mar 23, 2011, at 13:10, Rich Signell <rsignell@xxxxxxxx> wrote: > >> Kevin, >> Just to follow up on Roy's comments: GI-CAT will harvest either the >> THREDDS metadata or the ncISO metadata (THREDDS or THREDDS-ncISO). >> >> ncISO has the advantage that if your data is CF-compliant, the >> geographic and time extents will be computed directly from the >> coordinate variables in the THREDDS datasets. >> >> See my 5 minute instructional video here for how to set up GI-CAT to >> harvest THREDDS ncISO metadata. Soon to go viral! ;-) >> http://www.youtube.com/watch?v=28biJHTQSrM >> >> -Rich >> >> On Wed, Mar 23, 2011 at 1:58 PM, Roy Mendelssohn >> <Roy.Mendelssohn@xxxxxxxx> wrote: >>> GI-cat : --http://essi-lab.eu/cgi-bin/twiki/view/GIcat >>> >>> -Roy >>> >>> On Mar 23, 2011, at 10:56 AM, Kevin Manross wrote: >>> >>>> >>>> Howdy! >>>> >>>> I think I may have asked this in person at one point, but I don't recall. >>>> Is there a way to search or query the main (and sub) catalog in TDS? >>>> >>>> We have our data set up hierarchically as such: >>>> >>>> >>>> UTCDAY/sensor/product/[subtype]/YYYYMMDD-HHMMSS.nc >>>> >>>> >>>> It would be tremendously advantageous for extracting subsetted data from >>>> our archives if we would be able to query the TDS catalog and obtain the >>>> paths and/or create aggregations based on the query input. >>>> >>>> For example, assume I have a TDS that has crawled through our data >>>> organized as above and created it's catalog structure. If I wanted to get >>>> all the grids of MESH (multi-radar maximum expected size of hail) between >>>> 04 June 2009 21z and 06 June 2009 04 z, is there a way that I can query >>>> the catalog(s) to get the span of data I am requesting? >>>> >>>> I'd be eager to hear if anything like this is possible - or how i might >>>> set up my configuration to possibly allow for something similar. >>>> >>>> Many thanks! >>>> >>>> -kevin. >>>> >>>> -- >>>> +-----------------------------------------------------+ >>>> Kevin L. Manross | ** New Address ** >>>> CIMMS Research Associate | 120 David L. Boren Bvd >>>> NSSL : WRDD : SWAT | Rm 3923 >>>> >>>> <kevin.manross@xxxxxxxx> >>>> | 405.325.6385 >>>> >>>> www.cimms.ou.edu/~kmanross >>>> | >>>> "My opinions are my own and not representative of >>>> CIMMS, NSSL, NOAA or any affiliates" >>>> +-----------------------------------------------------+ >>>> >>>> >>>> _______________________________________________ >>>> thredds mailing list >>>> thredds@xxxxxxxxxxxxxxxx >>>> For list information or to unsubscribe, visit: >>>> http://www.unidata.ucar.edu/mailing_lists/ >>> >>> ********************** >>> "The contents of this message do not reflect any position of the U.S. >>> Government or NOAA." >>> ********************** >>> Roy Mendelssohn >>> Supervisory Operations Research Analyst >>> NOAA/NMFS >>> Environmental Research Division >>> Southwest Fisheries Science Center >>> 1352 Lighthouse Avenue >>> Pacific Grove, CA 93950-2097 >>> >>> e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address) >>> voice: (831)-648-9029 >>> fax: (831)-648-8440 >>> www: http://www.pfeg.noaa.gov/ >>> >>> "Old age and treachery will overcome youth and skill." >>> "From those who have been given much, much will be expected" >>> >>> _______________________________________________ >>> thredds mailing list >>> thredds@xxxxxxxxxxxxxxxx >>> For list information or to unsubscribe, visit: >>> http://www.unidata.ucar.edu/mailing_lists/ >>> >> >> >> >> -- >> Dr. Richard P. Signell (508) 457-2229 >> USGS, 384 Woods Hole Rd. >> Woods Hole, MA 02543-1598 > > > > -- > +-----------------------------------------------------+ > Kevin L. Manross | ** New Address ** > CIMMS Research Associate | 120 David L. Boren Bvd > NSSL : WRDD : SWAT | Rm 3923 > > <kevin.manross@xxxxxxxx> > | 405.325.6385 > > www.cimms.ou.edu/~kmanross > | > "My opinions are my own and not representative of > CIMMS, NSSL, NOAA or any affiliates" > +-----------------------------------------------------+ > > > _______________________________________________ > thredds mailing list > thredds@xxxxxxxxxxxxxxxx > For list information or to unsubscribe, visit: > http://www.unidata.ucar.edu/mailing_lists/ ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center 1352 Lighthouse Avenue Pacific Grove, CA 93950-2097 e-mail: Roy.Mendelssohn@xxxxxxxx (Note new e-mail address) voice: (831)-648-9029 fax: (831)-648-8440 www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected"
thredds archives: