Re: [thredds] data repository survey

• To: Simon.Pigot@xxxxxxxx
• Subject: Re: [thredds] data repository survey
• From: Gerry Creager - NOAA Affiliate <gerry.creager@xxxxxxxx>
• Date: Mon, 24 Jun 2013 10:17:39 -0600

Simon

Somehow I'd forgotten about GeoNetwork. Thanks for the pointer. Looks like
it's matured since I last looked. I'll have to see about implementing it
(and Ramadda) side-by-side for some of our forecast verification work!

gerry


On Mon, Jun 24, 2013 at 7:31 AM, <Simon.Pigot@xxxxxxxx> wrote:

> Hi Jeff,
>
> Very timely email!
>
> There is another repository that has some similarities to RAMADDA:
> GeoNetwork. GeoNetwork also has a simple http repository for files which I
> would really like to replace with RAMADDA's scientific content management
> system and it seems a natural fit for RAMADDA to provide metadata fragments
> from its content types to fill out some of the metadata fields in
> GeoNetwork metadata records (we already can harvest metadata from THREDDS
> to fill out fragments of ISO metadata records). On the flip side,
> GeoNetwork has pretty good support for a lot of metadata standards
> (especially ISO and profiles) etc, good basis in Lucene search, some nice
> metadata catalog operations (harvesting protocols etc) and nice acceptance
> from a lot of organisations so there are benefits for RAMADDA if GeoNetwork
> was to handle the metadata side of RAMADDA.
>
> I've had quite a look at and evaluation of RAMADDA and am definitely
> interested in fostering direct, resourced collaboration on bringing the
> benefits of both RAMADDA and GeoNetwork together. I am a member of the
> GeoNetwork Project Steering Committee and would definitely like to discuss
> this further!
>
> Cheers,
> Simon
>
> ----
>
> PS: Also fixed a nagging bug sometime ago with the RAMADDA THREDDS
> harvester (1.5a) a few months ago - but never got round to supplying it to
> you - can I email you the simple patch?
> ________________________________________
> From: thredds-bounces@xxxxxxxxxxxxxxxx [thredds-bounces@xxxxxxxxxxxxxxxx]
> on behalf of Jeff McWhirter [jeff.mcwhirter@xxxxxxxxx]
> Sent: Monday, 24 June 2013 10:46 PM
> To: THREDDS
> Subject: [thredds] data repository survey
>
> Hi all,
>
> The Unidata folks recently presented a survey of data repositories:
> http://www.unidata.ucar.edu/committees/usercom/2013Apr/summary.html
>
> The intent was to identify and compare systems that are similar to RAMADDA
>  (http://ramadda.org) and presumably the TDS. Some of the systems
> mentioned were new to me and the survey does not provide much detail on
> them.
>
> For all of you TDS users out there  -
> Has anyone tried the above mentioned systems - e.g, ckan.org<
> http://ckan.org>, dataone, science base
> What other systems have you evaluated? (ESRI Geoportal, EuroGEOSS broker,
> ???)
> What kinds of features do they have that you have  found useful?
> What features would you like to see in a data repository?
>
> For those of you who aren't familiar with RAMADDA below is a quick
> overview of some of its features.
>
> -Jeff
>
>
>
> RAMADDA  is a data and information management framework that supports all
> kinds of digital "stuff".
> Some of the key features include:
>   Extensible content type system
>   Extensible  metadata framework  - define new metadata types via xml -
> e.g., DIF, THREDDS, etc
>   Model-View framework: content encodings include various HTML views
> (mapping, calendar, timeline),
>   JSON,  Geo-RSS, ATOM-XML, DIF, CSV, THREDDS Catalog, ICAL, etc.
>   Content management services - create, read,  update, delete (CRUD)
>   Fully featured HTML template facility
>   User and role-based access control
>   Comprehensive plugin framework
>   Rich search - text, spatial, temporal and faceted metadata
>   APIS -  Publishing APIs,  OAI-PMH, OpenSearch, import/export
>   Integrated rich content wiki facility
>   Virtual repository facility
>
>
> RAMADDA environment:
> 100% Java, Open-source (https://sourceforge.net/projects/ramadda/)
> Built on the standard Java servlet framework and runs under any servlet
> container
> - e.g., Tomcat, Glassfish or runs from the command line with Jetty
> Uses *any* JDBC compliant relational database - Derby, H2, Oracle,
> PostGRES, mySQL
> Web-based administration and configuration
> Integrated user model or external authentication via LDAP, etc
>
> Gridded  data:
> ses the Java NetCDF stack
> spatial, temporal and faceted metadata extraction and search
> spatial and temporal subset service, time series extraction service
> OpenDAP
> Metadata browse and NCML generation
> NCO (NetCDF Operators)  and  CDO (Climate Data Operators) integration
> NCML-based data model modifications, grid aggregation
> IDV-based server side visualization
> Climate model data management and analysis package
>
> Point data:
> File reader framework - over 40 file formats to date
> spatial, temporal and faceted metadata extraction
> metadata and data browse, mapping and charting
> spatial, temporal and paramater value based subset
> aggregation
> point format conversions - to NetCDF, LAS, CSV, etc.
> gridding and product generation
> web service API
>
> Other data types and services:
> Structured information - bibliography, Blog, Glossary, FAQ, Notes, Photo
> album
> Science project ontology constructs  -program, project, site, visit,
> campaign, dataset
> shapefiles, GPX, raw GPS, RiNEX, all radar file formats, FITS astronomy
> data
> email ingest and publishing service, SMS integration with Twilio
> Extensible structured lists  - bookmarks, todo, status board, tasks, etc
>
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>



-- 
Gerry Creager
NSSL/CIMMS
405.325.6371
++++++++++++++++++++++
“Big whorls have little whorls,
That feed on their velocity;
And little whorls have lesser whorls,
And so on to viscosity.”
Lewis Fry Richardson (1881-1953)

• References:
  • [thredds] data repository survey
    • From: Jeff McWhirter
  • Re: [thredds] data repository survey
    • From: Simon.Pigot