Difference between revisions of "Paleoclimate Data Standards"

From Linked Earth Wiki
Jump to: navigation, search
m (Essential metadata)
m (fix broken link to working groups)
Line 5: Line 5:
 
== The Big Idea ==
 
== The Big Idea ==
  
While more (meta)data seems universally better, workshop participants identified the necessity to '''distinguish a set of essential, recommended and desired properties''' for each dataset. A consensus emerged that the definition of these levels should be archive-specific, as what is needed to intelligently re-use a marine-annually resolved record could be quite different than what is needed to intelligently re-use an ice core record, for instance. It was decided that archive-centric [[Working Groups]] would be best positioned to elaborate and discuss the components of a data standard for their specific sub-field of paleoclimatology.
+
While more (meta)data seems universally better, workshop participants identified the necessity to '''distinguish a set of essential, recommended and desired properties''' for each dataset. A consensus emerged that the definition of these levels should be archive-specific, as what is needed to intelligently re-use a marine-annually resolved record could be quite different than what is needed to intelligently re-use an ice core record, for instance. It was decided that archive-centric [[:Category:Working Group | working groups]] would be best positioned to elaborate and discuss the components of a data standard for their specific sub-field of paleoclimatology.
  
 
== Essential metadata ==
 
== Essential metadata ==

Revision as of 14:32, 8 September 2016

A key objective of LinkedEarth is to promote the development of a community standard for paleoclimate data and metadata.

This page aims to summarize initial discussions from the June 22-23 PDS workshop on the subject of data and metadata standards. Notes came chiefly from Bronwen Konecky and Wendy Gross.

The Big Idea

While more (meta)data seems universally better, workshop participants identified the necessity to distinguish a set of essential, recommended and desired properties for each dataset. A consensus emerged that the definition of these levels should be archive-specific, as what is needed to intelligently re-use a marine-annually resolved record could be quite different than what is needed to intelligently re-use an ice core record, for instance. It was decided that archive-centric working groups would be best positioned to elaborate and discuss the components of a data standard for their specific sub-field of paleoclimatology.

Essential metadata

The conversation was guided by the following questions:

  1. What does “essential” mean (vs. highly desirable)?
  2. Who is the target audience/who are the end-users?
  3. What are the scientific end-goals?

For #1, we determined that:

  • "Essential" = data cannot be uploaded without it (the dataset would be utterly useless without any of this information missing)
  • "Essential metadata" should mean something different for legacy datasets vs. new datasets
  • "Essential" may vary by archive type

Overall, it was decided that separate "essential metadata" criteria needed to be applied to existing datasets vs. new datasets. In other words, the paleoclimate community should adopt stricter standards for what is essential in upcoming datasets, rather than being limited by the realities of old datasets.

For existing datasets, we deemed the following essential:

  • A table with at least two columns, one representing time, the other a climate indicator of some sort
  • Geolocation : coordinates, polygons, or, in cases where coordinates or polygons cannot be given, general location info)
  • Source: PI, contributor, or database (first author of publication if published, or some other person who can speak for the dataset if not published/if the first author is no longer in science/etc)
  • Names and Units of the variables in the dataset

Required Metadata

Moving forward, the paleodata community should adopt the following guidelines for what is 'essential':

  • All the above criteria, plus:
  • Archive type
  • measured material (i.e. what physical medium was the measurement made on)
  • uncertainty on measured variables (at the very least, analytical uncertainty on raw measurements)
  • Depth as well as age
  • Native observations (e.g. Mg/Ca measurements, BEFORE calibration to temperature)
  • age control points and other relevant age model info

Desired metadata

  • age-uncertain ensembles (realizations of the timeseries X(t) for different age model paths)
  • calibration ensembles (e.g. posterior draws from a Bayesian temperature calibration)