Querying the Datasets - Revision history

Khider: Add link to Notebook

2017-09-13T17:30:15Z

Add link to Notebook

Khider: fix query

2017-05-08T14:28:30Z

fix query

Admin: /* Get Datasets that have inferred variables with its calibration uncertainty less than 0.5 */

2017-04-28T12:18:03Z

‎Get Datasets that have inferred variables with its calibration uncertainty less than 0.5

Admin: /* Get Datasets that have paleo data based on d18O Proxy ( along with file names of the csv files ) */

2017-04-28T12:16:11Z

‎Get Datasets that have paleo data based on d18O Proxy ( along with file names of the csv files )

Admin: /* Example: Get a List of Datasets with archive type "Sclerosponge" and plot them on a map */

2017-04-27T03:32:55Z

‎Example: Get a List of Datasets with archive type "Sclerosponge" and plot them on a map

Admin: typo

2017-04-22T07:32:17Z

typo

Admin at 03:46, 17 April 2017

2017-04-17T03:46:17Z

Khider: Add a section linking the queries example

2016-11-08T22:57:01Z

Add a section linking the queries example

Admin at 04:39, 7 September 2016

2016-09-07T04:39:08Z

Admin: /* Fetch all dataset csv files given a dataset name */

2016-09-05T01:25:46Z

‎Fetch all dataset csv files given a dataset name

@@ Line 178: / Line 178: @@
        filelib.retrieve(fileurl, os.path.basename(fileurl))
 </syntaxhighlight>
 == See Also ==
 * [[Coral Query]]: Learn how to search the database by archive type

@@ Line 37: / Line 37: @@
 {{#ask:
 [[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::Sclerosponge]]
   | ?Coordinates
   | ?CoordinatesFor
@@ Line 51: / Line 51: @@
 {{#ask:
 [[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::Sclerosponge]]
   | ?Coordinates
   | ?CoordinatesFor

@@ Line 94: / Line 94: @@
 WHERE {
    ?v a core:InferredVariable .
-   ?v core:calibratedWith ?calibration .
+   ?v core:calibratedVia ?calibration .
    ?calibration core:hasUncertainty ?unc .
    ?unc core:hasValue ?val .
@@ Line 107: / Line 107: @@
 The following is a live URL that queries the SPARQL endpoint with the above query:
-http://wiki.linked.earth/store/ds/query?query=PREFIX+core%3A+%3Chttp%3A%2F%2Flinked.earth%2Fontology%23%3E%0APREFIX+xsd%3A+%3Chttp%3A%2F%2Fwww.w3.org%2F2001%2FXMLSchema%23%3E%0ASELECT+%3Fds+%3Fdata+%3Fv+%3Fval%0AWHERE+%7B%0A++%3Fv+a+core%3AInferredVariable+.%0A++%3Fv+core%3AcalibratedWith+%3Fcalibration+.%0A++%3Fcalibration+core%3AhasUncertainty+%3Func+.%0A++%3Func+core%3AhasValue+%3Fval+.%0A++FILTER+(xsd%3Adouble(%3Fval)+%3C+0.5)+.%0A++%3Fds+a+core%3ADataset+.%0A++%3Fv+core%3AfoundInTable+%3Ftable+.%0A++%3Fdata+core%3AfoundInMeasurementTable+%3Ftable+.%0A++%3Fds+core%3AincludesPaleoData+%3Fdata%0A%7D
+http://wiki.linked.earth/store/ds/query?query=PREFIX+core%3A+%3Chttp%3A%2F%2Flinked.earth%2Fontology%23%3E%0APREFIX+xsd%3A+%3Chttp%3A%2F%2Fwww.w3.org%2F2001%2FXMLSchema%23%3E%0ASELECT+%3Fds+%3Fdata+%3Fv+%3Fval%0AWHERE+%7B%0A++%3Fv+a+core%3AInferredVariable+.%0A++%3Fv+core%3AcalibratedVia+%3Fcalibration+.%0A++%3Fcalibration+core%3AhasUncertainty+%3Func+.%0A++%3Func+core%3AhasValue+%3Fval+.%0A++FILTER+(xsd%3Adouble(%3Fval)+%3C+0.5)+.%0A++%3Fds+a+core%3ADataset+.%0A++%3Fv+core%3AfoundInTable+%3Ftable+.%0A++%3Fdata+core%3AfoundInMeasurementTable+%3Ftable+.%0A++%3Fds+core%3AincludesPaleoData+%3Fdata%0A%7D
 === Querying Linked Earth Data from another Program/Script ===

@@ Line 78: / Line 78: @@
    ?pd core:foundInMeasurementTable ?table .
    ?table core:includesVariable ?var .
-   ?var core:onProxyObservationProperty wiki:D18O .
+   ?var core:proxyObservationType wiki:D18O .
    ?table core:hasFileName ?file
+}
@@ Line 85: / Line 85: @@
 The following is a live URL that queries the SPARQL endpoint with the above query:
-http://wiki.linked.earth/store/ds/query?query=PREFIX+core%3A+%3Chttp%3A%2F%2Flinked.earth%2Fontology%23%3E%0APREFIX+wiki%3A+%3Chttp%3A%2F%2Fwiki.linked.earth%2FSpecial%3AURIResolver%2F%3E%0ASELECT+%3Fs+%3Fpd+%3Ftable+%3Ffile%0AWHERE+%7B%0A++%3Fs+a+core%3ADataset+.%0A++%3Fs+core%3AincludesPaleoData+%3Fpd+.%0A++%3Fpd+core%3AfoundInMeasurementTable+%3Ftable+.%0A++%3Ftable+core%3AincludesVariable+%3Fvar+.%0A++%3Fvar+core%3AonProxyObservationProperty+wiki%3AD18O+.%0A++%3Ftable+core%3AhasFileName+%3Ffile%0A%7D
+http://wiki.linked.earth/store/ds/query?query=PREFIX+core%3A+%3Chttp%3A%2F%2Flinked.earth%2Fontology%23%3E%0APREFIX+wiki%3A+%3Chttp%3A%2F%2Fwiki.linked.earth%2FSpecial%3AURIResolver%2F%3E%0ASELECT+%3Fs+%3Fpd+%3Ftable+%3Ffile%0AWHERE+%7B%0A++%3Fs+a+core%3ADataset+.%0A++%3Fs+core%3AincludesPaleoData+%3Fpd+.%0A++%3Fpd+core%3AfoundInMeasurementTable+%3Ftable+.%0A++%3Ftable+core%3AincludesVariable+%3Fvar+.%0A++%3Fvar+core%3AproxyObservationType+wiki%3AD18O+.%0A++%3Ftable+core%3AhasFileName+%3Ffile%0A%7D
 ====  Get Datasets that have inferred variables with its calibration uncertainty less than 0.5  ====

@@ Line 37: / Line 37: @@
 {{#ask:
 [[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).MeasuredOn_(L)::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::<q>[[Category:Sclerosponge]]</q>]]
   | ?Coordinates
   | ?CoordinatesFor
@@ Line 51: / Line 51: @@
 {{#ask:
 [[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).MeasuredOn_(L)::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).HasProxySystem_(L).ProxyArchiveType_(L)::<q>[[Category:Sclerosponge]]</q>]]
   | ?Coordinates
   | ?CoordinatesFor

@@ Line 21: / Line 21: @@
 <pre>
-{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).OnProxyObservationProperty_(L)::D18O]]
+{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).ProxyObservationType_(L)::D18O]]
   | ?IncludesPaleoData_(L)=PaleoData
   | format=broadtable
@@ Line 27: / Line 27: @@
 }}
 </pre>
-{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).OnProxyObservationProperty_(L)::D18O]]
+{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).ProxyObservationType_(L)::D18O]]
   | ?IncludesPaleoData_(L)=PaleoData
   | format=broadtable

@@ Line 6: / Line 6: @@
 ==== Example: Get a List of Datasets (limit to 5) ====
 <pre>
-{{ #ask: [[Category:Dataset_©]]
+{{ #ask: [[Category:Dataset_(L)]]
   | mainlabel=Datasets
   | format=broadtable
@@ Line 12: / Line 12: @@
 }}
 </pre>
-{{ #ask: [[Category:Dataset_©]]
+{{ #ask: [[Category:Dataset_(L)]]
   | mainlabel=Datasets
   | format=broadtable
@@ Line 21: / Line 21: @@
 <pre>
-{{ #ask: [[Category:Dataset_©]] [[IncludesPaleoData_©.FoundInMeasurementTable_©.IncludesVariable_©.OnProxyObservationProperty_©::D18O]]
+{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).OnProxyObservationProperty_(L)::D18O]]
-  | ?IncludesPaleoData_©=PaleoData
+  | ?IncludesPaleoData_(L)=PaleoData
   | format=broadtable
   | limit=5
 }}
 </pre>
-{{ #ask: [[Category:Dataset_©]] [[IncludesPaleoData_©.FoundInMeasurementTable_©.IncludesVariable_©.OnProxyObservationProperty_©::D18O]]
+{{ #ask: [[Category:Dataset_(L)]] [[IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).OnProxyObservationProperty_(L)::D18O]]
-  | ?IncludesPaleoData_©=PaleoData
+  | ?IncludesPaleoData_(L)=PaleoData
   | format=broadtable
   | limit=5
@@ Line 36: / Line 36: @@
 <pre>
 {{#ask:
-[[Category:Location_©]]
+[[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_©.FoundInMeasurementTable_©.IncludesVariable_©.MeasuredOn_©::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).MeasuredOn_(L)::<q>[[Category:Sclerosponge]]</q>]]
   | ?Coordinates
   | ?CoordinatesFor
-  | ?Name_©
+  | ?Name_(L)
   | showtitle=off
   | maxzoom=14
@@ Line 50: / Line 50: @@
 </pre>
 {{#ask:
-[[Category:Location_©]]
+[[Category:Location_(L)]]
-[[CoordinatesFor.IncludesPaleoData_©.FoundInMeasurementTable_©.IncludesVariable_©.MeasuredOn_©::<q>[[Category:Sclerosponge]]</q>]]
+[[CoordinatesFor.IncludesPaleoData_(L).FoundInMeasurementTable_(L).IncludesVariable_(L).MeasuredOn_(L)::<q>[[Category:Sclerosponge]]</q>]]
   | ?Coordinates
   | ?CoordinatesFor
-  | ?Name_©
+  | ?Name_(L)
   | showtitle=off
   | maxzoom=14
@@ Line 66: / Line 66: @@
 One can also make more complex queries using SPARQL to the wiki's triple store.  The SPARQL endpoint is http://wiki.linked.earth/store/ds/query, and one can make queries by passing a query parameter with the text of the SPARQL query. The data can be returned in a variety of formats. The SPARQL queries refer to the Linked Earth core ontology terms found at http://linked.earth/ontology.
-''Note: The mapping between terms on the wiki and the ontology can be found at any wiki Property or Category page by looking at the "Imported from" value. For example, the property [[Property:ArchivedIn_©]] imports the term core:archivedIn from the ontology, where "core:" prefix refers to the linked earth ontology at http://linked.earth/ontology''
+''Note: The mapping between terms on the wiki and the ontology can be found at any wiki Property or Category page by looking at the "Imported from" value. For example, the property [[Property:ArchivedIn_(L)]] imports the term core:archivedIn from the ontology, where "core:" prefix refers to the linked earth ontology at http://linked.earth/ontology''
 ====  Get Datasets that have paleo data based on d18O Proxy ( along with file names of the csv files ) ====

← Older revision		Revision as of 22:57, 8 November 2016
Line 178:		Line 178:
	filelib.retrieve(fileurl, os.path.basename(fileurl))		filelib.retrieve(fileurl, os.path.basename(fileurl))
	</syntaxhighlight>		</syntaxhighlight>
		+
		+	== See Also ==
		+	* [[Coral Query]]: Learn how to search the database by archive type

@@ Line 35: / Line 35: @@
 ==== Example: Get a List of Datasets with archive type "Sclerosponge" and plot them on a map ====
 <pre>
-{{#ask: [[Category:Location_©]] [[CoordinatesFor.archiveType::sclerosponge]]
+{{#ask:
   | ?Coordinates
   | ?CoordinatesFor
@@ Line 47: / Line 49: @@
 }}
 </pre>
-{{#ask: [[Category:Location_©]] [[CoordinatesFor.archiveType::sclerosponge]]
+{{#ask:
   | ?Coordinates
   | ?CoordinatesFor

@@ Line 140: / Line 140: @@
 datasetname = sys.argv[1]
 endpoint = "http://wiki.linked.earth/store/ds/query" # Query Metadata
@@ Line 148: / Line 149: @@
 SELECT ?data ?filename
 WHERE {
-   wiki:""" + datasetname + """ core:includesPaleoData ?data .
+   ?ds core:includesPaleoData ?data .
    ?data core:foundInMeasurementTable ?table .
    ?table core:hasFileName ?filename