Discoverability of research data is a core component of the research data ecosystem. Making data findable has always been one of DataCite’s main goals, with DataCite Search providing a tool to search for all datasets with DataCite DOIs.

Today the discoverability of datasets was taken to the next level with the launch of Google Dataset Search. Google recognized the increasing importance of data and wants to make it easier for everyone, not just researchers, to find datasets. It is similar to Google Scholar in that datasets are included wherever the data lives. This large-scale effort means increased visibility for all data repositories and provides an extra push to make all research data openly available.

To be able to include datasets from diverse sources, Google developed guidelines for dataset providers to describe their data in a way that allows Google to index the metadata. These guidelines include standard metadata such as title, dataset creator, publication data, publisher, license, and description, and use schema.org, a widely used metadata standard co-developed by Google.

The schema.org metadata need to be embedded into the dataset landing page so that the Google indexer can find them, and the data repository needs to provide a sitemaps file with the URLs of all dataset landing pages. By doing this the data repository not only can be indexed in Google Dataset Search, but also follows our community recommendations for embedding machine-readable metadata in landing pages. (Fenner et al., 2016).

The number of data repositories embedding schema.org metadata in dataset landing pages is still low, see our latest survey from May (Fenner et al. (2018)). If a data repository doesn't provide schema.org metadata via the dataset landing page, the next best option is indexers that store metadata about the dataset. DataCite Search is such a place, and in early 2017 we started to embed schema.org metadata in DataCite Search pages for individual DOIs, and we generated a sitemaps file (or rather files) for the over 10 million DOIs we have.

This allowed Google to collect metadata about these DOIs, even if the repository did not provide the metadata on its landing pages. As part of this work we had many conversations with Natasha Noy and Dan Brickley from Google, many data repositories implementing schema.org, and the broader schema.org community. DataCite was thrilled to be involved in discussions around the development of Google Dataset Search and to test previous versions.

Google Dataset Search will greatly enhance discoverability of research datasets and we will continue to ensure that all relevant datasets with DataCite DOIs are included. Right now the focus is mainly on Social Sciences and Environmental Sciences, but the use of schema.org should make expansion to other disciplines straightforward.

As Google also notes, a search engine is only as good as the metadata that go into it, so we want to encourage all DataCite members to continue to deposit complete metadata - that we then convert into schema.org format - to ensure your datasets can be found. Even better, embed schema.org metadata in your dataset landing pages. Should you have further questions, e.g. how to embed schema.org in your repository pages, do not hesitate to reach out to mailto:support@datacite.org.

References

Fenner, M., Crosas, M., Durand, G., Wimalaratne, S., Gräf, F., Hallett, R., … Clark, T. (2018, March). Listing of data repositories that embed schema.org metadata in dataset landing pages. https://doi.org/10.5281/zenodo.1263942

Fenner, M., Crosas, M., Grethe, J., Kennedy, D., Hermjakob, H., Rocca-Serra, P., … Clark, T. (2016). A Data Citation Roadmap for Scholarly Data Repositories. bioRxiv, 097196. https://doi.org/10.1101/097196


Blog Logo

Helena Cousijn

DataCite Director of Community Engagement and Communications

https://orcid.org/0000-0001-6660-6214

Blog Logo

Trisha Cruse

DataCite Executive Director

https://orcid.org/0000-0002-9300-5278

Blog Logo

Martin Fenner

DataCite Technical Director

https://orcid.org/0000-0003-1419-2405

Taking discoverability to the next level: datasets with DataCite DOIs can now be found through Google Dataset Search

https://doi.org/10.5438/5aep-2n86

History

© 2018 Helena Cousijn, Trisha Cruse, and Martin Fenner. Distributed under the terms of the Creative Commons Attribution license.

google, search, schema.org, featured
https://blog.datacite.org/taking-discoverability-to-the-next-level/
blog.datacite.org
crawl=CC-MAIN-2020-05
23093
application/http; msgtype=response
sha1:USMZBXDAI35BNWM7FAB637ONCKT6NR25
<urn:uuid:7bb3e1d0-942d-436e-b623-3aa247a08ae5>
2020-01-20T01:57:28Z
99.84.181.100
text/html
sha1:KDNDHAESSCRAY2MRPSUUF2W72QR6UID2
<urn:uuid:04de678e-0661-4a7b-ad45-10db44a426fc>
https://blog.datacite.org/taking-discoverability-to-the-next-level/
response
<urn:uuid:7b3524f9-b833-4741-abdc-28eb9d8a2e44>
isPartOf: CC-MAIN-2020-05
publisher: Common Crawl
description: Wide crawl of the web for January 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-48.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/