Discovering millions of datasets on the webDiscovering millions of datasets on the webResearch Scientist, Google Research

What’s new in Dataset Search?

Based on what we’ve learned from the early adopters of Dataset Search, we’ve added new features. You can now filter the results based on the types of dataset that you want (e.g., tables, images, text), or whether the dataset is available for free from the provider. If a dataset is about a geographic area, you can see the map. Plus, the product is now available on mobile and we’ve significantly improved the quality of dataset descriptions. One thing hasn’t changed however: anybody who publishes data can make their datasets discoverable in Dataset Search by using an open standard (schema.org) to describe the properties of their dataset on their own web page.

We have also learned how many different types of people look for data. There are academic researchers, finding data to develop their hypotheses (e.g., try oxytocin), students looking for free data in a tabular format, covering the topic of their senior thesis (e.g., try incarceration rates with the corresponding filters), business analysts and data scientists looking for information on mobile apps or fast food establishments, and so on. There is data on all of that! And what do our users ask? The most common queries include “education,” “weather,” “cancer,” “crime,” “soccer,” and, yes, “dogs”.
https://60.cozshopping.com/discovering-millions-of-datasets-on-the-webdiscovering-millions-of-datasets-on-the-webresearch-scientist-google-research/
60.cozshopping.com
crawl=CC-MAIN-2021-25
61744
application/http; msgtype=response
sha1:WTX6MMIOPNOTYHQH45WYJH55YMUKYNFL
<urn:uuid:3f089a21-ced5-4aa3-85a5-ab3add77196b>
2021-06-12T18:02:36Z
172.67.198.145
text/html
sha1:L3ZGF34VRFJOIZLS2KX7BGX3X7ESVCJE
<urn:uuid:d885bd8d-25f4-460b-a38b-8a0472ebed3a>
https://60.cozshopping.com/discovering-millions-of-datasets-on-the-webdiscovering-millions-of-datasets-on-the-webresearch-scientist-google-research/
response
<urn:uuid:c010cb88-7b6b-4901-8e0d-22d6e5f8ca8b>
isPartOf: CC-MAIN-2021-25
publisher: Common Crawl
description: Wide crawl of the web for June 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-225.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/