Data sources

From Freebase

Jump to: navigation, search

Contents

Licensing

The Freebase Terms of Service require contributors to only contribute data which is compatible with the Freebase licensing terms. It is up to individuals to ensure content (Data, Schema, Descriptions, or Media Files) can be uploaded. See License compatibility for more information. For external data sets which are not license compatible another option is to link to them using a strong identifier so that users can follow the link from Freebase to the other database.

Current sources

This is a partial list of sources from which data has been imported to Freebase.

You can find a fuller list at http://sources.freebaseapps.com/, although this lists only sources uploaded by the data team rather than by the community.

Automated sources (via Data pipeline)

Test sources

Linked Data

Linked Open Data, LOD, or Semantic web are terms that describe data that is meaningfully connected across different websites, and is accessible under an open License so that it can be combined and otherwise manipulated.

Terms and concepts:

Related semweb projects:

alt Linked Open Data cloud diagram

Proposed sources

See also LinkedData.org's cloud.

Proposed Key Sources

Many online databases may not have data dumps or appropriate licensing for import to Freebase. In this case we can still provide a link from Freebase back to the appropriate webpage. This is useful as it gives further data point for reconcilation of other items i.e. if we know imported topic A is the same as external website topic B, and Freebase topic C is also the same as B we can deduce that A should be reconciled with C. The linking relies on keys, so any external webpage should ideally relate 1 to 1 with a semantic entity, a topic on Freebase. The following is a list of possible data sources:


Further reading:

Personal tools
http://wiki.freebase.com/wiki/Data_sources
wiki.freebase.com
crawl=CC-MAIN-2015-11
29761
application/http; msgtype=response
sha1:VBFSSYZ6FFZBCEIA3A57QW6DWLN3LWGH
<urn:uuid:9f25c806-ce2a-40ca-8c32-eb98437a765b>
2015-03-04T02:48:10Z
74.125.22.121
sha1:7LJKLYBAUC567KHOHKGWQTQJFPKTH4GV
<urn:uuid:21c1d986-72b4-4499-962c-b911eee358bc>
http://wiki.freebase.com/wiki/Data_sources
length
response
<urn:uuid:0ae7949a-3b22-4419-a149-e4e94c98dff4>
robots: classic
hostname: ip-10-28-5-156.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2015-11
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for February 2015
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf