Wikidata:Data donation

From Wikidata
Jump to navigation Jump to search

Data donation
This page is written for institutions, companies, organisations and individuals who are interested in adding data to Wikidata.

You may find these related resources helpful:

High-contrast-document-save.svg Dataset Imports    High-contrast-view-refresh.svg Why import data into Wikidata.    Light-Bulb by Till Teenck.svg Learn how to import data    Noun project 1248.svg Bot requests    Question Noun project 2185.svg Ask a data import question
Other languages:
Bahasa Melayu • ‎Deutsch • ‎English • ‎Esperanto • ‎Lëtzebuergesch • ‎Nederlands • ‎Türkçe • ‎català • ‎dansk • ‎español • ‎français • ‎italiano • ‎norsk bokmål • ‎occitan • ‎polski • ‎português • ‎português do Brasil • ‎suomi • ‎svenska • ‎čeština • ‎български • ‎македонски • ‎русский • ‎српски / srpski • ‎тоҷикӣ • ‎українська • ‎հայերեն • ‎العربية • ‎فارسی • ‎پښتو • ‎नेपाली • ‎মেইতেই লোন্ • ‎ไทย • ‎中文 • ‎日本語 • ‎한국어

About Wikidata[edit]

Donating data to Wikidata (English)
Linked Data - San Francisco
Wikidata-logo-en.svg

Wikidata is a multilingual free knowledge base about the world that can be read and edited by humans and machines alike. It provides data in all the languages of the Wikimedia projects, and allows for the central access to data in a similar vein as Wikimedia Commons does for multimedia files, it is also used by many other websites. The data on Wikidata is added by a community of volunteers both manually and by using software, much like other Wikimedia projects including Wikipedia.

Wikidata has millions of items, each representing things like a person, a place, an artwork, an abstract concept, or some other type of entity. Each item has statements (key-value pairs), each statement in turn consisting of a property such as "birth date", and the appropriate value for the item. Properties have their own pages on Wikidata and are connected to items, resulting in a linked data structure. There can also be statements for external identifiers, such as a VIAF IDs.

Wikidata is hosted by the Wikimedia Foundation, a nonprofit charitable organization dedicated to encouraging the growth, development and distribution of free, multilingual, educational content, and to providing the full content of these wiki-based projects to the public free of charge.

What data we host[edit]

High-contrast-document-save.svg

Wikidata focuses on a basic level of useful information about the world and links to other resources for specialized data on the subject. Sources for data on Wikidata must be:

  • Reliable
  • Publicly available

The best way to find out which parts of your data is suitable for Wikidata is to talk to the Wikidata community.


Why add data to Wikidata[edit]

There are many reasons to add data to Wikidata including:

High-contrast-zoom-in.svg

Help more people to see your information[edit]

Data from Wikidata is used by many high traffic websites including Wikipedia which is one of the most used websites in the world receiving over 15 billion page views per month.

Wikipedia-logo-v2-en.svg

Improve open knowledge[edit]

Wikidata hosts data that can be used on Wikimedia projects and beyond. By adding data to Wikidata you create a framework and checklist to help your topic to be well covered and up to date in all Wikimedia projects in many languages.

High-contrast-mail-forward.svg

Increase traffic to your website[edit]

Anyone looking at Wikidata or other sites that use Wikidata including Wikipedia can see a clickable reference link for the source of the data, making it easy to visit your website.

High-contrast-insert-object.svg

Make your data more useful for yourself and others[edit]

Under Tim Berners-Lee's (the inventor of the World Wide Web) 5-star Open Data plan, making your data available as a spreadsheet is rated as 2 stars, but adding it to Wikidata will rate it as 5 stars, allowing it to benefit from the network effect. By adding data to Wikidata it becomes more useful, you can:

  • Combine it with other data
  • Use Wikidata tools to explore the data
  • Visualise your data along with data from other sources

Organisations who have worked with Wikidata[edit]

High-contrast-emblem-favorite.svg

Case studies[edit]

Many organisations are choosing to work with Wikidata. Case studies are available on the following projects:

High-contrast-emblem-downloads.svg

Organisations whose data has been added to Wikidata[edit]

Data from many organisations have been added to Wikidata. These include:

  • Art UK (formerly known as BBC: Your Paintings)
  • Bibliothèque nationale de France: IDs, references and biographical data
  • British Museum: Thesaurus
  • National Library of Australia: People identifier
  • Rijksbureau voor Kunsthistorische Documentatie: Artist biographies
  • UNESCO: Programme inscriptions eg. World Heritage Sites
  • National Nuclear Data Center: Nuclide stability, natural abundance, decays and half life

Wikidata and copyright[edit]

Copyright symbol 9.gif

An overview of open data and data licensing is available at Wikidata:Open data publishing.

All data on Wikidata is released under Creative Commons CC0 (public domain). However individual facts and identifiers, such as numbers and IDs are not copyrightable. If you are an institution based in Europe, the whole of your ID list may be under database copyright, but we would not be copying the entire list in bulk; rather, volunteers add most of them individually, one at a time. For more information please see the Wikimedia Foundation’s guidance on database rights.

Every database is different. To define whether your organisation would need to make a license change on your data or if the section of data you would like to make available does not fall under copyright please contact the Wikidata community.

Reusing and combining Wikidata data[edit]

There are many tools to manipulate data on Wikidata, for a full list see the Wikidata external tools and the Tools Directory.

High-contrast-view-refresh.svg

Reusing data[edit]

It's easy to access data on Wikidata. Data can be reused in Wikimedia projects and beyond, making exciting applications possible.

You can use our data including translated names, birth/death dates and locations, free images, you name it.

High-contrast-edit-copy.svg

Matching your data with other data sets[edit]

Many tools exist to augment or cross-check your data with data from other sources. One example is BEACON which can give you a list of your IDs matched against any other we have for the same items, e.g Art UK artists against VIAF. Mix'n'match and OpenRefine can be used to create connections between your database and Wikidata.

High-contrast-applications-internet.svg

Visualisations[edit]

Several tools exist to visualise Wikidata data including:

  • Histropedia: uses data from Wikipedia and Wikidata to automatically generate interactive timelines with events linked to Wikipedia articles. Example: The Apollo missions
  • Monumental: a tool that allows you to explore built heritage and learn more about monuments by collating information Wikidata, Wikipedia and Wikimedia Commons. Example: Paris
  • Wikidata Graph Builder: uses data from Wikidata to create graphs of concepts and their related concepts.
  • Wikidata Query Service: A service that offers the ability to run complex queries on items in Wikidata, and related tools e.g. World Heritage sites

How to add data to Wikidata[edit]

The process of adding Wikidata can be technically challenging but the Wikidata community is very happy to discuss with you the best approach and offer assistance where needed. The basic process is:

  1. Contact the Wikidata community describing what data you have and would like to include in Wikidata.
  2. Decide with the Wikidata community what data is suitable to import.
  3. Work with the Wikidata community to import the data

1. Contact the Wikidata community[edit]

Wikimedia Community Logo.svg

There is a central noticeboard for contacting the Wikidata community called Project chat.

  1. Create your own Wikimedia account (do not use the name of an organisation in the title).
  2. Make sure you are logged in
  3. Go to the Project chat page.
  4. Click the blue Start a new discussion button.
  5. Write a message and make sure to include a title in the title line.
  6. Sign the message by writing ~~~~ at the end of your message.
  7. Click Show preview underneath your message to make sure your message has been written correctly, you will see that your username has appeared where the ~~~~ were added.
  8. Click Save page to post the message.

Users will either reply to your message on the Project chat page or on your userpage which you can access by clicking Talk at the top of the screen next to your username. Please note pages become archived after a short while to make room for new messages, to access old messages go to the Archive index.

You can also use IRC.

2. Decide with the Wikidata community what data to import[edit]

Wikidata does not include all data available but just a useful subset. Please refer to our notability criteria for the minimum requirements.

3. Work with the Wikidata community to import the data[edit]

There are several ways to add data to Wikidata including

High-contrast-document-save-as.svg

Manual data entry[edit]

Everyone can add data to Wikidata by manually adding the data.

High-contrast-document-properties.svg

Online tools[edit]

There are a number of online tools to help with the import of data into Wikidata. Some of them that support specific workflows for data imports are:

  • Mix'n'match contains lists of important concepts from reliable sources and allows to match the names to Wikidata entries with one click. It is possible to get your list included. Read the blogpost about the motivation behind Mix'n'match.
  • The primary sources tool allows for a curation workflow for data donations to Wikidata, where Wikidata editors can review, edit, or reject data offered to the community. It was initially developed for datasets from Freebase, but can be used for any collection of very large non-curated datasets.
  • QuickStatements (Q20084080): allows users to create items and upload lists of statements based on input in tab-separated format exported from spreadsheets
  • fatameh allows users to create fully populated items about scientific papers with one click.
High-contrast-applications-system.svg

Wikidata API[edit]

The Wikidata API is a web service that provides convenient access to wiki features, data, and meta-data over HTTP.

High-contrast-contact-new.svg

Bots[edit]

Bots (also known as robots) are tools used to make edits without the necessity of human decision-making. Bots on Wikidata can add interwiki links, labels, descriptions, statements, references, and can even create items, among other things. We also collect hints and inspiration for your own code to import data with a bot.

Other ways organisations can be involved with Wikimedia[edit]

Wikimedia-logo.svg

There are a number of ways organisations can be involved with Wikimedia including:

  • Making media content available
  • Contributing to Wikipedia articles
  • Hosting Wikimedia events
  • Hosting a Wikimedian in Residence

For more information contact your local Wikimedia chapter.

Useful links[edit]

High-contrast-go-jump.svg

An introduction to Wikidata
Community Portal
A glossary of Wikidata terms
Wikidata Tool Directory
Create a Wikimedia account (do not use the name of an organisation in the title).

Retrieved from "https://www.wikidata.org/w/index.php?title=Wikidata:Data_donation&oldid=877591628"
http://littleknownlies.com/index.php?q=aHR0cDovL3dlYi5hcmNoaXZlLm9yZy93ZWIvMjAxOTAzMjAwNTI2MTQvaHR0cHM6Ly93d3cud2lraWRhdGEub3JnL3dpa2kvU3BlY2lhbDpNeUxhbmd1YWdlL1dpa2lkYXRhOkRhdGFfZG9uYXRpb24%3D
littleknownlies.com
crawl=CC-MAIN-2021-21
132829
application/http; msgtype=response
sha1:I6KWLQVPBW4Y73XW5P2VVMPYW6E7EHH6
<urn:uuid:3cb6ab0e-c902-4914-b4f8-17a59945a3cf>
2021-05-13T03:21:03Z
74.208.215.216
text/html
sha1:Y2SEQ37756DNTU6HBBBKWWTO5HAOXC3Q
<urn:uuid:9a43453d-ed5f-42a0-8a9e-6fbcc6cd6260>
http://littleknownlies.com/index.php?q=aHR0cDovL3dlYi5hcmNoaXZlLm9yZy93ZWIvMjAxOTAzMjAwNTI2MTQvaHR0cHM6Ly93d3cud2lraWRhdGEub3JnL3dpa2kvU3BlY2lhbDpNeUxhbmd1YWdlL1dpa2lkYXRhOkRhdGFfZG9uYXRpb24%3D
response
<urn:uuid:cd9845c6-4917-4f87-b820-a0f02440d705>
isPartOf: CC-MAIN-2021-21
publisher: Common Crawl
description: Wide crawl of the web for May 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-63.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/