Wikidata to provide structured data for all Wikipedia versions

A new initiative will make it possible for any language version of the online encyclopedia to automatically pull in data rather than enter the information manually. But will it drive off editors?

With more than 280 different language editions of Wikipedia often sharing data elements like people's birth dates and definitions, there has never been a single central data repository from which each version could pull such information. Until now.

Today, the German chapter of the Wikimedia Foundation pulled back the wraps on Wikidata, a project that is aiming to be a single common source of structured data that can be used across all versions of Wikipedia. By December, that should allow editors of each individual language version of a Wikipedia article to pull data from that repository rather than adding it by hand themselves.

The project has an initial budget of $1.7 million, half of which is being funded by Microsoft co-founder Paul Allen's Allen Institute for Artificial Intelligence. An additional 25 percent of the funding is coming from Google, and the remaining 25 percent is from the Gordon and Betty Moore Foundation.

According to Andrew Lih, the author of "The Wikipedia Revolution," the Wikidata effort is a "logical progression" for Wikipedia, and one that will do for data use in the massively popular online encyclopedia what the Wikimedia Commons has done for sharing media across the dozens of different Wikipedia versions.

"When Wikipedia started out, it was every Wikipedia [language version] for itself," Lih said. "It was a manual process of...copying articles over."

The Wikimedia Commons allows editors to automatically pull in things like photographs and maps, and Lih said he sees Wikidata's making structured data commonly available as "much more efficient, and a better way to organize data."

But Lih also worries that the move to more technical solutions like Wikidata will hasten a trend that may be scaring away less tech-savvy Wikipedia editors. Over the years, he explained, the act of adding new information or articles to Wikipedia has gone from being something simple that anyone can understand to being something that requires filling in code that will correctly enter the new data in a database. And that was before the advent of Wikidata.

The problem, he said, is that the Wikipedia editing user interface is becoming trickier and trickier to navigate, and that may be driving away people who have trouble with complex data entry systems, and making it hard for Wikipedia to recruit new editors. And that will only get worse as more and more articles are re-configured to pull information from Wikidata.

Still, Lih acknowledges that something like Wikidata is a tool that's essential for the future of Wikipedia because it will allow article editors to query the central database for things like, say, all Austrian actors born between May 5 and May 12. That's not something that's possible today because the information that appears in Wikipedia articles is nothing more than text.

"So even though I'm hesitant," Lih said, "there's no doubt that this is the way it has to go."

 

Join the discussion

Conversation powered by Livefyre

Don't Miss
Hot Products
Trending on CNET

HOT ON CNET

Delete your photos by mistake?

Whether you've deleted everything on your memory card or there's been a data corruption, here's a way to recover those photos.
http://www.cnet.com/news/wikidata-to-provide-structured-data-for-all-wikipedia-versions/
www.cnet.com
crawl=CC-MAIN-2014-35
94152
application/http; msgtype=response
sha1:VRSWCMLAOHFU64HDVLHHSXZZKJJ5IEHZ
<urn:uuid:6b020086-940c-4c16-9eb8-c810cfe3f66b>
2014-08-29T08:02:06Z
23.62.6.58
sha1:JELXPT5E33MGQBI73V52CAYPA6XR62JL
<urn:uuid:29fd95ec-6e0b-45f8-805e-3f97834a238b>
http://www.cnet.com/news/wikidata-to-provide-structured-data-for-all-wikipedia-versions/
response
<urn:uuid:ce8f5662-004b-4462-8701-b28ba5b7fed4>
robots: classic
hostname: ip-10-180-136-8.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-35
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for August 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf