Questions tagged [wikipedia]

Wikipedia is a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation.

Filter by
Sorted by
Tagged with
4
votes
1answer
39 views

Geotagged wiki data

For a research purpose how can I extract geotagged wiki data (containing page id or titles for articles that refer to particular geolocation) for a city in England.
3
votes
0answers
26 views

How are Wikipedia subcategories meant, semantically?

Let's have a look at the category https://en.wikipedia.org/wiki/Category:British_politicians Theresa May is not in it. So let's see: Theresa May is in Category:20th-century_British_women_politicians ...
1
vote
3answers
45 views

Wikipedia referenced articles in computer readable format?

A huge number of news related wiki pages contain article references (for example this article on the 2017 Equifax data breach) and I would like to obtain the following data from the references section ...
1
vote
2answers
224 views

Converting Wikipedia URL to Wikipedia Page ID

I've linked phrases in texts to entities in Wikipedia: Going over the bridge, coming from Aliante Casino, you cant miss the nice view of the href="http://en.wikipedia.org/wiki/Waterfall">...
1
vote
1answer
38 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
4
votes
0answers
209 views

Torrent for Wikidata dump

I'm looking for Wikipedia (enwiki-latest-pages-articles-multistream.xml.bz2) and a Wikidata (latest-all.json.bz2 ) dumps. The files are quite large (the latter has ~47GB) and my internet connection ...
1
vote
1answer
63 views

How do I extract certain articles from Arabic Wiki Dumps?

I need to collect all articles that are about countries and continents in Arabic from Wikipedia. I was wondering how do I find these articles if I downloaded the latest wiki dump? New to the field. ...
0
votes
1answer
74 views

Query wikipedia links

I'm using the following query to receive label and description of all Wikidata-entries with geo-location in a geo-bounding box: SELECT DISTINCT ?place ?placeLabel ?placeDescription ?location WHERE { ...
1
vote
0answers
31 views

How come there are missing entities in this SPARQL query?

I was interested in listing all books, so I wrote: SELECT ?book ?url WHERE { ?book wdt:P31 wd:Q571 . OPTIONAL { ?url schema:about ?book . ?url schema:inLanguage "en" . ?url schema:...
1
vote
1answer
40 views

Non commercial use of nfl team logos from Wikipedia

I am about to publish some use cases for an open source visualization I did for hierarchical data. One use case is sports data, e.g. visualizing the super bowl play by play. I would like to use the ...
1
vote
1answer
66 views

What are Outlink categories of Wikipedia

I am wondering if it is possible to view outlink categories of a given article in Wikipedia? For example, consider the Wikipedia article about 'Data Mining'. What are the outlink categories of "Data ...
2
votes
1answer
121 views

Limiting a SPARQL Query to Lastest Point in Time

I'm trying to get information on Prefectures in Japan out of Wikidata. I succeeded to read the population statement, however there are occasionally several values with different point in time fields. ...
2
votes
2answers
116 views

How to get specific wikipedia data?

I only want to use the link structure and articles’ content of Wikipedia. Therefore, I want to downlaod the dump that contains only the following details. articles content link structure (i.e. re-...
3
votes
1answer
583 views

Wikimedia Commons API image by category

I'm trying to retrieve a list of urls of images in Wikimedia Commons from a particular article. I want to either search article by category and retrieve images from them, or filter images by category. ...
3
votes
0answers
44 views

Is it fair use to use figures from ArXiv preprints on Wikipedia?

Apologies if this isn't the right exchange. I'm not sure where this question should live. There are some science figures from Arxiv papers that I think would greatly enhance a Wikipedia page on the ...
3
votes
1answer
47 views

2 category intersection with PetScan not working?

I'm trying to create an intersection between two categories on Wiktionary using PetScan (http://tools.wmflabs.org/catscan2/catscan2.php), but I can't get it to work. What I've read says it should be ...
3
votes
1answer
61 views

Crosswalk between FIPS codes and Wikipedia articles about U.S. Census Places

The English Wikipedia includes an article for nearly every U.S. Census Place. Has anyone published a crosswalk from FIPS codes of these places to Wikipedia urls? Is this something that would be ...
1
vote
1answer
60 views

How can I get data about Wikipedians (e.g. language proficiency), by username?

Is there an open dataset containing information such as username, language proficiency levels (https://en.m.wikipedia.org/wiki/Wikipedia:Babel/Levels) and (possibly) academic degrees and nationality ...
1
vote
1answer
61 views

Search in wikidata with specific Q code

I've this query but I can't understand why doesn't return any result. I try different versions (with link, with only code, with wd:code) but nothing seems to work. What I need is this query but ...
2
votes
1answer
187 views

Wikidata - Search of human instance that doesn't break

Is this possible, like the wikidata autocomplete combo works, in a speedy way, with a filter of "itemlabel strings start with..." ? PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> SELECT ?item ...
4
votes
1answer
576 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
4
votes
1answer
132 views

Wikidata differs from Wikipedia

I am trying to retrieve data for a company programmatically using the Wikidata API. However, the data retrieved from Wikidata is different from en.wikipedia.org. Is this expected? Example: Nissan ...
2
votes
2answers
116 views

Various Country Statistics

In Wikipedia articles of countries a lot of statistics are given about the country at hand. For example in the Venezuela article, demographics are described in terms of ethnic groups (e.g. 51.6% are ...
1
vote
0answers
43 views

Download clean coordinates from Wikipedia Map Module: … detailed map

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
4
votes
1answer
69 views

Wikipedia Article Category

The wikipedia Page View API provides information about the number of page views for a given article, including an option to view top-N articles in a given day or month: https://wikimedia.org/api/...
1
vote
0answers
46 views

wikipedia user data for a recommendation engine

So I pulled the Wikipedia Page Traffic Statistics into an AWS instance and then downloaded a file which represents one hour from several months of usage data to look at locally, but it didn't really ...
3
votes
2answers
112 views

Info based on page title?

I'm looking for a way to get info from wikipedia based on the page title. example: If i have a page called "Britney Spears" i want to be able to get a simple bio extracted from wikipedia onto the ...
3
votes
1answer
95 views

Wikipedia: How to activate email notification from watchlist?

I may have a blackout on this, so please help. I have a wikipedia account with a confirmed email. I have checked the box "Email me when a page or file on my watchlist is changed". I have two pages ...
9
votes
2answers
344 views

Is Wikidata up to date with Wikipedia?

I think that DBpedia links to Wikipedia by Wikipedia database dump, making it not up to date with on-line Wikipedia contents. I was wondering if Wikidata uses on-line Wikipedia content or if it also ...
2
votes
2answers
815 views

Get section and page title from a list of articles in Wikipedia via API

I want to get the different sections with their pages from the Wikipedia:Featured articles. By following this answer, I know I can get page titles of links as follows: https://en.wikipedia.org/w/...
6
votes
2answers
395 views

How to get urls of entries in wikipedia list articles?

I am trying to retrieve the URL of all articles listed inside wikipedia list articles. For concreteness lets consider the wikimedia list article List_of_American_scientists I know how to use the wiki ...
1
vote
1answer
63 views

Downloading wikipedia data from specific url

I want to download data from Wikipedia page I am a rookie at this and can'T find any relevant articles. Most of them are on downloading full Wikipedia. I need just one specific URL data.
3
votes
2answers
2k views

Download wikipedia dump and save in raw text form

I have been trying to use Wikipedia text data for my personal research. I know that crawling is not good for the Wikipedia server so I downloaded a big XML file from https://dumps.wikimedia.org/jawiki/...
8
votes
1answer
353 views

wikidata: (when) will it be possible to query for wikipedia page links?

(When) will the following be possible: For a wikipedia page: get the list of all wikipedia links on that page with their respective wikidata IDs in a single query/API call. Receive additional ...
4
votes
2answers
216 views

wikipedia page: get the list of all links with their wikidata ids

For a Wikipedia page: is it possible to get the list of all Wikipedia links on that page with their respective wikidata IDs in a single query/API call? Optional: can additional information of the ...
4
votes
2answers
387 views

ISO 3166-1 country codes in DBpedia

How can I get a two-letter ISO 3166-1 country code in DBpedia? More specifically, I'm querying the SPARQL endpoint like this: SELECT DISTINCT ?iata ?country where { ?airport a dbo:Airport. ?...
2
votes
1answer
85 views

Wikipedia database: categories and category mapping across languages

I've imported the wikipedia database in four languages with the goal of running some machine learning algorithms on it for text classification. The import doesn't populate the "category" table though. ...
5
votes
1answer
127 views

Getting influences / influencedBy data from DBpedia

I am struggling with DBpedia. The description is unclear (to the point that for me it is hard to tell which data can be obtain, which - cannot), and (what is worst) it does not have many examples (...
23
votes
2answers
5k views

Get Wikipedia URLs (sitelinks) in Wikidata SPARQL query

I can use the following query to list all sovereign states via the Wikidata query interface: PREFIX wikibase: <http://wikiba.se/ontology#> PREFIX wd: <http://www.wikidata.org/entity/> ...
7
votes
4answers
4k views

Get season statistics for NFL players

So as the title suggests I'm trying to retrieve NFL stats for players. I've found that Wikipedia has a quite extensive statistics panel for a lot of players (i.e Tom Brady https://en.wikipedia.org/...
1
vote
1answer
72 views

How to use multiple wikipedia categories for Quick Intersection?

I'm using http://tools.wmflabs.org/quick-intersection/index.php to get a list of articles within categories but I have a list of over 35 categories and I'd like to use Quick Intersection to get the ...
14
votes
6answers
4k views

Mapping all Wikipedia URLs to Wikidata entity ids

Is there a Wikidata dump that maps all Wikipedia URLs to their corresponding Wikidata entity ids, e.g. the Wikipedia URL https://en.wikipedia.org/wiki/Tom_Hanks to the Wikidata entity id Q2263?
12
votes
4answers
1k views

How to get soccer players Wikipedia URL?

I'd like to grab as many soccer players names and their Wikipedia URL. For example: "David Beckham": 'David_Beckham', "Wayne Rooney": 'Wayne_Rooney' The first portion is their name and the second is ...
5
votes
3answers
531 views

How can I add Wikidata properties of item a on the Wikipedia page of item b?

How would I get the eccentricity (Property:P1096) of Venus (Q313) in the article en:Mars? I have figured out that I have to write {{#property:P1096}} if I want to get a property of the page on that ...
5
votes
1answer
221 views

"DBpedia as Tables" not having all the properties

I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables. ...
3
votes
1answer
82 views

Where should I host/contribute a mapping from Stack Overflow tags to Wikipedia articles?

I had asked for a mapping from Stack Overflow tags to Wikipedia articles over at meta.stackoverflow, but no one seemed to find one, so I started building my own. Where is the "right" place for me to ...
8
votes
1answer
4k views

Download Wikipedia articles from a specific category

I know that I can download English Wikipedia Dump, but I was wondering if I can download only articles for a specific category-subject. For instance, can I download articles related to Mathematics or ...
5
votes
1answer
87 views

Suspected dirty data in Wikipedia articles indirectly belonging to a category

I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia. I've tried using a tool called Quick intersection. ...
9
votes
3answers
530 views

How to get daily updates from Wikipedia?

I installed media-wiki on ec2 machine and loaded the Wikipedia page-articles dump content and other relevant data into that. I want to update the data regularly(daily) but I didn't get any resource ...
24
votes
10answers
8k views

Wikipedia table to JSON (or other machine-readable format)

I'm interested in the data listed in the tables listed here. Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?

 
https://opendata.stackexchange.com/questions/tagged/wikipedia
opendata.stackexchange.com
crawl=CC-MAIN-2022-05
250076
application/http; msgtype=response
sha1:3NWG4GTOERFBR4YWGDHWCFMBEERT2VW6
<urn:uuid:a361e9c6-3310-48dc-bcab-a835b69e282a>
2022-01-25T05:40:04Z
151.101.129.69
text/html
sha1:3F23I2HP77TQZOIK4C5TDQE4VYIJAPJY
<urn:uuid:067bc96e-c10a-49e9-92aa-c43b08b38a1b>
https://opendata.stackexchange.com/questions/tagged/wikipedia
response
<urn:uuid:ab307876-0ba5-48b4-93a9-6692c2c2dad2>
isPartOf: CC-MAIN-2022-05
publisher: Common Crawl
description: Wide crawl of the web for January 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-84
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/