Wikipedia word frequency

Mar 28, 2017

Download a file that contains each word (with a length > 2) and its frequencies extract from the Wikipedia corpus in descending order. The format of the file is

(<freq>,<word>)

Download https://1drv.ms/u/s!AvhnLreYwL-PgZMAiJKGr9CNvtrkhg

here is an excerpt of the first 10 entries

(134754521,the)
(54428880,and)
(23193612,was)
(15908522,for)
(13531284,with)
(10813887,that)
(9944531,from)
(9452065,his)
(6237633,were)
(5892049,are)
https://deniz.dizman.org/wikipedia-word-frequency/
deniz.dizman.org
crawl=CC-MAIN-2020-40
4115
application/http; msgtype=response
sha1:HFMKUBV2N5LLOSNDZ5WC53YGC3KRZVEN
<urn:uuid:392832d6-020a-44cf-9b83-cc4e6cd49118>
2020-09-22T03:32:47Z
95.168.175.54
text/html
sha1:7S43NVM2SNKOA6NP4XM6RKIRVV45ECQP
<urn:uuid:375b94a4-7e61-4bd5-af0f-70f00698d6dc>
https://deniz.dizman.org/wikipedia-word-frequency/
response
<urn:uuid:e1d3891a-4fbc-4060-afaf-cbe4ed362980>
isPartOf: CC-MAIN-2020-40
publisher: Common Crawl
description: Wide crawl of the web for September 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-59.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/