Wikia

Community Central

Help:Database download

120,808pages on
this wiki
Talk5

All Wikia text is available for easy download. Please see the relevant license for the terms under which this content may be used. Typically, Wikia sites are available under a Creative Commons License (see Wikia Licensing) but this can vary for each wikia.

Each wikia's content database is available as an XML dump. This does not include private user data or images.

Downloading a database dumpEdit

DatabaseDownload

The database download section on Special:Statistics

To access the download, go to the Special:Statistics page for the wikia. For example, for the Muppet Wiki you would go to http://muppet.wikia.com/wiki/Special:Statistics

There are two download options:

  • Current pages: This contains only the current version of pages which can be useful for bot use
  • Current pages and history: This contains the full page history of each page on the wikia so it can be a very large file if downloaded from a wikia with a large number of pages and many edits such as WoWWiki or Wookieepedia.

To download one of these, click the date link next to the option you would like. This should automatically trigger your browser to begin downloading the XML file in the .7z file format. This is a compressed file - you'll need to use a tool like 7-Zip to unzip it.

Requesting a new dumpEdit

If the latest dump isn't sufficient, or there is no database dump available, you can request one by clicking the "Request a database dump" button. This will file a request to have the public XML dump updated. These requests are processed during off peak hours and are usually cleared out weekly. Once the request is processed, the date of the download links will update. A new request can be performed once per week. You can also request a new database dump via Special:Contact.

Further Help and FeedbackEdit

Around Wikia's network

Random Wiki
http://community.wikia.com/wiki/Help%3ADatabase_download
community.wikia.com
crawl=CC-MAIN-2016-18
60983
application/http; msgtype=response
sha1:HUC2EBEUCKPFWONDBOQWYON4XPK3IBSI
<urn:uuid:78adce87-6027-4a3c-91de-5717057a061a>
2016-05-05T10:29:31Z
104.156.81.194
sha1:GPKPATWRWS34IU6RABJ7UX5R44NWJJLL
<urn:uuid:42619db4-95f4-4055-ba85-6d12d41c0771>
http://community.wikia.com/wiki/Help%3ADatabase_download
response
<urn:uuid:76ba1726-ab42-4fbf-b372-1c2f1cae7586>
robots: classic
hostname: ip-10-239-7-51.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2016-18
operator: CommonCrawl Admin
description: Wide crawl of the web for April 2016
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf