GSoC/GCI Archive
Google Summer of Code 2011 Wikimedia Foundation

Working Archival for Web Ciations

by nn123654 for Wikimedia Foundation

Web Citations are currently the most popular form of citation on the Wikipedia project for inline references. They have the common of "dieing" when the URLs either change or the servers that they are hosted on go down. Given the nature of wikipedia and the need for verifiability this creates a significant content problem when sources that are used in articles are no longer available.
https://google-melange.com/archive/gsoc/2011/orgs/wikimedia/projects/nn123654.html
google-melange.com
crawl=CC-MAIN-2021-43
5744
application/http; msgtype=response
sha1:VUCVL7KES4WJQ4D7CLYWCRFHTBVQPK6A
<urn:uuid:080b05dd-e017-4c58-86a3-d1e75ac9df44>
2021-10-20T17:24:12Z
216.239.34.21
text/html
sha1:6UTVFNH3PG7ZQ4F4DHZCCD2CBPBDTZB7
<urn:uuid:bc880803-0d76-4a4d-9b5e-10ed7f7a83ab>
https://google-melange.com/archive/gsoc/2011/orgs/wikimedia/projects/nn123654.html
response
<urn:uuid:64616875-30df-436d-9152-f702a705980b>
isPartOf: CC-MAIN-2021-43
publisher: Common Crawl
description: Wide crawl of the web for October 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-190
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/