Robin Good: Open Source Link Rot 44%

Knowledge
Robin Good
Robin Good

According to this PDF report from the Chesapeak Digital Preservation Group, 44% of links go rotten. (The Chesapeak group is comprised of four member libraries, the Georgetown Law and Harvard Law School Libraries, and the State Law Libraries of Maryland and Virginia.)

The study highlights not only how bad and real the issue is, but how rapidly it is worsening. Here a few newsworthy highlights:

a) Link rot has increased from 8.3 to 44.3% in six years.

b) In 2013 government originated documents showed the largest percentage of linkrot.

c) More than 50 percent of the materials posted to government domains disappeared from the original documented web addresses.

N.B.: There is a high value in preserving non-trivial content in ways that allow reliable access for indefinite time at a permanent online address. (In theory search engines could provide this as an additional (and optionally paid) service to final users who request it, as this is part of what they already do by default.

Informative. 8/10

44% of Links Go Lost: To Preserve Valuable Content Online Will Become a Prime Need

Full original PDF report (8 Pages)
https://phibetaiota.net/2013/12/robin-good-open-source-link-rot-44/
phibetaiota.net
crawl=CC-MAIN-2019-39
218380
application/http; msgtype=response
sha1:AY3ECNCGK4PDZCJAXW6SUI6W4DHJ445N
<urn:uuid:35270986-1a1a-44d4-abdf-e871ed1c2b2b>
2019-09-21T18:15:36Z
188.166.164.209
text/html
sha1:LWFLETBINS34OK6QW5MDJRUZMBRFJ4ND
<urn:uuid:205df432-4f80-4a29-8c82-3c285856074a>
https://phibetaiota.net/2013/12/robin-good-open-source-link-rot-44/
response
<urn:uuid:c865562e-fa72-40c0-8e8e-2de2116e86bc>
isPartOf: CC-MAIN-2019-39
publisher: Common Crawl
description: Wide crawl of the web for September 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-65.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/