Motherboard: Motherboard Made a Tool That Archives Websites on Demand

Motherboard: Motherboard Made a Tool That Archives Websites on Demand. “Archiving services, such as the Wayback Machine, may be a staple of online journalism, but they sometimes have a problem. While, say, Archive.is might preserve one particular webpage, perhaps the Wayback Machine can’t, depending on what sort of restrictions the website developer has put in place. For example, someone stopped copies of MSNBC host Joy Reid’s blog, which hosted a stream of homophobic comments, from displaying in the Wayback Machine. With that in mind, I made a quick tool that can push a single webpage or URL to multiple archiving sites at once, and fire back the newly minted digital copies in response. Hopefully it will help reporters and researchers more efficiently figure out which service will work best for that particular site.”

Why we need multiple web archives: the case of blog. reidreport. com (Web Science and Digital Research Group)

Web Science and Digital Research Group: Why we need multiple web archives: the case of blog.reidreport.com. “This story started in December, 2017 with Joy-Ann Reid (of MSNBC) apologizing for ‘insensitive LGBT blog posts’ that she wrote on her blog many years ago when she was a morning radio talk show host in Florida. This apology was, at least in some quarters, (begrudgingly) accepted. Today’s update was news that Reid and her lawyers had in December claimed that either her blog, and/or the Internet Archive’s record of the blog had been hacked (Mediaite, The Intercept).” A deep dive into the technical aspects of a very distasteful situation.
https://rbfirehose.com/tag/joy-reid/
rbfirehose.com
CC-MAIN-2023-23
86195
application/http; msgtype=response
sha1:IUEAK7IVHNXXI5TTFCQWEIBUKKQZKYJX
<urn:uuid:56d5f4aa-6e49-4229-af6d-7b5ae999a602>
2023-05-31T10:30:53Z
192.0.78.232
text/html
sha1:HM6ALKYUIRTDOCMR22W2ASRD7DUK22K4
<urn:uuid:c3c936b0-f9dd-4f12-bcdc-72a1432ceac7>
https://rbfirehose.com/tag/joy-reid/
response
<urn:uuid:c0b23fe5-6e11-47f9-9d07-96d5eade61ab>
isPartOf: CC-MAIN-2023-23
publisher: Common Crawl
description: Wide crawl of the web for May/June 2023
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-188
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.4-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/