Follow

@garbados It sufficiently doesn't-suck that I saved the link for later reference, when any of my projects reaches the point of being worth other people wanting to deploy ^.^

Sign in to participate in the conversation
Toot.Cat

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!
https://toot.cat/@woozle/1390496
toot.cat
crawl=CC-MAIN-2020-05
20009
application/http; msgtype=response
sha1:BKPVH6UNP2IX7WZRU6P74EI3FTL4VIDK
<urn:uuid:6ca99f15-8192-4c42-bf07-b8e9de4088cf>
2020-01-27T08:40:15Z
138.68.60.118
text/html
sha1:PPKQHHJX5XHNF7HUV6QZMLBQIZFGZKBU
<urn:uuid:64ca7243-107c-4c18-b7f6-32dcde4a36fa>
https://toot.cat/@woozle/1390496
response
<urn:uuid:42169118-a502-4e1d-9325-4b987584da20>
isPartOf: CC-MAIN-2020-05
publisher: Common Crawl
description: Wide crawl of the web for January 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-204.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/