
Go Back   Wolfdog.org forum

vBulletin Message
There are no threads newer than the previous one. Click the back button in your browser to return to it.

Forum Jump


All times are GMT +2. The time now is 10:29.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
(c) Wolfdog.org
http://wolfdog.org/forum/showthread.php?s=7f23f85ff980c9885f5d8e1bd086e3fd&t=25753&goto=nextnewest
wolfdog.org
crawl=CC-MAIN-2020-05
32664
application/http; msgtype=response
sha1:5OESTGUGNJ4GBWQKMMWGUJTRG26MPRBG
<urn:uuid:33b34350-63e9-4a90-ba27-c87c8b5f88d9>
2020-01-19T08:29:19Z
104.27.160.119
application/xhtml+xml
sha1:NIJ5N2BNCJTLIN4YWELZ6VVKNMKNWYHT
<urn:uuid:703cf986-2dd8-48b4-9856-677cd8dbcae3>
http://wolfdog.org/forum/showthread.php?s=7f23f85ff980c9885f5d8e1bd086e3fd&t=25753&goto=nextnewest
response
<urn:uuid:1e499460-58a6-4f21-9dd2-b4d5be3456a6>
isPartOf: CC-MAIN-2020-05
publisher: Common Crawl
description: Wide crawl of the web for January 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-30.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/