
Go Back   Wolfdog.org forum

vBulletin Message
There are no threads newer than the previous one. Click the back button in your browser to return to it.

Forum Jump


All times are GMT +2. The time now is 15:02.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.
(c) Wolfdog.org
https://www.wolfdog.org/forum/showthread.php?s=379fd26565586ea5e0a841c38f58f343&t=24968&goto=nextnewest
www.wolfdog.org
crawl=CC-MAIN-2021-21
30535
application/http; msgtype=response
sha1:CSYCO7ZHQJ5F6D7GV3I2I5X375JBJMSP
<urn:uuid:2d74a5ef-c8a6-4fb0-b361-aa5c69f89562>
2021-05-17T13:02:16Z
172.67.133.118
application/xhtml+xml
sha1:7BPLQU5DQEBWA3NFUW3OVJJMESOSQLJG
<urn:uuid:2a1abd27-8251-4477-9845-d5c0e5e583b2>
https://www.wolfdog.org/forum/showthread.php?s=379fd26565586ea5e0a841c38f58f343&t=24968&goto=nextnewest
response
<urn:uuid:be5da0be-4177-4443-963e-f7cd918b53ca>
isPartOf: CC-MAIN-2021-21
publisher: Common Crawl
description: Wide crawl of the web for May 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-25.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/