Old Revisions

These are the older revisons of the current document. To revert to an old revision, select it from below, click Edit this page and save it.

blog/naked_bots_huh.txt · Last modified: 2010/02/07 02:10 by eves
chimeric.de = chi`s home Creative Commons License Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0
http://www.pikkubot.de/dokuwiki/doku.php?id=blog:naked_bots_huh&do=revisions
www.pikkubot.de
crawl=CC-MAIN-2021-31
13113
application/http; msgtype=response
sha1:MHCGFCZCOXKTWLYWN3SKBZCY463PDUD4
<urn:uuid:968b5b56-d7c7-4e7d-82c2-702f0c7a1bfe>
2021-08-05T19:58:07Z
213.109.162.85
application/xhtml+xml
sha1:TAMDMWSTFBHZABGXBM2C5DWQ23CYS2UQ
<urn:uuid:9a081793-99bc-42fc-9f5f-44d35609db82>
http://www.pikkubot.de/dokuwiki/doku.php?id=blog:naked_bots_huh&do=revisions
response
<urn:uuid:b2129961-055c-471e-8d47-e1e8002e42dd>
isPartOf: CC-MAIN-2021-31
publisher: Common Crawl
description: Wide crawl of the web for July/August 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-198.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/