View Single Post
Old 18-10-2011, 13:30
jonmorris
Forum Member
 
Join Date: Jul 2002
Location: a land filled with trolls
Posts: 7,393
Perhaps. If it goes out after 9, then can edit a lot of the good stuff back in!
jonmorris is offline Follow this poster on Twitter   Reply With Quote
 
http://forums.digitalspy.co.uk/showpost.php?p=53700910&postcount=27
forums.digitalspy.co.uk
crawl=CC-MAIN-2015-14
11928
application/http; msgtype=response
sha1:N7THFFCZ42XY7GW7RISZ3RLWJ5GKUUVS
<urn:uuid:a02b1244-fa18-4a58-9a06-65847fa2252b>
2015-03-30T07:13:22Z
54.229.78.109
sha1:4XVWCEFL3WN2GMHO55D5ABJRCJPXEADU
<urn:uuid:f0bd287e-7268-4401-8932-6ddfbc8ef241>
http://forums.digitalspy.co.uk/showpost.php?p=53700910&postcount=27
length
response
<urn:uuid:1bf51605-4a44-4bbf-8b3f-89d23bb32ac1>
robots: classic
hostname: ip-10-168-14-71.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2015-14
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for March 2015
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf