View Single Post
  #124  
Old 10-08-2012, 08:22 PM
Noneck Noneck is offline
The Blind Squirrel that finally found an acorn.
 
Join Date: May 2007
Location: Nw Side
Posts: 10,370
Default

Quote:
Originally Posted by doogiec View Post
While I suspect the same problem would occur nowadays, it may not be as bad.
There is only one way to find out.
Reply With Quote
 
http://www.whitesoxinteractive.com/vbulletin/showpost.php?p=3000183&postcount=124
www.whitesoxinteractive.com
crawl=CC-MAIN-2017-43
7467
application/http; msgtype=response
sha1:CFNDWE3VUR4BNNKZICJE2BPGK4DC4JPD
<urn:uuid:3bb27f47-6557-4aef-95d4-216a55a34e73>
2017-10-22T19:17:38Z
74.50.124.222
application/xhtml+xml
sha1:2ZREVLCASVURMN2KCLHF5U7JTOPBDARV
<urn:uuid:69c05069-080f-4436-bc39-af7e6085001d>
http://www.whitesoxinteractive.com/vbulletin/showpost.php?p=3000183&postcount=124
response
<urn:uuid:d660b2b4-365c-4b59-a849-b81983641ea8>
robots: classic
hostname: ip-10-148-22-106.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-43
operator: Common Crawl Admin
description: Wide crawl of the web for October 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf