View Single Post
Old January 28, 2013, 10:53 AM   #6
Kimio
Senior Member
 
Join Date: January 2, 2011
Location: Utah
Posts: 882
Sam, that is some great information, and something I've been wondering about like the OP. I appreciate you taking the time to type all of that out.
Kimio is offline  
 
Page generated in 0.04792 seconds with 7 queries
http://thefiringline.com/forums/showpost.php?p=5389992&postcount=6
thefiringline.com
crawl=CC-MAIN-2014-35
13575
application/http; msgtype=response
sha1:6AAYQQ6L3IBLSWCEIN4FS5452P374K6U
<urn:uuid:7dba19e2-3ce8-468c-abd3-94b80fdf93b3>
2014-08-31T06:42:40Z
162.243.102.188
sha1:5E4E2CFR52SOMJVLAUDYPHAKFTNDI6YP
<urn:uuid:0200c285-816a-4fce-a938-9396f16d9f25>
http://thefiringline.com/forums/showpost.php?p=5389992&postcount=6
response
<urn:uuid:a2557789-d9a2-4b5c-91ef-033a66ff05e3>
robots: classic
hostname: ip-10-180-136-8.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-35
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for August 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf