View Single Post
Old July 29, 2013, 10:21 AM   #11
g.willikers
Senior Member
 
Join Date: September 28, 2008
Posts: 8,196
That's a whopping lot of work that you put into this.
And it's most interesting, as an addition to our general knowledge of the subject.
Can't ever know too much.
Thanks for sharing.
__________________
Lock the doors, they're coming in the windows.
g.willikers is offline  
 
Page generated in 0.07524 seconds with 7 queries
http://thefiringline.com/forums/showpost.php?p=5594529&postcount=11
thefiringline.com
crawl=CC-MAIN-2016-18
14473
application/http; msgtype=response
sha1:6YAMKDQXC2X52OEAGPAX5QHTI2ZMR5JS
<urn:uuid:ec6baf5b-a78b-44a3-b524-b2f42cf50b03>
2016-05-06T07:34:33Z
104.27.186.105
sha1:K262WP3S3LGZRLUTUHLAAEJB2ZDOSRZ7
<urn:uuid:dd9670f2-ccd2-4042-90b1-bd73c3d01213>
http://thefiringline.com/forums/showpost.php?p=5594529&postcount=11
length
response
<urn:uuid:72e2e1e4-85d7-43de-8b50-b21c3e646b47>
robots: classic
hostname: ip-10-239-7-51.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2016-18
operator: CommonCrawl Admin
description: Wide crawl of the web for April 2016
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf