View Single Post
  #3  
Old 24th October 2012, 15:41
cbj4074 cbj4074 is offline
Senior Member
 
Join Date: Nov 2010
Posts: 395
Thanks: 30
Thanked 58 Times in 50 Posts
Default

Thanks, Till. Very nice; I was unaware of the fact that CSRs do not expire. I learn something new every day around here.
Reply With Quote
 
http://www.howtoforge.com/forums/showpost.php?p=287242&postcount=3
www.howtoforge.com
crawl=CC-MAIN-2014-52
16581
application/http; msgtype=response
sha1:EKJTXFM3TWZPFDRZDTPU4CGCASVOH444
<urn:uuid:3011b8cb-3fe8-4f9d-be94-b6cb39d6fcbf>
2014-12-26T05:13:27Z
188.40.16.205
sha1:4EADXYOGSJLNW6ORSW6NO3S4W5B6MGQS
<urn:uuid:0049d512-64a3-49e3-8689-b82deadf0d24>
http://www.howtoforge.com/forums/showpost.php?p=287242&postcount=3
response
<urn:uuid:5b69e00b-aeac-4ce2-991a-53ad3957e881>
robots: classic
hostname: ip-10-231-17-201.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-52
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for December 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf