View Single Post
Old February 19, 2013, 11:57 PM   #55
DaleA
Senior Member
 
Join Date: September 12, 2002
Location: Twin Cities, MN
Posts: 1,155
Thanks Pax!

I did not realize the in's and out's. Your info is a real eye opener for me and something I admit I should check out rather than sit here with my head in the sand and my fingers crossed.
DaleA is offline  
 
Page generated in 0.03840 seconds with 7 queries
http://thefiringline.com/forums/showpost.php?p=5423983&postcount=55
thefiringline.com
crawl=CC-MAIN-2013-48
14085
application/http; msgtype=response
sha1:4FIU4PPE5ESML7OHWDCNPJXX4F74AGHO
<urn:uuid:5705f70b-f9ad-482c-882b-abc7035655de>
2013-12-12T08:02:18Z
162.243.102.188
sha1:ZODUUQKDQ3DHSQ2K6LVEYCJ3GOT6RWZH
<urn:uuid:ae90fa08-65b8-4c72-88d9-f77415dd3d02>
http://thefiringline.com/forums/showpost.php?p=5423983&postcount=55
response
<urn:uuid:7aaea1b8-893c-4733-94f4-b435e9aa62c6>
robots: classic
hostname: ip-10-33-133-15.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2013-48
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for Winter 2013
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf