View Single Post
Old 03-14-2004, 06:08 PM   #5
Skinkie
Definately, Maybe
 
Skinkie's Avatar
 
Status: Moderator
Join Date: Dec 2001
Location: Eh, Wherever
Posts: 2,449
10 year veteran! Forum Veteran 
Getting the companies to go along with this plan will be hard, but sounds like a good idea to me.


Just because people think what I say don't make sense, doesn't mean I don't like popsicles.
Skinkie is offline   you may: quote & reply,
 
http://www.lucasforums.com/showpost.php?p=1475267&postcount=5
www.lucasforums.com
crawl=CC-MAIN-2014-35
15171
application/http; msgtype=response
sha1:CNKKWIUSLCYY7IPF6VJCECDQ45NY4WGO
<urn:uuid:43d02e3b-0dfb-4b06-af28-8a98d0939b7d>
2014-08-20T21:45:13Z
76.73.74.242
sha1:HZ26JBM6BRWAU4NYL5PFKW3VPSGKHNXO
<urn:uuid:90551a7b-4a28-4685-9143-ae2f869a1e4f>
http://www.lucasforums.com/showpost.php?p=1475267&postcount=5
response
<urn:uuid:ea1e1d77-ce33-4cf3-a417-85841ea96be1>
robots: classic
hostname: ip-10-180-136-8.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-35
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for August 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf