View Single Post
  #7   (View Single Post)  
Old 18th January 2017
LeFrettchen's Avatar
LeFrettchen LeFrettchen is offline
Marveled user
 
Join Date: Aug 2012
Location: France
Posts: 286
Default

OK, thanks for the sharing
__________________
The secret of wisdom is not wisdom itself, it's the road that leads us there.
Reply With Quote
 
http://daemonforums.org/showpost.php?s=4939a5d3a28908fe7db0b022b98fc7c4&p=60603&postcount=7
daemonforums.org
crawl=CC-MAIN-2018-22
13275
application/http; msgtype=response
sha1:2HVDANV5YBIEEC3YNQEWS2EZ3ZRZIEZO
<urn:uuid:9aa506c7-4b8f-4daa-bb89-817f084c256f>
2018-05-21T05:18:51Z
95.170.82.241
application/xhtml+xml
sha1:HV43M4LE4Q65SXEWAOX3KQGMF2YYB27D
<urn:uuid:27732f81-d20b-4bc5-892a-6595700ec62d>
http://daemonforums.org/showpost.php?s=4939a5d3a28908fe7db0b022b98fc7c4&p=60603&postcount=7
length
response
<urn:uuid:9211aa6c-d83e-4b16-8ff3-2a470385c171>
robots: classic
hostname: ip-10-228-146-143.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2018-22
operator: Common Crawl Admin
description: Wide crawl of the web for May 2018
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf