View Single Post
Old 02/28/18, 05:05 PM   #4
MattEmily
Administrator
 
MattEmily's Avatar
 
Join Date: 01/13/11
Posts: 5,655
Send a message via AIM to MattEmily Send a message via Yahoo to MattEmily
Default Re: Something bothering me.

technically we have a thread for this already let me find it and I'll merge the threads.
MattEmily is offline   Reply With Quote
 
http://pro-board.org/showpost.php?s=35ce64db94daeff0db797fc482beb9ac&p=75164&postcount=4
pro-board.org
crawl=CC-MAIN-2018-51
13457
application/http; msgtype=response
sha1:WNEWGVCN5JPYTZME675M5HYXKV5CMAHG
<urn:uuid:7ebaa15e-0bb8-42de-a455-19dadf6d79bc>
2018-12-14T07:10:46Z
198.20.90.194
application/xhtml+xml
sha1:2PXJHFQOGTQ7ZCIQIWP5UD2JSCYYCTUE
<urn:uuid:f2420893-12f3-42ef-a56e-21d6d8113162>
http://pro-board.org/showpost.php?s=35ce64db94daeff0db797fc482beb9ac&p=75164&postcount=4
response
<urn:uuid:9b7449e5-f2a9-4a25-b83a-4fd0ae6e75fc>
isPartOf: CC-MAIN-2018-51
publisher: Common Crawl
description: Wide crawl of the web for December 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-145-10-101.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/