View Single Post
Old 09-25-2017   #13
frozenLake
 
frozenLake's Avatar
Default

Don't know if this is still being updated. If it is, I would love to see how it turns out, but it... has been a while since we have gotten any news of this.
frozenLake is offline   Reply With Quote
 
http://mb.srb2.org/showpost.php?s=5f4972cd062d844589950159fd118596&p=796050&postcount=13
mb.srb2.org
crawl=CC-MAIN-2019-13
15837
application/http; msgtype=response
sha1:GH4PXGVEBI4UPPIZ4AIUAMAURPNZHICV
<urn:uuid:be23c1af-b4ef-4f1d-9994-58394a2d01b4>
2019-03-22T00:37:41Z
104.28.23.6
application/xhtml+xml
sha1:D732VTR2DIRZJY4INKB6YPWQX3YD7JMC
<urn:uuid:33ebd7d8-b69d-42f3-a4a7-128d62d1e72b>
http://mb.srb2.org/showpost.php?s=5f4972cd062d844589950159fd118596&p=796050&postcount=13
response
<urn:uuid:fc3d789d-8418-4468-b47c-7562512f192b>
isPartOf: CC-MAIN-2019-13
publisher: Common Crawl
description: Wide crawl of the web for March 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-168-29-43.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/