View Single Post
  #66  
Old 2012-08-09, 09:31
Pirkaf's Avatar
Pirkaf Pirkaf is offline
Regular
 
Join Date: Apr 2009
Posts: 74
Default

Quote:
Originally Posted by Sheeta View Post
Sorry this took so long. Here's the important announcement.

From now on, all updates will be on that blog.
Awesome news, wish you luck!
Reply With Quote
 
http://forums.novelnews.net/showpost.php?s=fa426feb8d08030ca58f1f7b02b812c9&p=70465&postcount=66
forums.novelnews.net
crawl=CC-MAIN-2018-39
14012
application/http; msgtype=response
sha1:P63SDD3JB62OZ5VLS32FFRGEVXGIQYGM
<urn:uuid:b57df9aa-fdd6-4809-8075-9d23ea331de9>
2018-09-26T14:21:27Z
206.124.132.97
application/xhtml+xml
sha1:OMUDDW6J2TSSJA7TM3TZHWIP4IBNHTJG
<urn:uuid:ed36c9d7-6419-4bcc-861c-42116406be09>
http://forums.novelnews.net/showpost.php?s=fa426feb8d08030ca58f1f7b02b812c9&p=70465&postcount=66
response
<urn:uuid:89ca9e94-1893-4053-82b4-97de0ce4ca13>
isPartOf: CC-MAIN-2018-39
publisher: Common Crawl
description: Wide crawl of the web for September 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-138-196-149.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/