
Narkive collects, archives and processes public data to provide easily accessible knowledge to it's users in the form of threads. The organization of this content is a completely automatic process with no human intervention. This model allows us to archive and provide the world with, at the time this webpage was generated, 963,393,342 messages in 297,113,847 threads.

History

Narkive was started in late 2009 by then 17-year-old me (Davide Cavion) and has since then always been a one man operation.

Infrastructure

The server infrastructure behind Narkive is redundant and distributed, to provide the users with the fastest access times and best service availability. This infrastructure is able to sustain non cached peak request rates of 500 pages per second at an average generation time of around 100ms per page. Even if never at full capacity, this allows to keep the costs down by owning the servers and not having to relay on expensive cloud computing. Stack Overflow operates under similar concepts, just on a much larger scale.

Content Sources

The two main content sources for our messages are usenet newsgroups and mailing lists, with the first one being the most popular. Mailing lists, or discussion lists, were recently introduced and are still being worked on. If you would like to have your newsgroup or mailing list archived here, or you have your own archive you would like to import, I would be happy to help you. A NNTP read only peering server is also in the work.
Loading...
https://narkive.com/about
narkive.com
crawl=CC-MAIN-2019-26
6912
application/http; msgtype=response
sha1:F3FDVNKMFS47H7Y4ZNMU54XP5ORAS3UG
<urn:uuid:034e0a40-0d46-425a-9e9f-93f8f1eb3076>
2019-06-17T13:56:24Z
23.227.197.75
text/html
sha1:QSX2A65C5QY7BPHUOJDQZ4LC2G7MN6QO
<urn:uuid:16930e50-c096-4a81-a5cd-25abefdb1679>
https://narkive.com/about
response
<urn:uuid:09008126-c39b-4c86-bfcc-38e361948473>
isPartOf: CC-MAIN-2019-26
publisher: Common Crawl
description: Wide crawl of the web for June 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-158-222-202.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/