Tag: document dump

by Jonathan Stray

The Overview project is an attempt to create a general-purpose document set exploration system for journalists. But that’s a pretty vague description. To focus the project, it’s important to have a set of test cases — real-world problems that we can use to evaluate our developing system. In many ways, the test cases define the […] more »
http://mediashift.org/idealab/tag/document-dump
mediashift.org
crawl=CC-MAIN-2015-32
15501
application/http; msgtype=response
sha1:HI2L6HXUNBXCLLSD2J2AE6NRG3CEMQW4
<urn:uuid:3beb4692-7197-4c89-85be-e09801612304>
2015-07-30T10:24:42Z
192.241.218.35
sha1:YT6AF2FGKEHIXW6XO64646HCDPNN7I5P
<urn:uuid:f9797590-8daa-4bc7-9932-d2729f409ecd>
http://mediashift.org/idealab/tag/document-dump
response
<urn:uuid:07e93ec7-b0f8-4205-9530-fe9268c41a38>
robots: classic
hostname: ip-10-236-191-2.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2015-32
operator: CommonCrawl Admin
description: Wide crawl of the web for August 2015
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf