User Tools

Site Tools


data-magmt

Edit the page and hit Save. See syntax for Wiki syntax. Please edit the page only if you can improve it. If you want to test some things, learn to make your first steps on the playground.

G T H﻿ N Z
Note: By editing this page you agree to license your content under the following license: CC Attribution-Share Alike 4.0 International
data-magmt.txt · Last modified: 2018/01/15 06:16 by admin
http://linuxexpert.org/dw/doku.php?id=data-magmt&do=edit
linuxexpert.org
crawl=CC-MAIN-2019-35
21722
application/http; msgtype=response
sha1:3EGHUKHYAVEETNGYEHU3ZPR2WQMSXLPU
<urn:uuid:a6496223-bbec-4113-a04d-7a277215e74d>
2019-08-21T20:04:24Z
159.100.190.194
text/html
sha1:VXZCQNANDA4CT6SWTYXN5QOGIZPYPYJ6
<urn:uuid:baf92e9e-c3f8-427b-bf54-0cd5a5adf711>
http://linuxexpert.org/dw/doku.php?id=data-magmt&do=edit
response
<urn:uuid:058413c5-16ef-4c68-884b-a2d6414d9a95>
isPartOf: CC-MAIN-2019-35
publisher: Common Crawl
description: Wide crawl of the web for August 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-36.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/