This topic contains 0 replies, has 1 voice, and was last updated by  Dean Brooker 3 years, 8 months ago.

Viewing 1 post (of 1 total)
  • Author
    Posts
  • #2147

    Participant

    looks good

Viewing 1 post (of 1 total)

You must be logged in to reply to this topic.
https://mafc.ca/resources/forums/topic/web-site/
mafc.ca
crawl=CC-MAIN-2019-09
36759
application/http; msgtype=response
sha1:EQJQPQ3YI46RAVYTSXIINQ6T3K4HQVM2
<urn:uuid:18f89e4d-aa31-44fc-979d-784b645ec382>
2019-02-21T22:12:38Z
65.39.189.102
text/html
sha1:OPDV4VZHAALP6XBSWCTVBMG6UBYP6NBS
<urn:uuid:5d386fe7-b1ce-4b04-8bc3-dbab162ee168>
https://mafc.ca/resources/forums/topic/web-site/
response
<urn:uuid:b8c7bcb5-6f4e-457d-ab01-b8d45f5422e4>
isPartOf: CC-MAIN-2019-09
publisher: Common Crawl
description: Wide crawl of the web for February 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-168-29-43.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/