Skip to Main Content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Selector's Toolkit: Help

resources for collection analysis

Questions + Troubleshooting

Suffix to addresses below is @mit.edu.
https://libguides.mit.edu/c.php?g=176256&p=1160623
libguides.mit.edu
crawl=CC-MAIN-2021-39
31551
application/http; msgtype=response
sha1:FJHU4AQHRY56G4CLNI7YKH3VPU5WEQZP
<urn:uuid:aceec775-2115-42d4-8882-8cb5025cbf17>
2021-09-22T08:42:29Z
34.194.39.199
text/html
sha1:H4NWY6T5NFLODCMBPKL4LSMAC7UIARAO
<urn:uuid:6d5efb07-5dbd-463b-a5f8-7226a8e634f6>
https://libguides.mit.edu/c.php?g=176256&p=1160623
response
<urn:uuid:09d27ae5-7c34-4f70-8e7f-38ec783cf07e>
isPartOf: CC-MAIN-2021-39
publisher: Common Crawl
description: Wide crawl of the web for September 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-248
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/