Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • HTRC algorithms and HTRC Data Capsules have the capability are capable of analyzing the entire HathiTrust corpus, and additionally make use of each volume’s MARC bibliographic and METS metadata. Both the HTRC algorithms and Capsule-environments draw from the HTRC Data API described below.

  • The HTRC makes available also two datasets, the HTRC Extracted Features Dataset and a dataset of Word Frequencies in English Language Literature, 1700-1922. HTRC Extracted Features includes metadata and extracted page-level data (words and word counts) for 1315.7 million volumes.

  • HathiTrust+Bookworm visualizes data for 15.7 million volumes.

...
https://wiki.htrc.illinois.edu/pages/diffpagesbyversion.action?pageId=55771150&selectedPageVersions=12&selectedPageVersions=13
wiki.htrc.illinois.edu
crawl=CC-MAIN-2021-25
51908
application/http; msgtype=response
sha1:ML5DXA7BO33AGK5Q7ZUL5U26ZIGHIV5B
<urn:uuid:16b0c748-22c5-4e7c-b98a-c707ecf80e81>
2021-06-21T10:47:55Z
128.174.94.214
text/html
sha1:2AE2DPPBSZS4QTXHZ53KFU4W4UCVBFVT
<urn:uuid:076f4d0a-886a-461d-8af7-216bdc8f3962>
https://wiki.htrc.illinois.edu/pages/diffpagesbyversion.action?pageId=55771150&selectedPageVersions=12&selectedPageVersions=13
response
<urn:uuid:fb7f353e-3e16-4975-b87e-7cb3826900c3>
isPartOf: CC-MAIN-2021-25
publisher: Common Crawl
description: Wide crawl of the web for June 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-123.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/