Web Harvester

Share this on social media:

Web Harvester from OCLC is said to allow libraries and other cultural heritage institutions to capture and add web content to their digital collections that are managed by OCLC’s CONTENTdm Digital Collection Management Software.

This tool, which evolved from collaboration with several state libraries, state archives and universities over a period of seven years, addresses the need to store and provide access to otherwise highly transient information resources that solely exist on web sites.

The Web Harvester is integrated into library workflows, allowing library staff to capture content as part of the cataloging process. The captured content is then sent to the organisation's digital collections where it can be managed with other CONTENTdm digital content.

The tool is accessed via the Connexion client, OCLC's cataloging service. It captures content ranging from single, web-based documents to entire web sites. Harvested items are discoverable from WorldCat.org, WorldCat Local and the CONTENTdm Web interface. Master files of the captured content also can be ingested to the OCLC Digital Archive, the service for long-term storage of originals and master files from libraries' digital collections.

The Web Harvester is an optional product for current Hosting users of CONTENTdm to expand their ability to collect, manage and provide access to digital content.
https://www.researchinformation.info/product/web-harvester
www.researchinformation.info
crawl=CC-MAIN-2022-05
49711
application/http; msgtype=response
sha1:ZCPLLUUO3KBY5YYI6GPX47BVKOEODEPT
<urn:uuid:f206c27e-3e56-42f4-8197-56ebb347ab39>
2022-01-24T10:55:30Z
46.101.5.180
application/xhtml+xml
sha1:ECLJIKV3JRN4CUTGY4I4SVTMGFBVSCLE
<urn:uuid:547c9a7b-9288-4ce9-8874-79497d188979>
https://www.researchinformation.info/product/web-harvester
response
<urn:uuid:6115ffb0-7556-4b7f-bd38-567b5f3aa592>
isPartOf: CC-MAIN-2022-05
publisher: Common Crawl
description: Wide crawl of the web for January 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-243
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/