Child pages
  • Ingest
Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 16 Next »

Ingest

Name:

Ingest

Version:

0.7 (2010-06-09)

Status:

Alpha

Specification:

Merritt Ingest Service

Download:

Not available

More information:

Curation home page

The Ingest micro-service provides a means to add new digital content into the curation environment for active management by the Program. Using terms defined by the Open Archival Information System (OAIS) reference model, the Ingest service accepts Submission Information Packages (SIPs) and converts them into Archival Information Packages (AIPs). This process may involve the use of other micro-services: the Transformation service to transcode objects into normative forms defined by internal standards; the Characterization service to produce relevant descriptive information for management in the Inventory service; and the Storage service to manage object files.

The Ingest micro-service defines the following conceptual entities:

  • Batch. A set of jobs.
  • Job. The processing of a single digital object.
  • Profile. An indication of the type of digital object being ingested.
  • Handler. A specific ingest sub-task.
  • Notification. The final status resulting from an ingest.
  • No labels
https://confluence.ucop.edu/pages/viewpage.action?pageId=36438061
confluence.ucop.edu
crawl=CC-MAIN-2020-45
46073
application/http; msgtype=response
sha1:N4HEERZE26DZF5KD6D42ZIVUWGVJF6LM
<urn:uuid:34fb5583-458f-47ae-8e56-e6ecc1039b24>
2020-10-21T02:19:31Z
128.48.70.55
text/html
sha1:W5SD4YVQSUXKI62MC5DJ7JLTB6YWQ6GE
<urn:uuid:a50d9d75-bc88-4185-8fdc-3bf647c5315f>
https://confluence.ucop.edu/pages/viewpage.action?pageId=36438061
response
<urn:uuid:dcaac64e-7ebb-4ab5-8124-b21acee04c4b>
isPartOf: CC-MAIN-2020-45
publisher: Common Crawl
description: Wide crawl of the web for October 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-18.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/