Comet: Sprint 16 (July 20, 2022 –August 2, 2022)

Comet Sprint 16 Review

What was the goal of Sprint 16?

  • Editing and adding descriptive and other user defined metadata for existing objects
  • Running workflow and event triggered work (characterization, access derivatives)
  • Assigning permanent identifiers (primarily interested in the short term in ARKs as canonical IDs)
  • Publishing that content to a public access platform (OAI, IIIF, Shoreline, current local systems).

What is the milestone that this sprint is supporting?
To support the full deposit lifecycle for an object

Accomplishments of Sprint 16:

  • Now generating metadata from the configuration; cardinality of the fields is configurable
  • Objects are assigned ARKs as a workflow step (approval); minted directly from EZID API. The ARK assignment is configurable based on the project
  • Batch upload validation: if a CSV has references to files that aren’t in the collection of files in the staging area, an error message appears so that the user can go back for remediation before the system creates objects from that batch
  • Collection nesting: subcollections now appear as members of a collection in the collections page; can add or remove

What’s next?
Showing the publishing process in three different ways:

  1. When a user deposits an object as a part of a collection, the user can push the entire collection to the OAI endpoint and make the set harvestable from OAI
  2. Having a IIIF Image Server (Cantaloupe) wired in to staging and production environments for each campus
  3. Workflow-driven “publish” to the Shoreline geodata platform

GitLab link: https://gitlab.com/surfliner/surfliner/-/milestones/86#tab-issues
https://surfliner.ucsd.edu/comet-sprint-16-july-6-2022-july-19-2022/
surfliner.ucsd.edu
crawl=CC-MAIN-2022-40
18583
application/http; msgtype=response
sha1:UZPXSB5V376V74PMGTBKO3ZQX2Z6FAWH
<urn:uuid:cdfb07f8-573c-4437-91f4-201c208bacee>
2022-10-02T06:08:42Z
132.239.119.52
text/html
sha1:VCR4K3P65AOEX364M3EF5XSL7MZ34XTY
<urn:uuid:4ca13ec5-09e8-42f3-9e56-9684f185f78f>
https://surfliner.ucsd.edu/comet-sprint-16-july-6-2022-july-19-2022/
response
<urn:uuid:9f9a8369-c758-4071-a3f6-eb8851539d06>
isPartOf: CC-MAIN-2022-40
publisher: Common Crawl
description: Wide crawl of the web for September/October 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-62
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.4-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/