 

You are here

Archiving a Historic Medico-legal Collection: Automation and Workflow Customization

Printer-friendly versionPrinter-friendly version
Misra D, Mao S, Rees J, Thoma GR
Proc IS&T Archiving 2007. Arlington, Virginia, May 2007; 157-61
Abstract: 

The U.S. National Library of Medicine (NLM) has acquired a historical collection of documents, released by the Food and Drug Administration, specifying the Notices of Judgment (NJs) against manufacturers of adulterated or misbranded food, drugs and cosmetics. These documents, consisting of 70,000+ pages containing more than 65,000 NJs, are to be preserved and made accessible over the long term due to their legal and historical value. We developed a preservation system, named SPER (System for Preservation of Electronic Resources), based on DSpace infrastructure, for archiving and disseminating NJs contained in these documents. For efficiency and cost-effectiveness, we developed algorithms to automatically identify the NJs and extract metadata from their contents, and then have an archivist review and edit the metadata, and ingest the NJs into the archive. Contents of the documents are also captured as text streams to provide full-text search capability for the NJs. These functionalities required a number of changes to the open source DSpace software, including changing the ingest interface and workflow, handling metadata schema that does not map to Dublin Core, and enhancing the database schema. This paper describes the overall SPER system, customized workflow for automated metadata extraction, the automated metadata extraction process, and an estimate of labor savings through automation.

Misra D, Mao S, Rees J, Thoma GR. Archiving a Historic Medico-legal Collection: Automation and Workflow Customization Proc IS&T Archiving 2007. Arlington, Virginia, May 2007; 157-61
https://lhncbc.nlm.nih.gov/publication/lhncbc-2007-021
lhncbc.nlm.nih.gov
crawl=CC-MAIN-2021-04
19279
application/http; msgtype=response
sha1:HWKMTQ2PUDD33JXIDYVSQE2MUC465GKQ
<urn:uuid:7ad91d9e-6c8e-425b-b519-f2e5e570d49a>
2021-01-17T20:15:11Z
13.32.181.111
text/html
sha1:RY2SLWUKK3QKJIPR6JZDW77JZYSO7QAK
<urn:uuid:cc84d4eb-0750-4e0e-8de9-b1fe39cc1aaa>
https://lhncbc.nlm.nih.gov/publication/lhncbc-2007-021
response
<urn:uuid:9c51d392-7257-4659-bc2c-2f2f302f346e>
isPartOf: CC-MAIN-2021-04
publisher: Common Crawl
description: Wide crawl of the web for January 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-52.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/