 

Simplify & Scale: Building a Python-based Bulk Upload Tool for D-Space

Date

2024-05-22

Authors

Wardlow, Bruce
Diepen, Patrick

Journal Title

Journal ISSN

Volume Title

Publisher

Texas Digital Library

Abstract

Over the past year at the Cornette Library at WTAMU, we've developed a bespoke Simple Archive Format (SAF) compiler using Python to streamline the bulk upload process of University newspaper scans into our institutional D-Space repository. Join us in this presentation as we delve into the fundamentals of SAF, explore the genesis of our original script, and discuss its evolution with the integration of a graphical user interface (GUI) and error handling functionalities. As we fine-tune this tool to suit our requirements, we're keen to explore its potential expansion to cater to other institutions' needs, transforming it into a comprehensive SAF compiler. During this interactive idea lab session, we'll engage in a dialogue about the desired features of such a program and whether adaptability to various institutional contexts outweighs the convenience of a one-size-fits-most solution.

Description

TCDL 2024 Session 5B, Wednesday, 5/22/2024, 2:00 pm to 3:15 pm | Moderated by Phebe Raglin, Texas A&M University - Corpus Christi | Idea lab | Software Development

Citation
https://tdl-ir.tdl.org/items/3e558dfc-05b1-49c9-b38b-a42b753835a1
tdl-ir.tdl.org
CC-MAIN-2024-26
472508
application/http; msgtype=response
sha1:XJQ2Z6EAQ4KYGMIT4MSUSRWHY6ZPHKY7
<urn:uuid:58253d8d-35f0-45bd-9679-58ca48de0f23>
2024-06-13T06:08:59Z
34.205.219.63
text/html
sha1:OUYGIAMTH37JPQVZLXJW7KBGHQ5M6363
<urn:uuid:b3d62999-1a61-415e-ad6c-99aa4e3b937c>
https://tdl-ir.tdl.org/items/3e558dfc-05b1-49c9-b38b-a42b753835a1
response
<urn:uuid:afb2ef56-2502-42c4-856e-f3e920efc3b8>
isPartOf: CC-MAIN-2024-26
publisher: Common Crawl
description: Wide crawl of the web for June 2024
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-37
software: Apache Nutch 1.20 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.5-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/