edoc

A distributed archival network for process-oriented autonomic long-term digital preservation

Subotic, Ivan and Rosenthaler, Lukas and Schuldt, Heiko. (2013) A distributed archival network for process-oriented autonomic long-term digital preservation. In: Proceedings of the 13th ACM/IEEE joint conference on digital libraries (JCDL '13). New York, N.Y., pp. 29-38.

Full text not available from this repository.

Official URL: http://edoc.unibas.ch/dok/A6183928

Downloads: Statistics Overview

Abstract

The reliable and consistent long-term preservation of digital content and metadata is becoming increasingly important – even though the storage media used are potentially subject to failures, or the data formats may become obsolete over time. A common approach is to replicate data across several sites to increase their availability. Nevertheless, network, software, or hardware failures as well as the evolution of data formats have to be coped with in a timely and, ideally, an autonomous way, without intervention of an administrator. In this paper we present DISTARNET, a distributed, autonomous long-term digital preservation system. Essentially, DISTARNET exploits dedicated processes to ensure the integrity and consistency of data with a given replication degree. At the data level, DISTARNET  supports complex data objects, the management of collections, annotations, and arbitrary links between digital objects. At process level, dynamic replication management, consistency checking, and automated recovery of the archived digital objects is provided utilizing autonomic behavior governed by preservation policies without any centralized component. We present the concepts and implementation of the distributed DISTARNET preservation approach. Most importantly, we provide details of the qualitative and quantitative evaluation of the DISTARNET system. The former addresses the effectiveness of the internal preservation processes while the latter evaluates DISTARNET’s performance regarding the overall archiving storage capacity and scalability.
Faculties and Departments:04 Faculty of Humanities and Social Sciences > Fakultär assoziierte Institutionen > Digital Humanities Lab
05 Faculty of Science > Departement Mathematik und Informatik > Informatik > Datenbanken (Schuldt)
04 Faculty of Humanities and Social Sciences > Fakultär assoziierte Institutionen > Digital Humanities Lab > Imaging software/databases (Rosenthaler)
UniBasel Contributors:Schuldt, Heiko and Subotic, Ivan and Rosenthaler, Lukas
Item Type:Conference or Workshop Item, refereed
Conference or workshop item Subtype:Conference Paper
Bibsysno:Link to catalogue
Publisher:Association for Computing Machinery
Note:Publication type according to Uni Basel Research Database: Conference paper
Related URLs:
Identification Number:
Last Modified:25 Apr 2014 08:00
Deposited On:25 Apr 2014 08:00

Repository Staff Only: item control page
https://edoc.unibas.ch/32066/
edoc.unibas.ch
crawl=CC-MAIN-2020-40
20824
application/http; msgtype=response
sha1:SA6GP2IZE6VN4BU5MWAGUCJH4FN5UVNM
<urn:uuid:d592a722-ca93-42eb-a87a-55efbd90e41d>
2020-09-27T11:42:34Z
131.152.227.123
application/xhtml+xml
sha1:4Y62USZNZGFTX5RZC23CLR5GLFCGBC4J
<urn:uuid:c50a0218-ae2a-45a1-a678-b4edab970952>
https://edoc.unibas.ch/32066/
response
<urn:uuid:f5330f4f-9995-4c32-99fe-ce76b50af0b5>
isPartOf: CC-MAIN-2020-40
publisher: Common Crawl
description: Wide crawl of the web for September 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-127.ec2.internal
software: Apache Nutch 1.17 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/