  • Register

Any LTP "Packaging Format" Standard you Support that Makes More Sense than WARC?

0 votes
499 views

Here's my question: Do you prefer a packaging format other than WARC? What other justifications should I take into account? Could you share additional resources for my consideration ( in addition to those below?) And I'll elaborate:

We generally agree that digital permanent records should be kept in open and supported format (tools and communities). We even have a broad selection of formats to chose from (from TIFF/JPEG2000 through PDF/A to XML). What remains, in my view, is a similar broad agreement on the package format that house the above content and linked metadata. The target here is the format of the container, wrapper, or capsule. 

There are many requirements that this container should meet, and by far, I like that the container be extendable whereby one can add more content, additional metadata, user contributed context, etc. 

Sofar though, .zip container has more or less led the charge, though other formats such as .warc are emerging from studies and comparaisons and showing more promise, which prompts me to ask: 

Do you prefer a packaging format other than WARC? What other justifications should I take into account? Could you share additional resources I could consider in addition to these below?

Answers, links and comments will be well received!

asked Feb 13, 2015 by tibaut.houzanme (770 points)

Please log in or register to answer this question.

...
https://qanda.digipres.org/830/packaging-format-standard-support-makes-more-sense-than-warc
qanda.digipres.org
crawl=CC-MAIN-2021-21
21074
application/http; msgtype=response
sha1:ZAIIKWG74YPORO6G2JXGRUDOV6YRIQJM
<urn:uuid:10e14478-0047-4430-9337-6151ccfc33a7>
2021-05-06T22:16:46Z
172.104.134.96
text/html
sha1:YESFONE5WI24JPGQLW7FSN4BR33ZO6FH
<urn:uuid:9698b929-0541-4967-a729-3b74ef361a54>
https://qanda.digipres.org/830/packaging-format-standard-support-makes-more-sense-than-warc
response
<urn:uuid:28342729-888b-465c-8f60-7345a97958a4>
isPartOf: CC-MAIN-2021-21
publisher: Common Crawl
description: Wide crawl of the web for May 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-74.ec2.internal
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/