﻿ British Library plans to archive whole UK Web | ZDNet

British Library plans to archive whole UK Web

British Library plans to archive whole UK Web

Summary: The British Library is starting the first phase of a project that may eventually lead to it archiving all UK Web sites

SHARE:
TOPICS: Networking
3
A trial project to archive 6,000 UK Web sites was announced on Tuesday by the UK Web Archiving Consortium. The consortium, led by the British Library, includes the Wellcome Trust, the National Archives and the Scottish and Welsh national libraries.

Each member of the consortium will choose content relevant to its subject. All types of Web content will be included, from government documents to blogs.

Richard Boulderstone, director of e-strategy at the British Library, said that all types of material will be collected including "informal material" such as discussion forums. "Letters and other informal works tell us how society is actually operating," he said.

The British Library will not censor the material because it does not want to restrict what people can find out about in the future.

"We would like to take a snapshot of every year, as a sample of what the Web looked like", said Boulderstone, suggesting that in the future people could look back to 2004 and see the swear words that Web users were using.

Only a limited number of Web sites will be archived initially but "ultimately, we would like to archive the whole UK Web," said Boulderstone.

One of the problems faced by the consortium is that, due to UK copyright law, permission is needed before a site can be archived. The British Library is working with the government to extend the law to allow them blanket access to all Web sites because "there are 4 million sites that we would like to capture -- we cannot ask everyone for permission," said Boulderstone.

The UK Web Archiving Consortium is not the first to archive the Web. The Wayback Machine, run by US-based Internet Archive, is a service that allows people to visit archived versions of Web sites.

According to Boulderstone, the British Library's approach differs from that of the Internet Archive because his organisation seeks permission from Web sites. In the future, the British Library hopes to improve on Wayback by archiving more frequently and with more depth, and through providing metadata so that information can be found more easily.

Topic: Networking

Kick off your day with ZDNet's daily email newsletter. It's the freshest tech news and opinion, served hot. Get it.

Talkback

3 comments
Log in or register to join the discussion
  • I think its absolutely appalling that the British Library can ride roughshod over peoples copyright in such a fashion - by basically altering the law to allow them to do what they want with other people's web content.
    anonymous
  • This seems to be not only rather pointless, but unless they are planning to also archive every database and server side code on the web (or I am missing something) then most of these archived sites will not actually do anything.
    anonymous
  • What a wonderful idea. I don't think any webmaster producing original work will object to having their contributions preserved for the future. My only worry is how will the sites be stored? CD based storage will not last that long.
    anonymous
http://www.zdnet.com/british-library-plans-to-archive-whole-uk-web-3039158517/
www.zdnet.com
crawl=CC-MAIN-2014-49
97680
application/http; msgtype=response
sha1:6OVWWDW7BF7WAGSC5ATMGWKDI4NUPEOZ
<urn:uuid:1a27460f-3b32-41f2-a042-ba550f818d18>
2014-11-23T21:01:11Z
54.186.48.7
sha1:Q3REPST4XYC6IM2XAUJVQGFCXWZF76BW
<urn:uuid:7caab98f-d2aa-48ff-b509-6ebde68f928d>
http://www.zdnet.com/british-library-plans-to-archive-whole-uk-web-3039158517/
response
<urn:uuid:e2d026ed-eda7-465c-8ae5-d073ad58aae2>
robots: classic
hostname: ip-10-235-23-156.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-49
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for November 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf