California Digital Library » Web Archiving http://www.cdlib.org/cdlinfo The Official CDL Blog Wed, 01 Oct 2014 16:41:11 +0000 en-US hourly 1 http://wordpress.org/?v=4.0 WAS Service Update: August 2014 http://www.cdlib.org/cdlinfo/2014/09/23/was-service-update-august-2014/ http://www.cdlib.org/cdlinfo/2014/09/23/was-service-update-august-2014/#comments Tue, 23 Sep 2014 17:36:00 +0000 http://www.cdlib.org/cdlinfo/?p=16482 More...]]> was_logo

Recent Enhancements, News, and Activities

  • WAS User Group Meeting. The WAS User Group meeting was held during the Society of American Archivists Annual Meeting (SAA 2014). The meeting was open to all conference attendees for a discussion to explore web archiving issues related to researcher needs. Notes from the discussion are available here: http://bit.ly/WAS2014usergroup.
  • SAA 2014 Panel. Rosalie chaired a Lightning Talk that focused on access to web archives. The main takeaway was ‘tearing down the silos’. The speakers presented on a variety of methods that they are using to integrate access of their web archives with their existing archival and library collections. For example,
    • creating finding aids for each web archive
    • adding links to existing finding aids for the relevant archived sites
    • providing a web archive collection search page
    • uploading records into library catalogs
    • sending records to OCLC
    • building collaborative collections and providing unified access
    • integrating access with other formats in current discovery systems

    Link to the session description: Session 703: From Crawling to Walking: Improving Access to Web Archives: http://sched.co/1hIEcE2
    Link to the slides: http://www.slideshare.net/rosalielack/saa-2014-session-703

  • Storage and Infrastructure Upgrades. Work continues on migration of WAS storage to the San Diego Supercomputer Center (SDSC). The project completion date is estimated at Oct/Nov 2014. Work also continues on Rails software upgrades for the Curator and Public interfaces.

New Public Content

University of California, San Francisco Web Archive [Public Archives]

ucsf_web

UCSF has created an archive of 75 sites to support their mission to identify, collect, preserve, and maintain rare and unique materials to support research and teaching in the history of the health sciences and the UCSF. The oldest site in the collection is from 2007, when UCSF started capturing websites of the University’s administration, schools, the Graduate Division and the UCSF Medical Center, academic departments, administrative units, organized research units, and student organizations.

Visit: http://webarchives.cdlib.org/a/ucsfarchive.

WAS Activity, August 2014

  • 112 archives actively collected
  • 1564 total sites collected
  • 2.9 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/learning_center.

Service Monitoring and Availability
Check the system status page: http://www.cdlib.org/contact/system.html.

]]>
http://www.cdlib.org/cdlinfo/2014/09/23/was-service-update-august-2014/feed/ 0
WAS Service Update: June 2014 http://www.cdlib.org/cdlinfo/2014/07/10/was-service-update-june-2014/ http://www.cdlib.org/cdlinfo/2014/07/10/was-service-update-june-2014/#comments Thu, 10 Jul 2014 19:40:45 +0000 http://www.cdlib.org/cdlinfo/?p=15716 More...]]> was_logo

Recent Enhancements, News, and Activities

  • Storage. Work continues on migration of WAS storage to the San Diego Supercomputer Center (SDSC). We are now moving the content at a rate of approximately 1 TB a day. Once it is all moved (estimated September 2014), then WAS code will be updated to allow for transfer to and retrieval from SDSC. The project completion date is estimated at Oct/Nov 2014.
  • New partner institution. Lawrence Hall of Science at UC Berkeley has joined WAS!

New public content

Purdue University Web Archive Public Archives

purdue

Purdue University Archives has created an archive of around 30 sites to support their mission to make available for research, records and papers of enduring value created or received by the University and its employees. Visit: http://webarchives.cdlib.org/a/Purdue.

WAS Activity, June 2014

  • 117 archives actively collected
  • 1535 total sites collected
  • 2.8 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/learning_center.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]> http://www.cdlib.org/cdlinfo/2014/07/10/was-service-update-june-2014/feed/ 0 WAS Service Update: March 2014 http://www.cdlib.org/cdlinfo/2014/04/15/was-service-update-march-2014/ http://www.cdlib.org/cdlinfo/2014/04/15/was-service-update-march-2014/#comments Tue, 15 Apr 2014 21:49:03 +0000 http://www.cdlib.org/cdlinfo/?p=15015 More...]]> was_logo

Recent Enhancements, News, and Activities

  • Presentation. Rosalie Lack (WAS Service Manager) will be chairing a lightning talk session at the upcoming Society of American Archivists (SAA) Conference in August, in Washington, DC. The session title is “From Crawling to Walking: Improving Access to Web Archives.” The session will hear from speakers ‘lightning style’ (5 minutes each) about the challenges and solutions to promoting access and discovery of web archives. Speakers include:
    • John Bence, University Archivist, Emory University
    • Rick Fitzgerald, Librarian, Library of Congress
    • Polina Ilieva, Head of Archives & Special Collections, UC San Francisco
    • Benn Joseph, Manuscript Librarian, Northwestern University
    • Rosalie Lack, WAS Service Manager, CDL
    • Anna Perricci, Web Archiving Project Librarian, Columbia University
    • Meg Tuomala, Electronic Records Archivist, University of North Carolina at Chapel Hill
    • Olga Virakhovskaya, Assistant Archivist, Bentley Historical Library, University of Michigan
    • Jennifer Wright, Archives and Information Management Team Leader, Smithsonian Institution
    • Jane Zhang, Assistant Professor, Catholic University of America
  • Storage. The technical team continues work on migrating WAS storage to San Diego Supercomputer Center.

New public content

  1. UC Berkeley Library
    ucb_lib

    UC Berkeley Library has created an archive of the library website starting from April 2009.
    Visit: http://webarchives.cdlib.org/a/berkeleylib.

WAS Activity, January – March 2014

  • 106 archives actively collected
  • 1157 total sites collected
  • 2.5 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/learning_center.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]>
http://www.cdlib.org/cdlinfo/2014/04/15/was-service-update-march-2014/feed/ 0
WAS Service Update: January – February 2014 http://www.cdlib.org/cdlinfo/2014/03/11/was-service-update-january-february-2014/ http://www.cdlib.org/cdlinfo/2014/03/11/was-service-update-january-february-2014/#comments Tue, 11 Mar 2014 22:11:19 +0000 http://www.cdlib.org/cdlinfo/?p=14883 More...]]> was_logo

Recent Enhancements, News, and Activities

  • Storage. The technical team started work on migrating WAS storage to San Diego Supercomputer Center. The timeline for completion is summer 2014. Once completed we will be able to realize significant cost savings on storage, which will be passed onto all WAS institutions.
  • New partner institution. The Food and Agriculture Organization of the United Nations (FAO) has joined us! FAO is headquartered in Rome, Italy. Their first priority will be to archive their over 600 web sites from across the world.

New public content

Three new archives went public: University of Illinois at Urbana-Champaign Web Archives; Environmental Design Archive web site, UC Berkeley; and UCal Web Archive, UC Office of the President.

  1. University of Illinois at Urbana-Champaign Web Archives

  2. 1
    University of Illinois Archives has created an archive of over 600 University of Illinois websites.
    Visit: http://webarchives.cdlib.org/a/UofIWebArchives.

  3. Environmental Design Archives website 2000-2013, UC Berkeley
  4. In anticipation of a major redesign of their site, the Environmental Design Archives has crawled and archived their current site. Visit: http://webarchives.cdlib.org/a/eda.

  5. UCal Web Archive – prior to Jan. 2014 redesign

  6. 3
    This archive captured the contents of the UniversityofCalifornia.edu site prior to a redesign in January of 2014. Visit: http://webarchives.cdlib.org/a/ucpre2014.

WAS Activity, January – February 2014

  • 131 archives actively collected
  • 3131 total sites collected
  • 6.4 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/learning_center.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]>
http://www.cdlib.org/cdlinfo/2014/03/11/was-service-update-january-february-2014/feed/ 0
WAS Service Update: October 2013 http://www.cdlib.org/cdlinfo/2013/11/25/was-service-update-october-2013/ http://www.cdlib.org/cdlinfo/2013/11/25/was-service-update-october-2013/#comments Mon, 25 Nov 2013 23:23:48 +0000 http://www.cdlib.org/cdlinfo/?p=14580 More...]]> was_logo

Recent Enhancements, News, and Activities

  • Infrastructure. Work continues on infrastructure upgrades to search and indexing.

New public content

1. University of Illinois Urbana‐Champaign

was1

World Sustainable Development Web Archive. This archive aims to preserve web content published by Non‐Governmental Organizations that focus on environmental and economic sustainability materials from multiple languages and cultural groups. The sites collected have a rich array of documentation, data, images, and media that preserve the diverse perspectives, activities, and practices of sustainability NGO around the world.

2. Richard C. Rudolph East Asian Library, UCLA
was2

Shanghai Chronicles and Chinese Environmental NGOs are now publicly available. Shanghai Chronicles captures http://www.shtong.gov.cn/ since August 2012. Chinese Environmental archive captures Over 50 NGO sites that address local environmental conditions in China.

3. New York University Libraries / Tamiment Library (Labor & the Left)

was3

Internet/Cyberspace Democracy. Archives the websites of entities advocating universal, equal, and uncensored access to, and use of, online information; those contesting the notion of information as a commodity; those advocating non‐capitalist and non‐hierarchical models of online functioning and governance, etc.

Left Academia and Theory, Intellectuals and Other Notables. Contains the websites of organizations and individuals representing the left in academia, left ideas and theory, intellectuals and others of note.

LGBT Rights. Contains the websites of left and militant organizations and individuals who advocate for the rights of the LBGT community.

Notable Individuals. Contains the websites of notable progressive and radical individuals, principally those whose activity is not subsumed under the scope of any of the other Tamiment Library Web Archives.

Progressive Policy / Educational Organizations. Contains websites for progressive policy / educational
organizations, foundations, research institutes, etc.

WAS Activity, October 2013

  • 111 archives actively collected
  • 1367 sites collected
  • 3.1 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/p/curators.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]>
http://www.cdlib.org/cdlinfo/2013/11/25/was-service-update-october-2013/feed/ 0
Eight New Web Archives Go Live http://www.cdlib.org/cdlinfo/2013/11/19/eight-new-web-archives-go-live/ http://www.cdlib.org/cdlinfo/2013/11/19/eight-new-web-archives-go-live/#comments Tue, 19 Nov 2013 18:17:06 +0000 http://www.cdlib.org/cdlinfo/?p=14546 More...]]> There are eight new archives, from three institutions now publicly available in WAS. The archives include a collection of NGO sites from around the world that focus on environmental and economic sustainability, over 50 NGOs that address local environmental conditions in China,  as well as the Shanghai Chronicles back to August 2012, and five new archives from NYU of sites related to Internet/Cyberspace Democracy; left in academia, left ideas and theory, and intellectuals; LBGT rights; notable progressive and radical individuals; and websites for progressive policy/educational organizations, foundations, and research institutes.

1)      University of Illinois Urbana-Champaign

UIUCwebarchives

World Sustainable Development Web Archive. This archive aims to preserve web content published by Non-Governmental Organizations that focus on environmental and economic sustainability materials from multiple languages and cultural groups. The sites collected have a rich array of documentation, data, images, and media that preserve the diverse perspectives, activities, and practices of sustainability NGO around the world.

2)       Richard C. Rudolph East Asian Library, UCLA

shanghaichronicles

Shanghai Chronicles and Chinese Environmental NGOs are now publicly available. Shanghai Chronicles captures http://www.shtong.gov.cn/ since August 2012. Chinese Environmental archive captures over 50 NGO sites that address local environmental conditions in China.

3)       New York University Libraries / Tamiment Library (Labor & the Left)

NYUarchives

Internet/Cyberspace Democracy. Archives the websites of entities advocating universal, equal, and uncensored access to, and use of, online information; those contesting the notion of information as a commodity; those advocating non-capitalist and non-hierarchical models of online functioning and governance, etc.

Left Academia and Theory, Intellectuals and Other Notables. Contains the websites of organizations and individuals representing the left in academia, left ideas and theory, intellectuals and others of note

LGBT Rights. Contains the websites of left and militant organizations and individuals who advocate for the rights of the LBGT community.

Notable Individuals. Contains the websites of notable progressive and radical individuals, principally those whose activity is not subsumed under the scope of any of the other Tamiment Library Web Archives.

Progressive Policy/ Educational Organizations Contains websites for progressive policy/educational organizations, foundations, research institutes, etc.

]]>
http://www.cdlib.org/cdlinfo/2013/11/19/eight-new-web-archives-go-live/feed/ 0
WAS Service Update: July -September 2013 http://www.cdlib.org/cdlinfo/2013/10/16/was-service-update-july-september-2013/ http://www.cdlib.org/cdlinfo/2013/10/16/was-service-update-july-september-2013/#comments Wed, 16 Oct 2013 17:50:49 +0000 http://www.cdlib.org/cdlinfo/?p=14417 More...]]> was_logo

Recent Enhancements, News, and Activities

1.   WAS 2.0 released. With the WAS 2.0 release, WAS curators now have new tools and reports that support: site creation and management; collection development; quality assurance; site analysis; and integration with local systems. Learn more: http://www.cdlib.org/cdlinfo/2013/07/10/web-archiving-service-was-2-0-release-of-new-curator-tools/.

was1

2.  Redesigned public interface. WAS public interface (http://was.cdlib.org) was released with a fresh new look. Read more: http://www.cdlib.org/cdlinfo/2013/08/08/web-archiving-service-was-has-a-new-look/.

3.  WAS at Society of American Archivists (SAA) New Orleans, August 11 – 17. Rosalie Lack staffed a booth and hosted a WAS user’s group meeting at SAA. Of particular interest, and a clear indication of the growing interest in web archiving, the SAA Web Archiving Roundtable held their first meeting (lean more: http://webarchivingrt.wordpress.com/) and also the only session completely dedicated to web archiving was standing room only! The session was “The Web of sites: Creating Effective Web Archiving Appraisal and Collection Development Policies”; WAS partner institutions (University of Michigan Bentley Historical Library and UC San Francisco) were well represented on the panel. The session was chaired by Nancy Deromedi from University of Michigan Bentley Historical Library; Olga Virakhovskaya also from the Bentley and Rachel Taketa from UC San Francisco presented. Jennifer Wright also provided insight into the practices at the Smithsonian Institutions Archives. Session overview: http://bit.ly/18TB8wg.

4.  OS Wayback Development. CDL joins six other IIPC (International Internet Preservation Consortium) members in overseeing the development of Open Source Wayback software. Erik Hetzner, WAS Technical Lead, attended the IIPC-supported meeting in Paris at the Bibliotheque Nationale de France to launch the new effort and plan the development calendar. The OS Wayback is the tool that is used by virtually all libraries/archives doing web archiving (along with WAS). It recreates archived websites, including content, images and navigation so that end users can view and interact with archived sites. More details about this IIPC project.

New Partner: Smith College

was2

New Public Content: Current Events in China: popular websites, blogs & twitters
was3

Richard C. Rudolph East Asian Library, UCLA went live with the ‘Current Events in China: popular websites, blogs & twitters’ web archive. Learn more: http://bit.ly/1b1W60M.

Visit the web archive: http://webarchives.cdlib.org/a/currentchina.

WAS Activity, July –September 2013

  • 126 archives actively collected
  • 3348 total sites collected
  • 8.1 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/p/curators.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

 

]]>
http://www.cdlib.org/cdlinfo/2013/10/16/was-service-update-july-september-2013/feed/ 0
New Web Archive: Current Events in China – Popular Websites, Blogs & Twitters http://www.cdlib.org/cdlinfo/2013/09/10/new-web-archive-current-events-in-china-popular-websites-blogs-twitters/ http://www.cdlib.org/cdlinfo/2013/09/10/new-web-archive-current-events-in-china-popular-websites-blogs-twitters/#comments Tue, 10 Sep 2013 18:14:08 +0000 http://www.cdlib.org/cdlinfo/?p=14296 More...]]> eastasianlibrary-logo

By Su Chen, Head, UCLA East Asian Library

Newsnet, Commentary, Blog, and Twitter are the major channels for over 500 million Chinese to access news, voice opinions, and exchange ideas on current important domestic and international issues, although the exchanges are ephemeral and in flux, they, however, play a vital role in people’s daily life. The CDL’s Web Archiving Service (WAS)  provides a prefect platform to capture and preserve ephemeral content to fill the gap of collections and services. The “Current Events in China: popular websites, blogs & twitters” is an attempt to do just that. The sites are identified by Professor James Tong of Politic Science at UCLA and Professor Yong Hu of Journalism at Peking University, and the capture started in September 2012. Users can now access, due to a WAS six-month embargo on archived sites, the contents from Feb. 2013 and prior.

Visit the web archive: http://webarchives.cdlib.org/a/currentchina 

Learn more about the Richard C.  Rudolph East Asian Library 

 

 

]]>
http://www.cdlib.org/cdlinfo/2013/09/10/new-web-archive-current-events-in-china-popular-websites-blogs-twitters/feed/ 0
Web Archiving Service (WAS) has a new look! http://www.cdlib.org/cdlinfo/2013/08/08/web-archiving-service-was-has-a-new-look/ http://www.cdlib.org/cdlinfo/2013/08/08/web-archiving-service-was-has-a-new-look/#comments Thu, 08 Aug 2013 16:49:55 +0000 http://www.cdlib.org/cdlinfo/?p=14189 More...]]> The University of California’s Web Archiving Service (WAS) launched a new public interface.

Check it out: http://was.cdlib.org/!

homepage-screenshot

The fresh new look showcases the importance of web archiving and promotes access to WAS partner institution collections. Under About and Features you’ll get an overview of WAS–who we are, what we offer and key WAS features. At the Learning Center  you’ll find web tutorials and documentation. WAS partner institutions are listed under Institutions and go to Archives to search and browse all public collections.

Please explore and send us your feedback to washelp@ucop.edu!

About WAS

The Web Archiving Service (WAS) is a service of the University of California Curation Center, powered by the California Digital Library (CDL).  WAS provides the tools to capture, manage, and preserve web content and provides public access to collections of archived websites. Since its launch in 2007, WAS has served the University of California libraries and affiliated institutions, as well as educational institutions across North America. Learn more: was.cdlib.org.

]]>
http://www.cdlib.org/cdlinfo/2013/08/08/web-archiving-service-was-has-a-new-look/feed/ 0
WAS Service Update: June 2013 http://www.cdlib.org/cdlinfo/2013/07/12/was-service-update-june-2013/ http://www.cdlib.org/cdlinfo/2013/07/12/was-service-update-june-2013/#comments Fri, 12 Jul 2013 16:59:01 +0000 http://www.cdlib.org/cdlinfo/?p=14023 More...]]> was_logo

Recent Enhancements, News, and Activities

  • WAS 2.0 release of new curator tools. Development and testing completed. Release date scheduled for the week of July 8. The curator features will include: ability to override robots.txt; new QA reports; additional metadata fields; ‘Related sites’ feature; improved Compare Capture; XML export; and improved ‘Currently Running Captures’ report interface.

New public content

  • Emory University Archives

emory

The Emory University web archive include websites produced by Emory’s administrative offices, schools, departments, institutes, centers, and programs, as well as its faculty, student, and alumni organizations. The web archives created by Emory University Archives document Emory University’s evolving web presence and preserves web content that reflect Emory’s ever changing academic, administrative, research, and student activities and culture.

Available here: http://webarchives.cdlib.org/a/emoryuniversityarchives.

WAS Activity, June 2013

  • 107 archives actively collected
  • 1579 sites collected
  • 2.3 TB of data collected

WAS Service Description
The Web Archiving Service (WAS) enables librarians, archivists and researchers to capture, curate and preserve websites and web‐published materials. WAS makes it easy to build web archives, with scheduling and other tools to help manage your archive. You control public access to your archives and can configure the appearance and navigation of each archive. We also provide collection development consultation and help desk support for web archiving questions.

WAS Service Manager
Rosalie Lack, rosalie.lack@ucop.edu or washelp@ucop.edu.

WAS Training Materials, Guides, FAQs and Webinars
WAS training materials and guides are available here: http://webarchives.cdlib.org/p/curators.

Service Monitoring and Availability
Check CDL’s system status page at http://www.cdlib.org/contact/system.html.

]]> http://www.cdlib.org/cdlinfo/2013/07/12/was-service-update-june-2013/feed/ 0
http://www.cdlib.org/cdlinfo/category/web-archiving/feed/
www.cdlib.org
crawl=CC-MAIN-2014-41
50999
application/http; msgtype=response
sha1:ZHZQJAM4YSTEBMK3S4RLHPGXHEXV2FDR
<urn:uuid:a0980f31-0f5b-42c9-b259-5170d07abff4>
2014-10-01T20:17:29Z
128.48.120.83
sha1:O24T4UPLQD5CBVITY3JIGCNP5DISDNA3
<urn:uuid:5172b9b9-9fcd-4014-bce6-08c642a0ccc2>
http://www.cdlib.org/cdlinfo/category/web-archiving/feed/
response
<urn:uuid:c7d6cca5-4486-491c-8d96-9f40b71b5e7c>
robots: classic
hostname: ip-10-234-18-248.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-41
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for September 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf