February 27, 2015

Digital Libraries: Mass Digitization

By Roy Tennant

In my very first LJ Column, I wrote, “Only a very small fraction of the millions of print items currently held by the world’s libraries will ever be in digital form” (LJ 11/15/97). In 1997, the company that would prove me wrong was starting up in a Stanford lab. Now, near-weekly announcements of massive digitization projects by Google and the Open Content Alliance (OCA) promise to change forever the way people find and use books.

According to Google, we are only a few years away from having the entire collections of large research libraries completely digitized and searchable. Owing to copyright restrictions, only “snippets” of many books will be displayed, but they will be newly discoverable, and many full-text books will be browsable online.

These efforts are likely to be transformational in ways we have yet to realize. Mass digitization, like many heralded new technologies, will take longer than predicted to make a serious mark and will create unforeseen impacts and enable unpredicted kinds of interactions with books. Whatever the outcome, libraries will be affected. We just don’t know exactly how yet.

Discovery

Chip Nilges, vice president of new services for OCLC (and an LJ Mover & Shaker 2005), is working on getting information about digitized books into Open WorldCat to make them more discoverable. If the book is available at the Google Book Search web site in snippet view only, owing to copyright barriers, Open WorldCat stands ready to show users which nearby libraries hold the book.

Down the line, OCLC also plans to provide related services. “I absolutely want to do this in such a way that libraries can download records [of digitized books] to their local catalog. It’s definitely the next step,” Nilges said. OCLC also intends to work with the OCA to make sure its records are also in WorldCat. Libraries can also use OCLC’s collection analysis service to discover which items in their collections have been digitized by these ­projects.

Access

Some books digitized by Google can be browsed in full-page image and downloaded in PDF format from the Google Book Search site, along with publisher-provided texts in either “snippet” or “limited preview.” Since Google Book Search does not provide access to the thousands of public domain books available via Project Gutenberg and similar efforts, users are better off searching regular Google for them.

The library catalog promises to provide access to digitized books as well as print books. The University of Michigan (UM) is the first library participating in the Google Library project to do so. MBooks allows users to search for books that have been scanned by Google and other content digitized by the UM libraries. Once users get to a specific digitized title, they can search within that item.

Where Google makes the books it digitizes available for downloading only in Adobe Acrobat format, the OCA makes all the files available for downloading—from the raw images to the metadata. Books digitized by the OCA are freely available for browsing and downloading on the Internet Archive site.

Issues

The libraries involved with mass digitization must deal with a logistical nightmare; thousands of books each day must be paged, packed, and shipped off-site for scanning. The same number must be received and reshelved. The scans themselves are sometimes poorly done or are missing pages. Projects scanning massive numbers of books sometimes sacrifice quality.

In the end, the sheer number of books involved is amazing. Perry Willett at the University of Michigan estimates they now have around 100,000 books from the Google project digitized and online. “I think we are seeing the first glimpses of what a real digital research collection will look like,” he said. “It’s definitely going to change the way we think about everything we do in libraries. I hope this starts a lot of discussion about ‘what this all means,’ because the potential is just limitless.”


Link List
Google Library Project
books.google.com/googleprint/library.html
Internet Archive
archive.org
MBooks
mdp.lib.umich.edu/m/mdp/mdp-faq.htm
Open Content Alliance
opencontentalliance.org
Open Worldcat
worldcat.org
 


Author Information
Roy Tennant (roy.tennant@ucop.edu) is User Services Architect, California Digital Library. He is author of Managing the Digital Library (Reed Business Pr., dist. by Neal-Schuman)
For more on the wired library, see the netConnect supplement mailed with this issue and with the January, April 15, and July issues of LJ

Share
http://lj.libraryjournal.com/2006/10/ljarchives/digital-libraries-mass-digitization/
lj.libraryjournal.com
crawl=CC-MAIN-2015-11
68681
application/http; msgtype=response
sha1:GJQSMMLHBQ2K3SO37YDFAPWQUO64S4BX
<urn:uuid:dce7fb52-23b1-4a2d-a563-2cebb3b438c8>
2015-03-01T04:29:21Z
216.70.86.237
sha1:35ITZMRNCZQSMPFY4YITZNW4N3G4SIMY
<urn:uuid:58731c3e-899a-464b-9824-688fb4027bff>
http://lj.libraryjournal.com/2006/10/ljarchives/digital-libraries-mass-digitization/
length
response
<urn:uuid:ea7f9cf2-f10e-4433-b644-0d4a775bd198>
robots: classic
hostname: ip-10-28-5-156.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2015-11
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for February 2015
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf