IDEALS Home University of Illinois at Urbana-Champaign logo The Alma Mater The Main Quad

Shedding Light on the Dark Data in the Long Tail of Science

Show full item record

Bookmark or cite this item: http://hdl.handle.net/2142/10672

Files in this item

File Description Format
PDF heidorn.pdf (155KB) (no description provided) PDF
Title: Shedding Light on the Dark Data in the Long Tail of Science
Author(s): Heidorn, P. Bryan
Subject(s): Institutional repositories Data curation Small science Dark data
Abstract: One of the primary outputs of the scientific enterprise is data, but many institutions such as libraries that are charged with preserving and disseminating scholarly output have largely ignored this form of documentation of scholarly activity. This paper focuses on a particularly troublesome class of data, termed dark data. “Dark data” is not carefully indexed and stored so it becomes nearly invisible to scientists and other potential users and therefore is more likely to remain underutilized and eventually lost. The article discusses how the concepts from long-tail economics can be used to understand potential solutions for better curation of this data. The paper describes why this data is critical to scientific progress, some of the properties of this data, as well as some social and technical barriers to proper management of this class of data. Many potentially useful institutional, social, and technical solutions are under development and are introduced in the last sections of the paper, but these solutions are largely unproven and require additional research and development.
Issue Date: 2008
Publisher: Johns Hopkins University Press and the Graduate School of Library and Information Science. University of Illinois at Urbana-Champaign
Citation Info: In Library Trends 57 (2) Fall 2008: 280-299.
Genre: Article
Type: Text
Language: English
URI: http://hdl.handle.net/2142/10672
ISSN: 0024-2594
Publication Status: published or submitted for publication
Rights Information: Copyright 2008 Board of Trustees of the University of Illinois
Date Available in IDEALS: 2011-01-01
 

This item appears in the following Collection(s)

Show full item record

Item Statistics

  • Total Downloads: 449
  • Downloads this Month: 17
  • Downloads Today: 0

Browse

My Account

Information

Access Key
https://www.ideals.illinois.edu/handle/2142/10672
www.ideals.illinois.edu
crawl=CC-MAIN-2014-15
20057
application/http; msgtype=response
sha1:6WDFL34RMYCC5FE33ARRA42GNUSXRA6X
<urn:uuid:ae0c6fec-4530-448d-b7b6-b59d58b4a00a>
2014-04-23T12:52:09Z
192.17.174.8
sha1:CO2MC24JRDT3TG3ARKLRC2OOSPMJVCFB
<urn:uuid:983ae98a-8664-4cce-8463-44cabffa6cb0>
https://www.ideals.illinois.edu/handle/2142/10672
response
<urn:uuid:a9a830b2-581c-4f96-9814-0ef14d0df3c1>
robots: classic
hostname: ip-10-147-4-33.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2014-15
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for April 2014
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf