Proposal for Establishment of a DSpace Repository at the School of ...

flameluxuriantData Management

Dec 16, 2012 (4 years and 8 months ago)

487 views









Proposal for Establishment of a DSpace


Digital Repository at

The School of Information, University of Texas at Austin



Anne Marie Donovan

Maria Esteva

Addy Sonder

Sue Trombley



May 10, 2003



LIS 392P, Problems in the Permanent Retention of Elec
tronic Records

Dr. Patricia Galloway


The University of Texas at Austin

School of Information



D
-
Space Proposal
2















Acknowledgements


The DSpace Project Team would like to thank the following persons for their assistance
in the establishment of the iSchool DSpa
ce testbed repository and the collection of
information for this paper.



Dr. Patricia Galloway

Georgia Harper, J.D.

Kai Mantsch

Dr. Mary
-
Lynn Rice
-
Lively

Quinn Stewart

Shane Williams


D
-
Space Proposal
3

Introduction


In the Fall of 2003, students, faculty and staff at the

University of Texas at Austin
School of Information (iSchool) researched the potential us
efulness of the DSpace™
1

digital repository tool as an archival repository for iSchool Web sites. Concurrent with
the implementation of a small DSpace repository testbed
2
, the project team appraised the
entire iSchool Web site for its archival value and es
tablished a typology for the definition
of a DSpace archival domain within the Web site. Following the establishment of the
testbed, the project team developed specific guidelines and recommendations for the
establishment and management of a fully
-
operati
onal DSpace repository at the iSchool.


This report describes the team's research process and findings. It also provides
background information on similar digital asset repository projects at other institutions as
well as a survey of current methodologie
s for Web site preservation. The report is
presented in four parts: Archiving the Web, the DSpace Digital Asset Archiving Tool, the
Appraisal of the iSchool Web Site, and Implementing a DSpace Repository at the
iSchool.


Archiving the Web


Why Archive
the Web?



Legal and administrative requirements.
Web site archiving first received
substantial attention from organizations (particularly governmental) that use the Web for
the publication of authoritative documents and the conduct of official business.

The need
to preserve Web content as a business
record

became increasingly urgent as more and
more business was conducted over the Web. The field of Electronic Records
Management (ERM) is new and still relatively undeveloped, but it has highlighted the
ne
ed to collect and securely store organizational Web sites as a legitimate and often
unique record of an organization's business processes and transactions
3
.


Historical requirements.
The historical value of preserving Web sites has been
recognized by gove
rnments as well as individual institutions. The Library of Congress
has established a national policy to support the preservation of Web content that is
necessary for institutional endurance and cultural memory in the United States. National
Web archivin
g programs have also been established to achieve similar goals in Australia,
Sweden, and the European Union. Web site archiving is not a task that can be delayed;
Web content is ephemeral and the mortality rate of Web sites is very high. Scholars and
his
torians have come to rely on the resources of the Web and they will expect to have
those resources (current and retrospective) available well into the future.







1

A full description of the DSpace initiative is available
at
http://www.dspace.org
.

2

The iSchool DSpace testbed hompage can be found at
https://ford.ischool.utexas.edu/index.jsp
.

3

For a discussion of U.S. Federal gu
idelines for ERM, see Sprehe & McClure, 2003 at
http://istweb.syr.edu/~mcclure/guidelines.html
.

D
-
Space Proposal
4

The Nature of Web Sites


Web sites past and present
. In the first days of the Web (the early
1990’s), Web
sites consisted entirely of static html pages. These static documents sometimes contained
hyperlinks that would generate a request for another page on the same server. When a
hyperlink was activated, the browser (client) sent an http request

to the server, which
responded with the html content. In the mid
-
1990’s, techniques became available to
make client
-
server communications more versatile. The html specification was updated
to include a number of new tags that allowed people to embed lit
tle programs in the
source code of a page. The release of languages such as JavaScript and Visual Basic
allowed html page authors to dynamically script the behavior of objects running on either
the client or the server. Web sites became more interactive
and acquired the capability to
respond to user input. The increasingly dynamic nature of the Web led to its penetration
into almost every aspect of daily life.


Web sites have evolved to become records that inextricably combine
technological and social
issues. The Web has become the primary medium for mass
electronic communication in many countries, revolutionizing the way people search for
information, conduct business, and entertain themselves.

The Web both

enables and
reflects the way of life in most

of the industrialized world. Web sites are an amazing
synthesis of quick
-
paced technological advancements, human creativity, and human
behavior. It is this complexity that makes Web site archiving so challenging.


The future Web.

Use of the Web today
is already beginning to reflect what is
often referred to as the "Webbed world," a place where almost every electronic device is
Web
-
enabled. Web developers expect a dramatic increase in Web
-
served content over
the next few years, including more multi
-
med
ia and streaming media, more interactive
and dynamic content (hypermedia), and much more highly individualized content
delivery. The advent of pervasive computing (delivery devices embedded in everyday
objects) suggests that the technologies used to creat
e and deliver digital content over the
Web will multiply dramatically as well. There will be more input devices and more
automatic capture of content for delivery through a Web interface.



Web developers also expect a dramatic increase in the delivery of
content through
Web
-
enabled wireless devices. Efficient delivery will require adaptive interfaces,
intelligent devices, situated services, and environmentally aware content delivery. The
establishment of peer
-
to
-
peer (P2P) mobile networks with integral s
treaming feeds from
dispersed sensors will significantly complicate the difficulty of identifying the server for
Web
-
served content and the development of wearable Web
-
enabled devices has created a
new realm of information collection, the human
-
cyborg coll
ector
4
. How will we define
Web site, Web page, or capture Web content in this environment?






4

An description of the use of human
-
cyborg technology in Austin can be found at
http://wearcam.org/seatsale/nytimes/25CYBOprinter.html
, Hewlett
-
Packard shares their vision of P2P and
the human
-
cyborg in Cooltown at
http
://cooltown.hp.com/mpulse/1001
-
thinker.asp
. MIT's Media Lab is
also sharing their view of how wearable computers can be used (http://www.media.mit.edu/wearables/)

D
-
Space Proposal
5

The delivery of dynamic content to mobile devices will also result in the creation
of more interlinks in Web sites; there will be few or no standalone or static W
eb pages.
The trend is toward more databases and digital object repositories serving tailored content
to clients with the use of adaptive middleware. Web
-
served content is becoming more
ephemeral and the boundaries of digital objects are becoming more in
determinate. With
whom will the archivist have to collaborate to collect all the pieces of a Web site, a Web
page or a single digital object?



Why Archive the iSchool Web Site?


A unique resource
. Under the premise that the content of Web sites provides

a
uniquely informative view into the social and business processes of an institution, the
value of archiving the iSchool’s Web site patrimony is patent.
An examination of
iSchool Web sites stored in the Internet Archive (1997 to present) reveals that the

School's use of this publication medium has evolved considerably over the past six years.
Initially a simple informative presentation about the School, the iSchool Web site now
provides a broad record of the School's functions, activities, and developmen
t. No other
record or combination of records produced and gathered by the iSchool conveys the
operations of the institution in such a dynamic and encompassing way. The Web site
provides a snapshot of the technologies that are used to teach, communicate,
and interact
at the School; the intellectual content conveyed to the students; and the research and
public activities in which the School is involved. It is also very revealing of the
professional and social relationships established by staff, faculty, an
d students in the
course of their academic pursuits.
Archiving Web sites produced by the iSchool also
provides evidence of the development, extent, and impact of the incorporation of
information technologies in teaching processes at the School.


An archiva
l opportunity.

Acknowledging the value of the iSchool Web site as an
archival object, it is essential that fundamental archival principles are applied to its
capture and preservation. An archival perspective considers the technological, legal,
social, and
organizational issues involved in creating a collection and a commitment to
long
-
term preservation that will assure the authenticity, security, and long
-
term
accessibility of the archived assets. A number of institutions, both public and private,
have ini
tiated Web site archiving projects involving a broad collection scope. In the case
of the iSchool, these archival goals and concerns can be effectively tested through use of
MIT's open
-
source digital asset repository tool
--

DSpace. Before describing this

specific
toolset, however, it will be useful to examine the fundamental processes of Web site
archiving and some current Web site archiving projects.


Archiving Techniques


The two appraisal methods presently used by Web archiving institutions are
bulk

an
d
selective

collecting. Bulk collecting automates the harvesting of Web sites by using
Web crawlers, search engines, and large storage capabilities. To date, bulk collecting is
the only appraisal option that has allowed the development of comprehensive Web

site
collections despite the fast, disorganized growth of the Web. However, bulk collecting
D
-
Space Proposal
6

operates with minimal human appraisal input and without archival considerations. The
automated harvesting tools used by bulk collectors are

capable of gathering
large
amounts of Web sites very quickly. They can also be all
-
inclusive or somewhat selective.
For example, a harvester can be programmed to gather everything that is in the public
domain, or only selected Web sites in specified domains.
From an archival

perspective,
however, the power of the automated harvester is a double
-
edged sword. For a variety of
reasons (e.g., the presence of robot.txt files and legal constraints), the use of bulk
collecting techniques ultimately results in very large collections

of potentially
inappropriate Web sites that suffer from a variety of technical deficiencies.


The selective appraisal approach, which requires human involvement in the
selection and collection processes, provides a more comprehensive and technically
pro
ficient collection of Web sites. It allows early identification and rectification of
technical problems encountered during the collection process, thereby ensuring the short
and long
-
term accessibility of Web sites. Selective appraisal is in itself a pres
ervation
strategy because it considers from the outset the commitment needed to enable long
-
term
archiving of Web sites. Some institutions go even further in their preservation efforts by
including only standardized file formats in their repositories or by

transforming variably
formatted Web objects into more consistent and stable formats upon their accession into
the collection.


Selective appraisal does present its own set of problems, however. While
selective appraisal strategies can be implemented in
very controlled environments to
obtain specific digital objects, they are not useful if the archive’s goal is to document the
broad technological development of Web sites. Selective appraisal is undoubtedly much
slower and more costly than automated collec
tion. As well, archives and libraries have
highly diverse goals and different legal and economic considerations when they are
collecting Web resources. Institutions that practice selective appraisal must decide when
a Web site constitutes a Web publicati
on and when it constitutes a public Web record. In
practice, this definition shapes their collection development and if it is too restrictive,
many Web sites that might appropriately be collected fall through the cracks during the
collecting process. Given

the positive and negative aspects of both the bulk and selective
appraisal approaches, many institutions with broad collecting missions are now
examining the possibility of a hybrid approach to Web site collection.



Web Site Archiving Projects


The Inter
net Archive.

Inspired by the spontaneity of the Web and the chaotic way
in which it has emerged and continues to develop, the Internet Archives identifies, bulk
gathers, and indexes publicly accessible Web sites through a powerful commercial
harvesting to
ol
5
. As these harvesting tools (also called crawlers) search the Web, they are
excluded from some Web sites or Web pages by robot.txt files and they are unable to
access and harvest databases behind many interactive Web pages. Because of these
constraint
s, the Internet Archive has not realized its goal of collecting a complete record



5

A description of the Internet Archive collection process can be found at
http://www.archive.org


D
-
Space Proposal
7

of the Web. Its collection is populated with Web sites that are often duplicative or
incomplete and whose quality, functionality, or long
-
term preservation cannot be
guarant
eed. Nonetheless, the Internet Archive presents a highly informative series of
snapshots of the Web from 1996 to the present.


Australian projects.

The Pandora Project at the National Library of Australia
6

and the Commonwealth Electronic Recordkeeping G
uidelines of the National Archives of
Australia
7
, provide two different and complementary examples of how the selective
appraisal process can be used in the collection of Web resources. These projects also
exemplify the distinctive roles archives and libra
ries are likely to fulfill as long
-
term
repositories of Web sites. Individually, neither project comes close to capturing the full
scope of the Australian Web domain, but together they capture a large part of socially
significant Australian
-
produced Web c
ontent.


The objective of Project Pandora is to collect scholarly Web sites of Australian
authorship. The publication collection process reflects traditional library processing
methods with only minor modifications. In terms of policies and processes, th
e
incorporation of each Web object into the collection involves a combination of carefully
scheduled crawling, editing of the Web objects to repair functionality, quality control,
and library cataloguing. This strategy allows Pandora to assure the complete
ness and
integrity of the archival publications and to become fully responsible for their long
-
term
accessibility.


The National Archives of Australia is charged with gathering and keeping
Australia’s public records whether they are Web
-
based transactions
with citizens or Web
publications issued by government. Guidelines established by the National Archives
instruct government agencies to archive Web based records, including institutional
publications and transactions records, on a continuous basis. This
continuum model
8

approach to records management begins with an institution assessing and controlling the
environment in which its records are created. The function and characteristics of the
records are appraised in the context of the technology in which t
hey are created, for
example, whether their content is static, or is produced interactively through the use of
dynamic Web technology. Each agency’s record retention schedule and the results of the
individual appraisals determine the frequency of capture

or trigger for capture for Web
-
based records. Appraisal of the records
in situ

also reveals software applications and/or
descriptive metadata that should be captured along with the bitstream of a record to
ensure its long
-
term accessibility and to give d
ynamic records full functionality.


NEDLIB.

The Networked European Deposit Library
9

(NEDLIB) Web site
archiving project employs a collection method that reflects both a high level of



6

A description of the Pandora Project can be found at
http://pandora.nla.gov.au/bpm.html#intr


7

A description of the National Archives of Australia G
uidelines for Electronic Recordkeeping is available
at
http://www.naa.gov.au/recordkeeping/er/web_records/guide_contents.html

8

The Australian Record Continuum Model is b
ased on the work of Frank Upward. The origin of the term
"record continuum" is somewhat obscure, but a complete articulation of the model can be found in two
articles by Upward that were published in
Archives and Manuscripts

(Upward, 1996 and Upward, 1997)
.

9

A description of the NEDLIB project can be found at
http://www.kb.nl/coop/nedlib/
.

D
-
Space Proposal
8

automation and the use of selective appraisal techniques. The NEDLIB co
nsortium has
developed a bulk
-
harvesting tool that embeds some archival functionality to selectively
ingest e
-
publications marked for legal deposit into its repository (Hakala, 2001).
Through precise programming, the NEDLIB crawler aggregates updated or n
ew objects
from Web sites without gathering duplicate material. The crawler also automatically
assigns unique identifiers to object during ingest to permit easy identification of the
objects in the digital repository. The crawler also captures and indexes

metadata and
provides full text indexing to facilitate searching of the captured content. The NEDLIB
project is still in an experimental phase and project results have not been officially
published, but the project participant's initial findings indicate

the importance of
cooperative approaches to the development of effective tools for selective collecting.


Archival Issues in Web Site Collection


Present.

Today, most institutions that are experimenting with Web site archiving
are highly focused on the i
ngest step of the archiving process. Despite this focus,
however, none of the technical or social problems that attend even the initial steps of
Web site preservation areas are as yet resolved. Thus far, Web site preservation activity
has primarily invol
ved the development of metadata during the capture and accession of a
Web page and the creation of a secure storage site where properly identified bit
-
streams
can be kept untouched and then served to a user. In most cases, this process operates
within the

framework of the Open Archival Information System (OAIS) model
(Consultative Committee for Space Data Systems, 2002) which is described later in this
document.


While each of the projects described above differs in its goals, scope, and
procedures, the pr
oblem of appraisal recurs as a critical factor that determines the
effectiveness of all further archival processes. Appraisal is the preeminent process in
Web site archiving because it is during appraisal that an organization defines the
technologies that

will be used to capture, index, identify, and ultimately, to re
-
serve the
Web sites. The capabilities and limitations of these technologies in turn determine the
completeness and authenticity of the record, as well as possibilities for information
organiz
ation and the long
-
term accessibility of the Web site collection.


In Web site archives, as in all archives, there are also significant legal and social
issues to be resolved in the collection and display of archival objects. Considerations such
as intell
ectual property (IP) rights and privacy rights become more complex when applied
to digital objects. The legal limitations that an organization sets for its collection must
become an integral part of the appraisal process, embedded even in the technology t
hat
enables it. For example, the Internet Archive collection policy assumes that because Web
sites are made public on the WWW, archiving those sites does not violate intellectual
property or privacy law. To strengthen this operating assumption, the IA wi
ll de
-
accession any Web site upon the request of its creator if he or she does not want the site
held in the IA. Because IP and privacy law is not well developed in the context of the
WWW, the IA’s decision to bulk collect is essentially an appraisal choi
ce, an appraisal
choice without clear legal precedent or support. Since the long
-
term technical and social
D
-
Space Proposal
9

impacts of this appraisal model are still unclear, the IA does not provide a useful archival
model for academic Web archiving projects.


The Natio
nal Library of Australia’s Pandora Project must deal with both the legal
and preservation considerations that pertain to keeping a permanent record of Australia’s
Web
-
based publications. Once a Web publication is selected for collection, an
acquisition pr
ocess affirmed by Legal Deposit law, adjusted to a Web environment, is
begun. Among the adjustments made in the legal deposit process is an agreement with
the publisher that the National Library will delay public availability of the archived
object until
income provided by the publication is exhausted.


The work of the National Archives of Australia in collecting public records has
highlighted a number of legal concerns that, while not unique to Web
-
based records, are
certainly exacerbated by the public
-
ness of this new record creation and record keeping
medium. In the case of public records, concerns about IP rights take a back seat to
privacy concerns, but institutional liability can be significant if there is a perception that
records have been mishan
dled in either context.


Future.

In the future Web, the protection of IP and privacy rights will face new
challenges as Web
-
collected and delivered content becomes more pervasive and more
complex. For example, whose rights must a repository administrator

protect when
collecting and preserving content created in a P2P mobile network with integral
streaming feeds from dispersed human
-
cyborg collectors and other remote sensors?
Intellectual Property and privacy laws that cannot deal effectively with today's
Web will
certainly be inadequate to the legal challenges of the future Web.


The continuing trend toward Web
-
delivery of increasingly complex and
ephemeral content will have a profound affect on the process of Web site archiving. The
incredible amount of

content produced over the next decade will create an appraisal
problem much larger than the one we now face. In the words of W. G. Lefurgy (2001),
"The trick is to determine what to save” (Appraising Web Records). Traditional archival
methods will certa
inly be challenged. How is the archivist to establish provenance or
fond when dealing with content derived from multiple collectors and served to multiple
devices? Archivists will also face the challenge of describing the highly diverse contents
of their

collections for an equally diverse (or possibly unknown) user group.


The creation of Tim Berners
-
Lee's “Semantic Web” (Berners
-
Lee, 2001) would
provide some relative context for Web
-
served content, but the crucial problem of
capturing that content would

still exist. The technical challenges of
fixing

ephemeral and
interactive content and
freezing

dynamic digital objects for collection are daunting. At
the same time, the "Deep Web" is becoming deeper, and increasingly often the databases
it contains are

serving to an adaptive interface (middleware) and not to a specific client.
In this case, what is the content and who is the user?



Archivists will also face the problem of describing the extent as well as the
functionality of their archival assets (e
specially difficult in the case of complex or
D
-
Space Proposal
10

compound objects). The Cedars Project refers to this as the problem of determining an
object's "significant properties” (Cedars, 2002, p. 14). Today's Web site archivists must
already deal with multi
-
media, m
ulti
-
format content and the use of multiple technologies
for delivery. The difficulties presented will only increase over time. How is a repository
to keep track of, much less store, the software and hardware needed to access the assets in
its collection
s?


As the Web grows quantitatively and changes qualitatively, the need for
collaborative efforts in its preservation becomes more critical. For example, the NEDLIB
project experience suggests that significant cooperative effort will be required simply t
o
achieve a viable legal context for bulk collection of Web resources. Before this
particular problem, or any other, can be addressed, it is vital that the archival community
adopt a common technological framework for executing and examining digital arch
iving
processes and simple but flexible toolset for handling archival digital objects. The Open
Archival Information System (OAIS) model describes the needed framework, but digital
archiving projects have developed a variety of toolsets.




Projects such a
s PANDORA and NEDLIB ascribe to the OAIS model, but their
technological tools and business processes are too specialized to host a collaborative
study of a broad range of digital archiving challenges. A more generally applicable
technical base and process

model can be found in the DSpace digital asset archiving tool.


The DSpace Digital Asset Archiving Tool


DSpace project Genesis and Participants




DSpace is an evolving open source platform that enables the implementation of an
institutional digital rep
ository system. It is designed to capture and describe digital
objects, to allow for the search and retrieval of archived objects over the WWW, and to
preserve the digital assets over the long term, all within a secure environment. DSpace is
the product
of a collaborative effort between MIT and the Hewlett Packard Company
(HP), funded in part by grants from the Andrew W. Mellon Foundation and the
Cambridge
-
MIT Institute. After a test of the business model and software at MIT, the
project published the DS
pace code for public use in November 2002. As of May 2003,
over 2,500 organizations and individuals have downloaded the code.


DSpace Structure and Processes


The DSpace repository structure and its processes are based on the Open Archival
Information
System (OAIS) model. This model, developed by the Consultative
Committee for Space Data Systems

is presently under review by the ISO as a digital
repository standard. DSpace depends on metadata to insure intellectual and
administrative control over the s
ubmitted items. The OAIS model comprises six major
functions:
ingest
,
archival storage
,
dissemination
,
data management
,
administration
, and
preservation planning
. OAIS depends heavily on metadata to insure intellectual and
administrative control over item
s submitted to a repository.

D
-
Space Proposal
11


The first three functions,
ingest
,
archival storage
, and
dissemination
, encompass
actions related to the direct handling of a digital asset. The
ingest

process involves the
submission of digital objects to DSpace by the produc
er. The submitted item(s) is
approved by the repository’s “gate
-
keeper” who confirms that the item conforms to
predetermined terms established between the submitter and the repository, including
acceptable bitstream formats and mandatory metadata. The ap
proval process may
involve a workflow, passing through the hands of several parties in order to guarantee the
integrity of the repository’s collection policy. Materials are submitted to collections that
belong to communities. The submission is known as a

submission information packet
(SIP).


The
archival

storage function securely stores and maintains the bitstreams in the
repository. The submitted item(s) and its associated metadata become an archival
information packet (AIP) in which the item is given
a unique persistent identifier to
ensure that it can be located and retrieved in perpetuity. The assignment of a unique
identifier to an archival object upon ingest is a tool used by all digital archiving projects.
This unique identification is crucial be
cause it permits the digital object to be stored
efficiently within the archival repository and still be delivered as a fully
-
functional asset.
In most cases, a unique identifier is assigned automatically during harvesting or retrieval.


While DSpace re
commends the use of a CNRI handle
10
, there are a number of
models that the ISchool could consider in assigning a persistent identifier. The NEDLIB
harvester calculates a message digest checksum for each file to provide a means for file
authentication and t
o detect any file change or duplication. The Internet archive stores
Web sites as they are captured and assigns a unique identifier on the fly when a page is
requested

by a user. As each page is delivered, a javascript that identifies the page as a
copy o
f an archival object is automatically inserted in the code. The script also embeds a
unique identifier based on the page's harvesting date and indicates the file location of
archived components of the page (e.g., linked pages and images) that might be requ
ested
by the user. Pandora uses the PURL
-
OCLC resolver service

to assign a permanent URL
to each page
11
. For cataloguing and administrative purposes, DSpace and PANDORA
also retain other unique identifiers of a digital object, such as ISMN and ISBN.


Asset

dissemination

includes a user's ability to find and retrieve digital assets
stored in DSpace via a Web browser. Information seekers are initially given access to the
descriptive metadata of a requested item and then may download a dissemination
informat
ion packet (DIP) containing the asset. The completeness and functionality of the
asset as it is presented in the DIP is dependent upon the user’s pre
-
arranged access and
security profile.





10

For more information about this global naming service that enables secure name resolution over the
Internet go the Corp
oration for National Research Initiative’s Handle Sytem Web site at
http://www.handle.net
.

11

For more information regarding the persistent uniform resource locator (PURL) go to
htt
p://purl.oclc.org
.

D
-
Space Proposal
12

The last three functions,

data management
,

administration
, and

pre
servation
planning
relate to a broader range of activities that must be undertaken to ensure
transparency in the repository’s functions and the archival integrity of its assets.
Data
management

is critical to the success of the repository. When a submitt
ed item is
accepted into the repository, its associated metadata is written to a database. This
database allows users and administrators to retrieve details about AIPs without having to
access the original bitstream.
Administration

is the overarching set

of activities required
to ensure the “trusted repository” status of DSpace.
Preservation planning
, the least
defined of the OAIS functions, refers to the on
-
going maintenance of digital assets in the
repository. As an example, items are ingested into th
e repository in a registered format.
This format may be supported by the repository, or unsupported with a commitment to
future support, or it may be an unknown format that the repository does not intend to
support. It is incumbent upon the repository ad
ministrator to decide the level of support
for specific digital formats as well as to plan and facilitate all other activities necessary to
assure long
-
term preservation of the repository’s assets. These other actions may include
format migration, media r
efresh, data back
-
ups, and the formulation of a disaster
recovery plan.


DSpace Technology Development


A formal DSpace consortium consisting of MIT, Columbia, Cornell, Ohio State
University, the Universities of Rochester, Toronto, and Washington at Seat
tle, and
Cambridge University is committed to further testing of DSpace. Current topics of
research include the investigation of metadata other than Dublin Core to enhance the
robustness of the current metadata registry and the prospect of “federating” re
positories
for maximum benefit
12
. Anticipating input by the consortium and from the user
community, the DSpace development group intends to release updated versions of the
code on a quarterly basis.


Appraisal of the iSchool Web Site


Appraisal Process




Technical challenges.

To determine the feasibility of establishing a DSpace
repository at the iSchool, the team decided to conduct an appraisal of the iSchool Web
site in conjunction with implementing a DSpace testbed. The appraisal would be used to
ana
lyze the architecture of the site, develop a content typology, and identify the domain
to be preserved. To assist the appraisal process, the team held a meeting with the iSchool
Web master, the system administrator, the Assistant Dean for Technology, and
the head
of technical services to obtain information about the Web site's development and
management. Two central issues emerged out of this meeting: potential technical
constraints to archiving some types of digital content and the legal implications of
a
rchiving some of the site's content.




12

The Metadata Encoding & Transmission Standard (METS) an XML schema
-
based metadata standard has
received particular attention because it supports the effective archiving and efficient dissemination of
complex digital objects. See
http://www.loc.gov/standards/mets/

for a description of the METS project.

D
-
Space Proposal
13


The team began the appraisal with an architecture review of the iSchool Web site
(see Appendix C for a high
-
level site map). At present, the bulk of the site resides on
three servers: fiat, sentra, and stratus. The m
ain server, fiat, hosts all static content in the
site, while sentra and stratus host databases that serve dynamic content to site Web pages.
One database that serves the Web site, the Capstone database, is located on a non
-
iSchool
server. The iSchool sit
e contains public and private directories. Private directories are
indicated by a tilde in the directory name, and are used for iSchool course pages, iSchool
student organizations, and iSchool faculty and student personal pages. The iSchool
system admini
strator estimates that the Web site comprises approximately 2,000 files.


During the appraisal, it became apparent that the structure and management of the
Web site will greatly aid the collecting process. Relative links are used, and file and
directory n
aming conventions are consistent. For example, all private directories are
tilde’d, making them easy to identify (and partition) from the School's public directories.
The site has also benefited from the attention of a dedicated Web master who adheres to

the principles of good site architecture.


The appraisal revealed that the iSchool Web site contains both static and dynamic
content. Static content, which is simply a type of html page, presents little or no
technical challenge for capture. Static htm
l pages can be archived simply by copying the
source code, as it contains everything needed to render correctly in a browser. The html
code in static pages is always the same until it is manually changed. Dynamic content,
the second content type the team

found in the iSchool Web site, is more technically
challenging to capture. In general, dynamic html pages create their content in response to
user input, and when the html page is collected, the database behind the page and the
program that enables the i
nteractivity must also be captured. Dynamic pages provide a
new versatility in Web site design that enables interactivity with the user but they add to
the archival challenge.


The iSchool Web site contains significant dynamic Web page content that is
dat
abase driven. In this type of Web page, the html page acts as an interface to a
database. Archiving technology is not yet sophisticated enough to capture the
interactivity of a dynamic page such as this, but the databases themselves can be archived
so th
at the functionality of the pages can be preserved. In this case, rich metadata that
describes the parameters of the databases must be captured. Another type of dynamic
content found by the team during the site appraisal was a number of downloadable and
streaming multimedia files. These files, although they represent dynamic content, are
relatively easy to archive because they are well
-
defined media files. Preservation of a
variety of media types is not an archival problem as long as they are all suppor
ted by the
repository.


Social and legal challenges.

Archiving a Web site entails copying source code,
providing access to a copy of parts of the site, and potentially altering the original code so
that site can remain functional in a new technological fr
amework. Although the entire
iSchool Web site is presently available to the public, the team's appraisal revealed parts
D
-
Space Proposal
14

of the Web site that may be legally protected by University of Texas policies pertaining
to IP and privacy. The team was particularly
concerned about IP issues raised by
archiving Web sites or Web pages that held student and faculty produced content. These
resources include course Web sites and syllabi, student organization sites, and student
and faculty personal pages.


The University

of Texas Regents Rules and Regulations

concerning IP states that
this content falls under the ownership of the Board of Regents (
University of Texas
System Office of the General Counsel, 2002)
. To clarify the School's rights over the
content of its Web s
ite, the team posed a series of questions to the UT Office of General
Counsel. In response to these questions, the General Counsel's Office advised the team
to approach copyright compliance with particular care. In the same response, however,
the officia
l noted that the non
-
profit, academic status of the DSpace repository would
probably place the iSchool's archival collecting under the fair
-
use provision of copyright
law. Despite this encouraging response, the team decided it would include potential IP o
r
privacy concerns as a part of the appraisal process. T
he team's goal is to preserve as
comprehensive and informative picture of the iSchool as is possible, but the rights of
students and faculty members must be protected in achieving that goal. Caution
and
compromise clearly would be the order of the day.


The issue of privacy also arose during the appraisal process. For example, the
faculty and staff directories contain biographies and pictures of faculty and staff
members. Would it be necessary to as
k each individual whose picture is posted if they
agree to have their picture archived? Some faculty have already demonstrated resistance
to having their picture made available online by substituting an unrelated photo in the
place of a personal picture.

Would the same resistance be evident if the team sought to
archive personal photos?
Students and faculty might have a similar objection to the
preservation of their personal web pages.



Some of the faculty and staff photos are also clearly professiona
l works. Would it
be necessary to get permission from the photographer before archiving the picture? Who
should make the final archiving decision, the person in the picture or the person who took
the picture? After all, it will be the image of the indivi
dual that is preserved, not that of
the photographer. What procedure should be used if the provenance of the photo cannot
be determined? During the appraisal, the team also found that some site content is
generated by proprietary software. This will und
oubtedly have copyright implications.
For example,

the iSchool uses calendar software named WebEvent™ to enable students
and faculty to make room reservations. The current license agreements might have to be
extended to allow an archival copy to be made, particularly if the source code had to be
altered
in the process.


Appraisal Decisions.


The team's recommendation for collecting the iSchool Web site integrates
solutions to some of the technical and legal issues raised during the appraisal process and
the team's meeting with the iSchool staff. In par
ticular, they address concerns about the
D
-
Space Proposal
15

IP and privacy rights of the students and faculty. For example, to present as complete a
picture of the iSchool Web site as was possible, the team decided that it was necessary to
capture and preserve faculty and s
tudent produced content. It was determined, however,
that access to this content would be restricted until any legal issues are resolved. To avoid
potential copyright problems, the team also decided to exclude the content in any external
links. Additiona
lly, to avoid potential copyright violations, the content of any Web pages
that used proprietary software would not be captured. The School's two online
publications,
PCS Newsletter

and
Connections
, do not appear to be updated on a regular
basis and are al
so distributed in print. For these reasons, their electronic collection was
deemed unnecessary. The team also decided to exclude from collection the content of
iSchool listservs as well as the JobWeb database which may contain copyrighted
information.



T
he team also used information gained during the appraisal process to determine a
schedule for capture of the Web site. The frequency of capture will vary for different
parts of the site, but all of the pre
-
selected archival domain should be collected at t
he end
of each semester, that is, three times a year. In addition, the
News and Events

directory
should be collected once a month; a period that corresponds to the frequency with which
the content changes. Should the iSchool faculty decide to make course

materials and
syllabi available for public use through DSpace, it would be prudent to conduct a second
appraisal of this content to ensure that it is adequately captured. The team had hoped that
archiving activities could run parallel with current backup

routines (see Appendix D for a
description of the server backup procedure). Based on information gained from the site
administrator and Web master, however, the proposed archival capture schedule does not
parallel the current server backup schedule; sepa
rate jobs will have to be run to collect
content for DSpace.


The team's initial appraisal of the Web site was done to identify the domain of the
web site that would be of archival value and to determine an approximate schedule for
collecting that domain.

Once the DSpace repository is fully implemented, appraisal of
the Web site should become a continuous process based in part on usage statistics for the
archival collection. Of course, major additions to, deletions from, or re
-
designs of the
site will de
mand a full reappraisal.



Implementing a DSpace Repository at the iSchool


Policy and Procedures




Having completed an initial appraisal of the iSchool Web site and implemented
the DSpace testbed, the team turned its attention to the development of a con
cept for the
establishment of a fully
-
functional DSpace repository at the School. The project team's
review of ongoing Web archiving initiatives was very enlightening as it revealed the need
to impose key archival considerations at the very beginning of t
he project. The first goal
of the Web site archiving project is to gather a complete and representative record of the
content and functions of the iSchool Web site. The complexities of Web site archiving,
D
-
Space Proposal
16

especially the challenges presented by intellectu
al property (IP) and privacy
considerations, suggest that this goal is best approached in two distinct phases. Phase I
will entail the capture and archiving of the core of the iSchool Web site for the future use
of iSchool faculty, staff, and students (ad
ministrative and pedagogical). To ensure the
collection of an informative sample of the Web site, this capture would include individual
course Web pages and student organization Web pages although access to these pages
would be restricted until IP and pri
vacy issues are resolved. Phase II, as presently
envisioned, would open the DSpace repository to faculty and students at the iSchool who
wish to have their Web sites preserved in an archival repository. Deposit of student or
faculty Web sites in DSpace w
ould ensure their fully
-
functional accessibility beyond the
time period already provided by the iSchool server backup schedule.


In Phase I particularly, collection scheduling will require very close coordination
with the iSchool server administrator and

the Web Master as well as other members of
the staff and faculty who participate in the production of Web site content. The
collection of Web resources that contain IP and information about individuals (e.g.,
course syllabi, research reports, and biograp
hical or contact information for faculty and
students) will have to be managed through a series of individual agreements that comply
with UT’s current IP and privacy policies.


Phase I will also establish the level of resource commitment required from the

iSchool to establish a useful research and historical repository. The iSchool's position at
the forefront of archival and preservation and conservation (P&C) academic programs
will demand adherence to the most stringent archival and P&C standards and pra
ctices in
the establishment and maintenance of the iSchool Dspace repository. To accomplish this,
the iSchool will have to approach the project from three distinct viewpoints
-

community
,
collection management
, and
commitment
.


Community.
The DSpace user

community (the iSchool) will be responsible for
defining the repository’s operational policies and procedures. Key decisions include
what digital assets will be stored, by whom, and for whom. DSpace allows digital assets
to be aggregated into logical col
lections to facilitate their management and access. It is
possible for each collection to have a customized Web home page that describes the
collection in terms of its contents, identified user community, and terms of use. Initially,
the iSchool DSpace r
epository would have a single collection


iSchool Web sites.


Collection management.

In the DSpace domain, there are three types of users
--

the asset producer, the administrator, and the asset consumer. The
producer

(also
referred to as the creator, pu
blisher, or submitter) submits objects to the collection in
accordance with an agreement established between him or her and the repository. This
agreement takes the form of a SIP Agreement similar to the sample at Appendix A. The
SIP Agreement is a contr
act that defines the metadata that will be submitted with the
archival bitstream to ensure proper management of the collection, permissible content,
the bitstream format of the submission, the submission mechanism and frequency, access
restrictions, terms
for asset withdrawal, an authorization policy for the archival workflow,
D
-
Space Proposal
17

preservation terms, and the expected “level of service”
13

to be delivered by the
repository. In Phase I, the producer would be the person ultimately responsible for the
administration
, content, and format of the iSchool Web site. In Phase II, a student or
faculty submitter would have to be willing to sign and adhere to a similar agreement.


A producer who wishes to submit material will normally sign a Non
-
Exclusive
Distribution Licens
e (see Appendix B) that grants the repository the right, through a
formal asset transfer, to preserve, copy, and distribute (within the terms of the agreement)
their IP. At a minimum, there must be an agreement between the producer and the
repository mana
ger that establishes the archival management terms that will ensure
preservation of the assets. The producer must also secure permission from the repository
manager to physically transfer the digital object to the repository, either by using the Web
interf
ace or through batch processing. In Phase I, the project team intends to execute a
batch upload to DSpace of the iSchool Web site components appraised to be within the
DSpace domain.


Collection management is primarily the responsibility of the DSpace rep
ository
administrator
who is both a facilitator and executor. He or she is responsible for
maintenance functions that include configuring the collection home pages, updating
metadata and bitstream registries, establishing security procedures, and ensuring

adherence to the overall collection policy. Customer service duties might include
training and a potential helpdesk role. Carrying out the administrator's duties requires
close coordination with the IT staff. Technical support for Dspace includes the l
oading
of new software versions, establishing a program for system backup, and the
development of a disaster recovery plan. IT staff will also play a significant role in the
planning and execution of preservation functions to include refreshing media, vig
ilant
monitoring of data formats for viability, and the transformation of AIPs for preservation
using migration or emulation tools.



The DSpace administrator is also responsible for approving the accessioning of
items submitted to DSpace. In this gateke
eper role (which can be delegated to a
collection manager) the repository administrator confirms that the submitted item is
appropriate to the collection, that proper metadata has been submitted with the object,
and that the bitstream format is supported b
y DSpace. Items may travel through many
stages in a workflow in the repository, including passing through the hands of other
authorized users, before the administrator finally approves ingest of a submitted item. .


Consumers.
Access to the iSchool’s DS
pace digital assets can be global or by
registration. Access is fully Web
-
enabled and is executed using a Web browser. If
global access is allowed to the DSpace Web site, access to individual communities,
collections, and objects can be restricted. For
registered users, DSpace provides a user
name that allows access through a password authenticator system. The DSpace



13

There are three “levels of service” acknowledged by digital archival repositories: retain the experience of
the object


its original
look and feel; retain the content with some degradation of the form; and lastly,
retain the original bitstream with no guarantee of future access. All three levels are dependent on metadata
in varying degrees; more metadata should ensure that more of the
asset’s form and content are preserved.

D
-
Space Proposal
18

administrator is responsible for assigning proper security and access rights to each
registered user.
Assets in DSpace collections are nor
mally discovered by searching or
browsing the collection through a Web browser.
Hits

are presented in a result set that
offers a terse description of each item. After item selection, an overview page offers
more detailed information about the asset, such

as author, date of issue, file format,
collection information, and so forth. The user then simply clicks to download the DIP,
which is a copy of the AIP, to their client machine. The consumer may elect to
authenticate the distributed object by reconcil
ing its MD5 checksum. At some point, the
iSchool DSpace could conceivably push newly submitted information to registered users
of collections, as defined in their user agreement.




Technology



The DSpace testbed.
As mentioned earlier in our proposa
l, DSpace is an evolving
system. During the establishment and use of the testbed, the team encountered technical
problems of varying magnitude. The DSpace developers encourage feedback from their
user community and the team will apprise them of the follo
wing findings.


During installation, the iSchool system administrator was stymied on several
occasions due to poorly written installation instructions involving the installation of a
fairly large suite of prerequisite open source software products. He dr
ew on his
knowledge of the individual applications and prior installations to successfully create the
DSpace repository, but this experience suggests that all future releases and version
upgrades from DSpace be tested thoroughly before they are implemented
.


Of larger immediate importance, the team discovered that DSpace is not yet
capable of supporting Web site functionality. The original system design accommodates
individual academic publications or documents that do not have complex relationships
within

or among them. The DSpace developers have acknowledged this deficiency and
are researching metadata alternatives, beyond Dublin Core, that will establish functioning
relationships between files. At present, the individual components of the iSchool Web
s
ites can be submitted for long
-
term preservation and access but the experience or “look
and feel” of the sites cannot be recreated directly from the repository.


To be considered a long
-
term archival custodian of digital records, a DSpace
repository must
deal effectively with asset preservation. At present, DSpace offers a
secure environment in which to store digital assets. It depends on metadata to cope with
eventual migration or emulation activities. The software also creates a history log for
AIPs th
at addresses provenance concerns by creating snapshots of events, such as asset
modification and deletion, changes to associated asset metadata, and persistent handle
assignment.


These tools are the anticipated components of a preservation management stra
tegy
that does not yet exist. In the future, we envision a preservation process in which
metadata is used to identify AIPs requiring attention and a copy of each selected AIP
bitstream is migrated to a new format using a common conversion program. Metada
ta
D
-
Space Proposal
19

regarding the migration would be created and captured along with information written to
the history log. The updated bitstream would be ingested as an AIP, resulting in the
storage of the original, unaffected bitstream and a bitstream in an accessible
version.
Users would be able to select from any of the asset’s versions with the caveat that the
most recent version may be the only one readable within DSpace or any other platform.



Despite its shortfalls, the team is convinced that DSpace offe
rs the ISchool a
viable digital repository solution. Its strengths lie in its open source suite of tools, its
expanding user community across a broad base of institutions, and the DSpace
development team’s commitment to making the system a sustainable sol
ution for the
long
-
term management of digital assets.



Hardware and software requirements.

Based on the initial testbed
implementation of DSpace and the Web site appraisal, the project team developed a list
of hardware, software, and system requirements
for establishing a fully
-
functional
DSpace repository at the iSchool. Hardware requirements are minimal and include: a
server that is powerful enough to run DSpace, one tape drive, and a tape supply adequate
for the proposed content capture and DSpace bac
kup schedules. Software requirements
include: a Unix
-
like operating system
14
, Java 1.3+, Tomcat 4.0+, Apache 1.3, Ant 1.4,
and PostgreSQL 7.3+
15
. The system administrator has already downloaded and installed
this software to establish the DSpace testbed.


Personnel.
A continuous level of personnel support will be required for system
operation and maintenance. The team anticipates that DSpace operational support will be
provided by faculty and students at the iSchool as part of their academic activities.
Some
support will also be required from the iSchool staff. Administration and faculty will need
to be involved in the development of iSchool DSpace policies and procedures as well as
appraisal decisions. Collection of Web site content and maintenance of
DSpace will
require coordination with and support from the IT staff. Routine maintenance
requirements are small, but like any collection of electronic files, DSpace will require
back
-
up and version updates will need to be done on an occasional basis. Beca
use
DSpace is an archival repository, the archived files that have been transferred to static
media will need to be refreshed from time to time, and the migration of some files may be
necessary if their formats become obsolete. Performance
-
monitoring will

be needed to
ensure that DSpace is running correctly at all times. Maintenance of the archival assets
will be done by students and faculty, but the technical assistance of IT staff may be
required. The team anticipates that training of students, faculty,
and staff in the use of the
DSpace repository will be a collaborative effort but that the training program should be
integrated with the existing instructional schedule of the IT Lab.









14

The iSchool system administrator found that the current version of DSpace runs best on the Debian
distribution of Linux.

15

A full list of software requirements and installation steps is available at
http://dspace.org/technology/system
-
docs/install.html#prerequisite
.

D
-
Space Proposal
20

Benefits of Establishing a DSpace Repository at the iSchool


Dire
ct benefits to iSchool academic programs


Establishment of a DSpace digital repository at the iSchool would benefit all of
the School’s academic programs. Specific programmatic benefits include digital
preservation and conservation; digital media archivin
g; electronic record management;
information architecture development; and digital collections development. For example,
creating a retrospective archive of iSchool Web sites (from 1996 to the present) would
provide a longitudinal research tool for histor
ical investigation of technological,
academic, and social developments at the institution. Through adept marketing, the
iSchool DSpace repository could attract students and faculty interested in working on the
cutting edge of digital object management and

digital repository design. Graduating
students, fully versed in the workings of DSpace, should have a competitive edge in their
search for a career as information professionals in the digital world.


Other benefits may be realized as DSpace usage expand
s and evolves at the
iSchool. For example, it is MIT’s goal to prove that scholarly works authored in digital
media can be authenticated and preserved in a way that elevates them to a status equal to
works published in traditional media. This is a goal t
he iSchool could share. The
assignment of persistent identifiers within DSpace also guarantees that digital works will
not become inaccessible due to “link rot.” Faculty and students at the IS may elect to
submit their scholarly work and training material
s to DSpace to relieve themselves of the
burden of long
-
term digital asset preservation. A potential “fee for service” program
might be established to enable students or faculty who leave the School to continue use of
the repository.


Opportunities for D
isciplinary Leadership


With its focus on ensuring long
-
term access to digital objects, DSpace
compliments and supports the efforts of the UT Knowledge Gateway initiative
3

by
providing a secure means for delivering archival content to the public. Establish
ment of a
Dspace repository could enable the iSchool to assume the lead in developing techniques,
procedures, and policies for digital resources management at the University of Texas
(UT). Participation in the DSpace consortium would elevate the iSchool to

the rank of
leading digitally
-
progressive institutions such as MIT, Columbia, and Toronto. The
School might also consider breaking new ground in the provision of digital archiving
services at UT by establishing a pay
-
for
-
service trusted digital repositor
y in collaboration
with the UT General Libraries.


Conclusion



Establishment of a DSpace repository at the iSchool for archiving Web sites will
require a steady but fairly small commitment of resources and administrative support.
The School's level of
commitment can be determined by the value the administration
places on the contents of the archival repository. If the iSchool is to become a trusted
D
-
Space Proposal
21

repository for long
-
term preservation of faculty, student, or client assets, however, the
level of commit
ment must be much greater. A trusted institutional repository is a “series
of managed activities” (Russell, 2000) that demands sufficient resources, both human and
technical to ensure its long
-
term viability. The iSchool must support the enterprise
wholeh
eartedly, ensuring that DSpace is supported adequately to ensure trustworthy
operations regardless of the prevailing economic climate. It is Clifford Lynch’s fear that
the public trust in institutional repositories will be eroded due to flimsy policy,
man
agement failure, or technical issues

(Lynch, 2003). If the iSchool wishes to
participate meaningfully in the creation of public trust, it must be vigilant in upholding
any pledge to ensure long
-
term preservation of, and access to, digital assets in its ca
re.


D
-
Space Proposal
22

References



Berners
-
Lee, T., Hendler, J., & Lassila O. (2001, May) The Semantic Web.
Scientific
American.Com
. Retrieved on February 1, 2003 from
http://w
ww.sciam.com/article.cfm?articleID=00048144
-
10D2
-
1C70
-
84A9809EC588EF21


Cedars Project. (2002, March).
The Cedars guide to digital collection management
.
Retrieved May 1, 2003 from
http://www.leeds.ac.uk/cedars/guideto/collmanagement/guidetocolman.pdf



Consultative Committee for Space Data Systems. (2002, January).
Recommendation for
space data
system standard: Reference model for an open archival information
system (OAIS)
. CCSDS 650.0
-
B
-
1 Blue Book. Retrieved October 3, 2002 from
http://ccsds.org/documents/650x0b1.pdf


Hakala, J. (2001, Apr
il 15). Collecting and preserving the Web: Developing and testing
the NEDLIB harvester.
RLG Digi News, 5
(2). Retrieved March 4, 2003 from
http://www.rlg.org/preserv/diginews/digine
ws5
-
2.html#feature1


Lefurgy, W. G. (2001, April). Records and Archival Management of World Wide Web
Sites.
Government Record News
,
2.

Retrieved March 02, 2003 from
http://www.mybestdocs.com/le
furgy
-
w
-
grn0104.htm


LeFurgy, W. G. (2002, May). Levels of service for digital repositories.
D
-
Lib Magazine,
8
(5). Retrieved February 19, 2003 from
http://www.dlib.org/dlib/may02/lefu
rgy/05lefurgy.html


Lynch, C. (2003, February). Institutional repositories: Essential infrastructure for
scholarship in the digital age.
ARL Bimonthly Report 226
. Retrieved April 24,
2003 from
http:/
/www.arl.org/newsltr/226/ir.html


Russell, K. (2000, December).
Digital preservation and the CEDARS project experience
.
A paper presented at Preservation 2000: An international conference on the
preservation and long term accessibility of digital materia
ls, December 7
-
8, 2000,
York, England. Retrieved February 13, 2003 from
http://www.rlg.org/events/pres
-
2000/russell.html


University of Texas System Office of the General Counsel. (2002, Ma
y).
Intellectual
property
. Retrieved May 9, 2003 from
http://www.utsystem.edu/ogc/intellectualproperty/INDEX.HTM


Upward, F. (1996, November). Structuring the records continuum. Pa
rt one: Post
-
custodial principle and properties,
Archives and Manuscripts, 24
(2), 268
-
285.


D
-
Space Proposal
23

Upward, F. (1997, May). Structuring the records continuum . Part two: Structuration
theory and record keeping,
Archives and Manuscripts, 25
(1), 10
-
33.

D
-
Space Proposal
24

Recommended

Reading List


Arms, W. (2001, September 3).
Web Preservation Project Final Report
. Retrieved
March 4, 2003 from
http://www.loc.gov/minerva/webpresf.pdf



Arms, W., Adkins, Y. R., Ammen, C., & Hayes,
A. (2001, April 15). Collecting and
preserving the Web: The Minerva prototype.
RLG Digi News, 5
(2). Retrieved
March 4, 2003 from
http://www.rlg.org/preserv/diginews/diginews5
-
2.htm
l#feature1



Arvidson, A., Persson, K., & Mannerheim, J. (August, 2000).
The Kulturaw3 Project


The Royal Swedish Web ARchiw3e


an example of “complete” collection of web
pages
. A paper presented at the 66
th

IFLA council and general conference,
August
13
-
18, 2000, Jerusalem. Retrieved March 4, 2003 from
http://www.ifla.org/IV/ifla66/papers/154
-
157e.htm



Bass, Michael, et al. (2002)
DSpace


A sustainable solution for institutional digital

asset
services


spanning the information asset value chain: ingest, manage, preserve,
disseminate. Internal reference specification: Functionality
. Retrieved February
9, 2003 from the DSpace Web site at
http://dspace.org/technology/functionality.pdf


Bergman, M. (2001, August). The deep web: Surfacing hidden value.
The Journal of
Electronic Publishing 7
(1). Retrieved March 14, 2003 from
http://www.press.umich.edu/jep/07
-
01/bergman.html


Brewster, K. (2002, June 15). Editor’s Interview: An interview with the Brewster Kahle.
RLG Digi News, 6
(3). Retrieved March 29, 2003 from
http://www.rlg.org/preserv/diginews/v6
-
n3
-
a1.html


Brown, R. (1999).
Making Choices and Assigning Values: Macro
-
Appraisal in a Shared
Accountability Framework for Government Record
-
Keeping
. Retrieved March 20,
2003 from
http://rikar.org/archivist/bbs/data/a_pds/files/20011030195929/RBrown.rtf


Day, M. (2003, February 25).

Collecting and preserving the World Wide Web.
Retrieved
March 12, 2002 from the Wel
lcome Trust Web site at
http://library.wellcome.ac.uk/projects/archiving_feasibility.pdf



DSpace.
DSpace Home Page
. Retrieved February 3, 2003 from
http://www.dspace.org
.





Dudley, B. (2003, January 9). New technologies smarten everyday objects at CES.
The
Seattle Times
. Seattletimes.com. Business and Technology. Retrieved February 5,
2003 from
http://seattletimes.nwsource.com/html/microsoft/134612048_ces09.html



D
-
Space Proposal
25

Haffner, K., & Lyon, M. (1996).
Where wizards stay up late: The origins of the Internet
.
New York: Simon & Schuster.


Henricksen, K., & I
ndulska, J. (2001).
Adapting the Web interface: An adaptive Web
browser
. IEEE. Retrieved March 22, 2003 from the University of Queensland,
Department of Computer Science and Electrical Engineering Web site at
http://www.dstc.edu.au/m3/papers/AUIC2001.pdf



Imperial College Department of Computing. (n.d.). FOLDOC: Free on
-
line dictionary
computing. Retrieved March 19, 2003 from
http://fol
doc.doc.ic.ac.uk/foldoc/index.html


Internet Archive (2001, March).
Internet Archive Home Page
. Retrieved March 4, 2003
from
http://www.archive.org



Sun Microsystems, Inc. (2003, February 28) Java programming langua
ge basics.
Java
Technology Fundamentals Newsletter
. Retrieved March 14, 2003 from
http://developer.java.sun.com/developer/onlineTraining/new2jav
a/supplements/20
03/Feb03.html#top


Kanter, T. G. (2003). Going Wireless, enabling an adaptive and extensible environment.
Mobile Networks and Applications,

8
, 37

50. Retrieved February 15, 2003 from
Kluwer Online at
http://doi.acm.org/10.1145/603901.603905


Leiner, B., et al. (2000, August 4).
A brief history of the Internet
. Retrieved March 14,
2003 from the Internet Society (ISOC) Web site at
http://www.isoc.org/internet/history/brief/shtml


National Archives of Australia (2000).
Archiving Web resources: Guidelines for keeping
records of Web based activity in the Commonwealth government
. Retrieved
March 4, 2003 from
http://www.naa.gov.au/recordkeeping/er/web_records/guide_contents.html


National Library of Australia (2001, July).
Pandora Archive: Preserving and accessing
networked documentary resourc
es of Australia
. Retrieved March 4, 2003 from
http://pandora.nla.gov.au/bpm.html#intr



Office of the Vice President for Resource Development (2002, March). UT Austin
president unveils UT Knowledge Ga
teway initiative. Retrieved April 24, 2003
from
http://www.utexas.edu/supportut/news_pub/gateway.html
.


Public Record Office. (2003).
Digital preservation: PRONOM
. Retrieved March 18,

2003 from the Public Record Office, Digital Preservation Web page at
http://www.pro.gov.uk/about/preservation/digital/pronom.htm



D
-
Space Proposal
26

Schechter, B. (2001, September 25). Real
-
life Cyb
org challenges reality with technology.
The New York Times Online
. Retrieved March 20, 2003 from
http://wearcam.org/seatsale/nytimes/25CYBOprinter.html



Staff Writer. (2003, February 1
5).
Mpulse: A cooltown magazine
. Hewlett
-
Packard
Company. Retrieved February 5, 2003 from the Hewlett
-
Packard Web site at
http://cooltown.hp.com/mpulse/backissues/0601/0601
-
coolt
own.asp



Suryanarayana, L., & Hjelm, J. (2002, May).
Profiles for the situated Web
. A paper
presented at WWW2002, May 7
-
11, 2002, Honolulu, HI. Retrieved March 18,
2003 from
http://www2002.org/CDROM/
refereed/214/


University of Texas. (2003).
University of Texas Knowledge Gateway Home Page.

Retrieved May 5, 2003 from
http://gateway.utexas.edu/
.
https://www.techylib.com/en/view/flameluxuriant/proposal_for_establishment_of_a_dspace_repository_at_the_school_o
www.techylib.com
crawl=CC-MAIN-2017-34
115998
application/http; msgtype=response
sha1:2GBSR52HVSTTHZ7P2KJTPXFVMELGMQV7
<urn:uuid:95df2cb2-8f1b-40e0-ba3e-fccfe6dbb416>
2017-08-21T06:34:26Z
54.243.162.245
application/xhtml+xml
sha1:A4BVNN7XNQFLV67ANLAKVU7GE7T6G25A
<urn:uuid:63e890a0-e797-42db-99d0-39aa348a115f>
https://www.techylib.com/en/view/flameluxuriant/proposal_for_establishment_of_a_dspace_repository_at_the_school_o
length
response
<urn:uuid:017e4e49-713b-45a6-bebe-31b41791f85b>
robots: classic
hostname: ip-10-145-155-168.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-34
operator: Common Crawl Admin
description: Wide crawl of the web for August 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf