Data Management

The basics of data management and Resources for researchers

Library Research Guide

Back that Data Up!

You should keep three copies of your important data.

♦  1 local - on your workstation
♦  1 local/remote - an external hard drive
♦  1 remote - on a university, or department server, or the cloud

Is your data too big for that?

♦  Data compression is an option, but make sure that one copy, somewhere, is uncompressed.
♦  Use open source encryption software
♦  Document the software and version of the software you used to compress your files in your metadata

Have a Back-up Plan - and use it!

♦  Write out a schedule for updating copies of your data on your local and remote storage devices
♦  How often should you back up data? Daily? Weekly? Monthly? It depends. In the event of a disaster, how much data do you want to  re-create?  How much are you even able to re-create?
♦  Who's going to do it?  Put that in your Plan too.
http://guides.lib.k-state.edu/c.php?g=181716&p=1196411
guides.lib.k-state.edu
crawl=CC-MAIN-2019-30
133773
application/http; msgtype=response
sha1:L2NDGSVZSCT4LWSYC4MGM6RREOCJ7MBJ
<urn:uuid:85bcb772-0a63-457b-90cc-96be7a2cfb14>
2019-07-16T16:34:22Z
18.233.235.237
text/html
sha1:LMVKWOP5AOYUG2DV3QRCRZ3OB4FUL4WL
<urn:uuid:ec32c602-63dd-4354-bb9e-e519dbe4bad0>
http://guides.lib.k-state.edu/c.php?g=181716&p=1196411
response
<urn:uuid:f8252c8e-be09-44bf-93d2-cf644402aeb5>
isPartOf: CC-MAIN-2019-30
publisher: Common Crawl
description: Wide crawl of the web for July 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-180-76-105.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/