Type of datasets

Data comes in all forms and shapes. As you’re writing your thesis, you usually encounter the following types.

Archival data

In case you want to collect your own data (e.g., using web scraping or Application Programming Interfaces (APIs)), starting with your data collection early on is crucial. When it comes to web data, please follow the suggestions in this paper and corresponding web companion. New to scraping and APIs? Check out Tilburg University’s open course on web scraping and APIs.
https://thesis.hannesdatta.com/data/datatypes/
thesis.hannesdatta.com
CC-MAIN-2024-18
7090
application/http; msgtype=response
sha1:NC3FRZB62OUVRPFAVFQUZKKQ6ELVZLCG
<urn:uuid:3a191cfd-6b82-45b2-a854-874503c20f2a>
2024-04-22T23:36:24Z
54.161.234.33
text/html
sha1:POQH7SBT5BIWXNBYQDKC7X6XATL2EMNB
<urn:uuid:b9ffba35-54de-46dc-bece-7041fea94363>
https://thesis.hannesdatta.com/data/datatypes/
response
<urn:uuid:ca5e0d85-665f-4410-9115-2176a946c3a2>
isPartOf: CC-MAIN-2024-18
publisher: Common Crawl
description: Wide crawl of the web for April 2024
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-234
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.5-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/