Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Using the Web as a Data Source: Challenges for Linked Science

306 views

Published on

Short paper presented at Linked Science workshop, ISWC 2015.

http://linkedscience.org/events/lisc2015/
http://linkedscience.org/wp-content/uploads/2015/04/paper5.pdf

Published in: Science
  • Be the first to comment

  • Be the first to like this

Using the Web as a Data Source: Challenges for Linked Science

  1. 1. Using the Web as a Data Source: Challenges for Linked Science Carsten Keßler Hunter College, City University of New York http://carsten.io @carstenkessler
  2. 2. Data collection Then and now
  3. 3. http://www.sysomos.com/inside-twitter/twitter-friendship-data
  4. 4. Validity issues Sampling bias, anyone?
  5. 5. „Scottish independence referendum results“ von Brythones. Lizenziert unter CC-BY-SA 4.0 über Wikimedia Commons - https://commons.wikimedia.org/wiki/File:Scottish_independence_referendum_results.svg#/media/File:Scottish_independence_referendum_results.svg
  6. 6. Reproducibility issues The ivory tower, locked up
  7. 7. Linked Science …to the rescue?
  8. 8. Does LISC work here? • Semantic annotation, linking and archiving is problematic: • large datasets • in constant ﬂux • legal restrictions • terms of service may change at any time • legislation required to permit archiving
  9. 9. Can we ﬁx sampling bias? • Probably not, but… • need to be aware of it • if possible, test against other datasets to check for validity of conclusions • can we somehow encode this, maybe as provenance?
  10. 10. Should we enforce data publication? • Tradeoff between: • Learning about interesting new research going on at those companies, without any ability to verify or reproduce results • Implementing and enforcing strict rules for conference and journal outlets that would force authors to provide the data used in their analysis
  11. 11. Thank you. Carsten Keßler Hunter College, City University of New York http://carsten.io @carstenkessler

×
https://www.slideshare.net/c_kessler/using-the-web-as-a-data-source-challenges-for-linked-science
www.slideshare.net
crawl=CC-MAIN-2018-47
155393
application/http; msgtype=response
sha1:SI5AGGCT7ZSUEX6A3XAWQ62NNPROQW6G
<urn:uuid:bb47bb77-511d-43d3-8eec-fcb81d07dc90>
2018-11-16T10:14:30Z
108.174.10.19
text/html
sha1:XMDEQ55LT2SOGTPPWA66KBKXJWR3NJDB
<urn:uuid:f8bf9ba8-5cff-433a-9820-51271b0bae65>
https://www.slideshare.net/c_kessler/using-the-web-as-a-data-source-challenges-for-linked-science
response
<urn:uuid:414825a3-85d9-4fd9-8d4b-4258872bbc95>
isPartOf: CC-MAIN-2018-47
publisher: Common Crawl
description: Wide crawl of the web for November 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-228-195-45.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/