23 Research Things – Thing 19

Today I’ll be talking very briefly about text and data mining. My post will be short because this is not a technique I’ve used myself and I have no experience of it, although some of the researchers I’ve supported it have made use of data mining themselves. I think it has the potential to be a very useful research tool, but its limitations, covered in the presentation/transcript for today’s portion of the Research Things programme, may represent a significant hindrance. If text and data mining techniques cannot be used in the majority of key databases (those used by a majority of researchers in various fields), this is a severe drawback. Until this copyright issue is resolved, text and data mining should be used with care. As suggested in the presentation, it’s probably worth getting in touch with the team at ContentMine to check that you are applying text and data mining techniques correctly and complying with copyright.

About thelibrarianerrant

I'm a senior library assistant in one of the faculty libraries of the University of Cambridge. My posts here are in a personal capacity, and are on any topics relating to library and information services.
This entry was posted in resources and tagged . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s
https://thelibrarianerrant.wordpress.com/2016/11/23/23-research-things-thing-19/
thelibrarianerrant.wordpress.com
crawl=CC-MAIN-2018-13
65421
application/http; msgtype=response
sha1:VRACQFN5DQXZTJMUJMBPCF4YQXXHU37F
<urn:uuid:6917067f-a077-4da4-a5e0-b893f3390e59>
2018-03-20T19:05:50Z
192.0.78.13
text/html
sha1:THFBONYGODEUPXGJNHR74KASNUUJVQ7A
<urn:uuid:be215752-977b-4bd6-8b52-ed1a2c6e5404>
https://thelibrarianerrant.wordpress.com/2016/11/23/23-research-things-thing-19/
length
response
<urn:uuid:1c1fcb02-0c4a-47f9-b4e9-7c45a929c123>
robots: classic
hostname: ip-10-229-203-126.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2018-13
operator: Common Crawl Admin
description: Wide crawl of the web for March 2018
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf