Data mining for scholarly journals: challenges and solutions for libraries

SPEIRS, Martha A. (2013) Data mining for scholarly journals: challenges and solutions for libraries. Paper presented at: IFLA WLIC 2013 - Singapore - Future Libraries: Infinite Possibilities in Session 165 - Serials and Other Continuing Resources.

Bookmark or cite this item: http://library.ifla.org/id/eprint/148
[img]
Preview
Language: English (Original)
Available under licence Creative Commons Attribution.

Abstract

Data mining for scholarly journals: challenges and solutions for libraries

As our global knowledge environment changes and the information to be found in scholarly journals becomes increasingly available in digital format, it is necessary to employ more and more sophisticated search and retrieval procedures to mine this knowledge. We have large holes in our globally accessible knowledge base as traditional web-crawlers cannot collect and assess all of the serially produced papers, articles and journals that exist. Many search engines only touch the surface and they cannot harvest potentially valuable information in the silos of the “deep web”. More comprehensive data mining is therefore essential if we are to effectively tap the knowledge often hidden in scholarly journals and databases. Data-mining models are being developed which aim to search all the global knowledge being produced--an essential goal that will aid in sharing and therefore accelerating global knowledge diffusion. Deep Web Technologies and World Wide Science.org are examples of ongoing efforts to assist in mining the rapidly increasing mass of serially produced scientific information. Knowledge can only be shared, advanced and accelerated if it is accessible and as users expect libraries to be ever more effective in gathering and utilizing knowledge they must serve the global community by offering the best access to and analysis of all information. This paper intends to contribute to a more comprehensive understanding of what information is potentially available and how to access and analyze it using the latest methods of information retrieval.

FOR IFLA HQ (login required)

Edit item Edit item
.
http://library.ifla.org/148/
library.ifla.org
crawl=CC-MAIN-2018-34
85517
application/http; msgtype=response
sha1:KBNKWYGF74R7TVZ3JUWYQZLBP4GWR7AQ
<urn:uuid:161484b4-5e8a-4827-be3e-b8737c0cc082>
2018-08-21T12:41:21Z
46.22.140.133
application/xhtml+xml
sha1:BFYPYHGAKO5PJYI74MN4MP2VEQ6PNU5F
<urn:uuid:a0c10bf6-f20c-452f-b797-b532e04a6a71>
http://library.ifla.org/148/
response
<urn:uuid:413ec73c-5bb1-4354-89ef-be00aee3acff>
isPartOf: CC-MAIN-2018-34
publisher: Common Crawl
description: Wide crawl of the web for August 2018
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-113-243-226.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 0.11-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/