May 23, 2022

CORE Becomes the World’s Largest Aggregator of Full Text Open Access Scientific Materials

From a JISC Scholarly Communications:

CORE, a global aggregator of full text open access scientific content from repositories and journals, has been growing at a fast pace over the last few months. As of May 2018, CORE has aggregated over 131 million article metadata records, 93 million abstracts, 11 million hosted and validated full texts and over 78 million direct links to research papers hosted on other websites. Our dataset of full text papers has reached 49TB.  CORE is a jointly run service between the Open University and Jisc.

2018-06-08_07-50-07[Clip]

One of the reasons why CORE has been able to put together such a large collection of content is that it supports a wide range of mechanisms of gathering the data. For example, while aggregators such as BASE rely on OAI-PMH harvesting, CORE can pull content using OAI-PMH, ResourceSync and using custom built connectors (some of which make use of CrossRef TDM API) to a variety of publishers as well as subject and preprint repositories.

Learn More, Read the Complete Blog Post

See Also: How CORE Compares (May 2018)

See Also: CORE Data Providers

About Gary Price

Gary Price (gprice@mediasourceinc.com) is a librarian, writer, consultant, and frequent conference speaker based in the Washington D.C. metro area. Before launching INFOdocket, Price and Shirl Kennedy were the founders and senior editors at ResourceShelf and DocuTicker for 10 years. From 2006-2009 he was Director of Online Information Services at Ask.com, and is currently a contributing editor at Search Engine Land.

Share
https://www.infodocket.com/2018/06/02/core-becomes-the-worlds-largest-aggregator-of-full-text-open-access-scientific-materials/
www.infodocket.com
crawl=CC-MAIN-2022-21
73087
application/http; msgtype=response
sha1:DMH5K2L6GS3R7V7RC46SQJOUZXYYQX4J
<urn:uuid:a581484f-0954-4c0d-b1bb-f6fb2a471050>
2022-05-23T21:48:34Z
104.198.101.90
text/html
sha1:5JZFLJ4FL4AI43KNES36MPZWNCHD6QBH
<urn:uuid:346a0ec3-2d8b-4e89-9dc3-f6efafa43287>
https://www.infodocket.com/2018/06/02/core-becomes-the-worlds-largest-aggregator-of-full-text-open-access-scientific-materials/
response
<urn:uuid:ae07eed5-1da8-4000-b2b7-f2a6fced0788>
isPartOf: CC-MAIN-2022-21
publisher: Common Crawl
description: Wide crawl of the web for May 2022
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-243
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.3-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/