About CORE

Our Mission

CORE’s mission is to aggregate all open access research outputs from repositories and journals worldwide and make them available to the public. In this way CORE facilitates free unrestricted access to research for all.

CORE:

  • supports the right of citizens and general public to access the results of research towards which they contributed by paying taxes,
  • facilitates access to open access content for all by offering services to general public, academic institutions, libraries, software developers, researchers, etc.,
  • provides support to both content consumers and content providers by working with digital libraries, institutional and subject repositories and journals,
  • enriches the research content using state-of-the-art technology and provides access to it through a set of services including search, API and analytical tools,
  • contributes to a cultural change by promoting open access, a fast growing movement.

CORE harvests openly accessible content available according to the definition:

By 'open access' to this literature, we mean its free availability on the public internet, permitting any users to read, download, copy, distribute, print, search, or link to the full texts of these articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers other than those inseparable from gaining access to the internet itself. The only constraint on reproduction and distribution, and the only role for copyright in this domain, should be to give authors control over the integrity of their work and the right to be properly acknowledged and cited.

Testimonials


Read what others have to say about CORE

Research

Discover all CORE’s research outputs.

Join CORE

Do you have a repository or an open access journal that you would like to be included in the CORE collection? Find out how to join.

FAQs

Join CORE

Aggregation: general

Aggregation: technical

Aggregation: removing full-text

  • CORE aggregates content from repositories registered in OpenDOAR, journals registered in DOAJ or those that requested their content to be aggregated. This means that all the content sources aggregated by CORE must be open access as this is a requirement for the providers to be included in these registries. According to the official BOAI definition of open access, CORE is allowed to, "distribute, search, or link to the full texts of articles, crawl them for indexing, pass them as data to software, or use them for any other lawful purpose, without financial, legal, or technical barriers other than those inseparable from gaining access to the Internet itself. The only constraint on reproduction and distribution, and the only role for copyright in this domain is to give authors control over the integrity of their work and the right to be properly acknowledged and cited."
  • CORE’s system is fully automated and relies on data made available in a machine readable form. If your repository hosts full-text with a restrictive license that prohibits harvesting, this needs to be properly communicated in a machine readable form. All non open access items should be blocked in the robots.txt file. If this information is provided in the metadata for each record and CORE exposes the full-text, please get in touch with us.
  • CORE’s system is fully automated and relies on data made available in a machine readable form. Our system understands that the full-text of a record was removed only when the record is marked as deleted in the metadata of your repository. See how to take down full-text from CORE.
  • If there is full-text content that appears in CORE but not in the hosting service you can take it down via the CORE Repositories Dashboard anytime without notifying us. If you don’t have access to the Dashboard do get in touch.

CORE services

  • To register a new key to access the CORE API interface please use the form provided here.
  • If you plan to use the CORE API we kindly ask the following:
    • attribute CORE by including in your website ,
    • send us an email with a brief summary on how you are using the CORE API,
    • grant us permission to present this summary to our funders and/or display it on our website,
    • allow us to list your company’s name, URL and logo on our website
  • Yes, this is possible but there is usually a cost associated with it. Please email us the name of your company/organisation, business entity, the number of requests you estimate to send and how often you will send them and we will get back to your with a quote.
  • Please note the dataset has been created from information that was publicly available on the Internet. Every effort has been made to ensure this dataset contains only open access content. We have included only content from repositories and journals that are listed in registries where the condition for inclusion is the provision of content under open access compatible license. However, as metadata are often inconsistent, licensed information is often not machine readable, and repositories from time to time leak information that is not open access, we cannot take any responsibility for the license of the content in the dataset. It is therefore up to the user of this dataset to ensure that the way in which they use the dataset does not breach copyright. The dataset is in no way intended for the purposes of reading the original publications, but for machine processing only.
  • We aim to generate a new public dataset at least once a year. If you need a more recent dataset, please get in touch with us as we might be able to arrange it.
  • If you have access to the CORE Repositories Dashboard, log into the Dashboard to get the instructions on how to download the CORE Recommender. Otherwise, visit our recommender registration page, where you will also find the installation instructions.
  • The CORE recommender uses the popular content-based filtering system. The similar resources that appear in the CORE Recommender and their quality are highly impacted by the metadata information supplied by the repository of origin. If that information is incorrect or incomplete, you should contact the repository of origin. To improve the recommendations, you can use the feedback button, with which you can remove any undesirable articles.
  • CORE has around 15 terabytes (Tb) of raw textual data (metadata, pdfs, processed pdfs text), 1.5Tb of indexed data (each replica) and 1.5Tb of database data.

General information about CORE


Ambassadors

If you want to support CORE around the world please have a look at our ambassadors page.


The team

Aristotelis Charalampous Research Assistant

Aristotelis’ research focus is on helping further enhance CORE’s recommendation engine, including tasks ranging from (big) data processing to algorithm implementations that suit our needs. He is integrated with the rest of the team on testing these solutions on a daily basis on KMi infrastructure and evaluating their performance on them.

David Pride PhD student

I recently completed my MSc in Computer Science at The University of Hertfordshire. I joined the team at KMi as a PhD research student with Dr. Petr Knoth and Professor Zdenek Zdrahal as my supervisors. My thesis will expand on the original work on Semantometrics completed by Dr Knoth and Dasha Herrmannova. My areas of interest include semantics, natural language processing and text mining.

Drahomira Herrmannova PhD student & Data Analyst

Works with the rest of the team on both front- and back-end development. Enjoys maintaining and improving CORE as it provides her with useful data for her PhD. Dreams of turning CORE into a hub for Semantometric research. Book lover and sports enthusiast in her spare time.

Giorgio Basile Developer

Software developer, sports lover, chocolate addicted, table tennis world champion.

Lucas Anastasiou Lead Developer

Works on maintaining CORE service, continuously enhancing it with new features and developing new modules for it. Among the rest of the team envisions the creation of the world's largest full text open access dataset.
While not on his computer coding, he enjoys playing chess, scratching his guitar and dreams of climbing Alpe d'Huez or Col de la Madone with his bike.

Matteo Cancellieri Developer and Continuous Integration secret lover

Works on improving and and maintaining CORE services, especially in the frontend side. Once he was a Super Mario plumber.

Nancy Pontika Communications

A communications guru in the 'dominated by developers' CORE team. Her job is to liaise with the data providers and the technical group. As an open access advocate she hopes that one day there will be no access barriers to scientific literature. In her spare time she likes to swim, read and travel.

Petr Knoth Founder; Product & Team Leader

Started by developing the first CORE prototype in 2010 out of sheer frustration over the difficulty of text-mining open access papers. Responsible for leading the team, development & research effort, funding and product strategy. Believes in free unrestricted access to research for all. Excited by the opportunities of machine access to research papers to extract and create new knowledge. Green tea lover & retired ice skater.

Samuel Pearce Developer and Data & Harvesting Expert

Václav Bayer Developer & Technical Support

Works with the rest of the team on developing services for CORE and his primary focus is the front-end development. He is an avid laser tag gamer, but he also loves rafting and snowboarding.

Zdenek Zdrahal Deputy Product & Team Leader

Alumni CORE Staff

Dominika Koroncziova

Gabriela Pavel

Ian Tindle

Jakub Novotny

Magdalena Krygielova

Tomas Korec

Vojtech Robotka
https://core.ac.uk/about
core.ac.uk
crawl=CC-MAIN-2017-26
39075
application/http; msgtype=response
sha1:A4EHQPXFO3U5LRHCTG5YN7W3M4QADRR6
<urn:uuid:1807033e-795f-4ff0-be6b-74f4cfdf4d43>
2017-06-26T12:11:48Z
52.17.253.168
text/html
sha1:CAUTFOM2HC5XGTZXRLV7PUANKZEPCUQI
<urn:uuid:f5d69a70-a1e3-4476-ae06-68e44f95a015>
https://core.ac.uk/about
response
<urn:uuid:2f94ca2a-2a82-4502-b9a7-7a17ad39faa8>
robots: classic
hostname: ip-10-145-153-205.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2017-26
operator: Common Crawl Admin
description: Wide crawl of the web for June 2017
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf