A. Britton http://blogs.harvard.edu/britton I'm a librarian and archivist working on open access and digital preservation. Tue, 08 Oct 2019 13:04:12 +0000 en-US hourly 1 https://wordpress.org/?v=4.8.1 http://blogs.harvard.edu/britton/files/2019/09/Screen-Shot-2019-09-06-at-7.28.59-AM.png A. Britton http://blogs.harvard.edu/britton 32 32 https://creativecommons.org/licenses/by-nc-nd/4.0/ Anniversaries of Open Access Policies http://blogs.harvard.edu/britton/2019/10/08/anniversaries-of-open-access-policies-2/ http://blogs.harvard.edu/britton/2019/10/08/anniversaries-of-open-access-policies-2/#respond Tue, 08 Oct 2019 11:15:26 +0000 http://blogs.harvard.edu/britton/?p=144 A dynamic list of more than 650 open access polices and their dates of adoption can be found in Wikidata: https://w.wiki/8DF. The list contains many facts first collected in the UK-based Registry of Open Access Repositories Mandates and Policies (ROARMAP).

Czech Academy of Sciences example

According to the list, the Czech Academy of Sciences adopted an open access policy on 14 October 2010. To verify the date I followed the ROARMAP link:
http://roarmap.eprints.org/99/

…which led to a broken link to the policy:
http://www.cas.cz/o_avcr/zakladni_informace/dokumenty/politika-otevreneho-pristupu.html

The Internet Archive’s Wayback Machine has a copy of the policy as it appeared online in 2016:
https://web.archive.org/web/20160305014822/http://www.avcr.cz/o_avcr/zakladni_informace/dokumenty/politika-otevreneho-pristupu.html

In Wikidata, I added the Waybacked URL as a reference, along with the Czech-language policy title.
https://www.wikidata.org/w/index.php?title=Q42297364&type=revision&diff=1027885811&oldid=728433059

Then I turned to the Wikidata item for the Czech Academy of Sciences:
https://www.wikidata.org/wiki/Q374686

…and added the date of the policy as a “significant event” in the history of the academy.

https://www.wikidata.org/wiki/Property:P793

https://www.wikidata.org/w/index.php?title=Q374686&type=revision&diff=1027888236&oldid=1004027816

 

In English-language Wikipedia, I added a “History” section to the Czech Academy of Sciences article and sentence about the OA policy.
https://en.wikipedia.org/w/index.php?title=Czech_Academy_of_Sciences&type=revision&diff=920220137&oldid=918041186

As a reference, I used a Waybacked copy of an OpenAire country profile from 2016, found by following links in the Wikidata item for open access in the Czech Republic.
https://www.wikidata.org/wiki/Q56064875

https://web.archive.org/web/20160805223240/https://www.openaire.eu/oa-czech

 

Want to contribute? Get started here. 

 

]]>
http://blogs.harvard.edu/britton/2019/10/08/anniversaries-of-open-access-policies-2/feed/ 0 https://creativecommons.org/licenses/by-nc-nd/4.0/
Update: Open-Access Society Publishers in Wikidata http://blogs.harvard.edu/britton/2019/09/11/update-open-access-society-publishers-in-wikidata/ http://blogs.harvard.edu/britton/2019/09/11/update-open-access-society-publishers-in-wikidata/#comments Wed, 11 Sep 2019 21:04:05 +0000 http://blogs.harvard.edu/britton/?p=87 As described in my post of 6 September 2019, I am working on adding SOAR Catalog references to Wikidata. Here is an ongoing list as of 11 September 2019. It will be revised in the near future.

 

]]>
http://blogs.harvard.edu/britton/2019/09/11/update-open-access-society-publishers-in-wikidata/feed/ 1 https://creativecommons.org/licenses/by-nc-nd/4.0/
Open-Access Society Publishers in Wikidata http://blogs.harvard.edu/britton/2019/09/06/open-access-society-publishers-in-wikidata/ http://blogs.harvard.edu/britton/2019/09/06/open-access-society-publishers-in-wikidata/#respond Fri, 06 Sep 2019 12:47:37 +0000 http://blogs.harvard.edu/britton/?p=57 In September 2013 Caroline Sutton, Peter Suber, and Amanda Page launched a third edition of the Society Open Access Research (SOAR) Catalog. As of 2019 it exists online as a continuously updated Google spreadsheet.

Recently I chatted with the catalog’s editors and began an independent, volunteer effort to amplify the carefully maintained contents of this list via the public-domain knowledge base Wikidata. My project aims to include a reference to the SOAR Catalog in each relevant Wikidata society and journal entry. Below is a description of the steps involved and some of the issues that have arisen so far.

PREPARATION

To find out which societies already had representation in Wikidata, I downloaded the SOAR Catalog as a CSV file, then imported it to a new Google sheet. Each row in the Google spreadsheet was assigned a unique identifier.

The SOAR editors had entered society names in abbreviated form, so I changed each name to its fullest form. For example “Soc” was changed to “Society” and “Amer” to “American” and so on.

The revised spreadsheet was downloaded as a CSV file, then uploaded to OpenRefine as a new project.

OPENREFINE

In OpenRefine I reconciled the society names against Wikidata. The retrieved information was saved as a new column “Q” in OpenRefine. Wikidata items were found for 526 societies, roughly half the total on the SOAR list.

Names were reconciled as type “organization” (Q43229, including subclasses “learned society”, “scientific society”, “association”, etc.), and then again as no type. During the reconciliation process, sometimes a society had multiple Wikidata items which I then examined and merged into one.

I exported the revised data as a CSV file, then imported it back to the Google sheet.

ANALYSIS

In the Google spreadsheet, I then analyzed the full catalog of 1,043 journals to find patterns. Were there some societies that published more journals than others? What was the geographic distribution by country? When was the catalog data last updated?

I found roughly 881 unique societies listed in the SOAR Catalog.

The following Google Sheets functions were useful:
=UNIQUE
=VLOOKUP

A few of the journals with multiple publishers had been entered into single cells. The journal Psychology, Community, and Health, for example, is published by the “SPPS – Sociedade Portuguesa de Psicologia da Saúde, SPPC – Sociedade Portuguesa de Psicologia Comunitária, SPSC – Sociedade Portuguesa de Sexologia Clínica, ISPA – Instituto Universitário”. The format of this data is not easily searchable as is, and should be parsed into several cells for each publisher name.

WIKIDATA

For societies not found through OpenRefine reconciliation, I searched each name individually in Wikidata, and if found, added those Q identifiers to my spreadsheet. If not found, I created new Wikidata items. Some of the society websites required a bit of foreign language translating. To create a new item for the Croatian Physical Society, for example, I verified the society website and double-checked spelling in Croatian (“Hrvatsko fizikalno društvo”). Google Translate came in handy, as did the internet browser’s developer page source view.

As of this writing, some eight new Wikidata items have been created for societies (Q67167604, Q67167730, Q67167802, Q67167898, Q67167964, Q67168062, Q67168156, Q67168296). It will take some time to finish the remaining 350 names on the list.

QUICKSTATEMENTS

The tool QuickStatements was used to annotate Wikidata with references. The CSV-formatted syntax looks like this:

qid,P31,Q45400320,S248,Q55823083,s585
Q1376656,P31,Q45400320,S248,Q55823083,+2019-00-00T00:00:00Z/9
Q8035326,P31,Q45400320,S248,Q55823083,+2019-00-00T00:00:00Z/9

RESULTS

A dynamic list of societies in Wikidata with references to the SOAR Catalog can be found here: https://w.wiki/8Cw

NEXT STEPS

The next phase of this effort will address Wikidata representation of the 1,043 journals listed in the SOAR Catalog.

RECOMMENDED RESOURCES

OpenRefine reconciliation guide by Antonin Delpeuch
https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation

OpenRefine Google group
https://groups.google.com/forum/#!forum/openrefine

Google Sheets function list
https://support.google.com/docs/table/25273

QuickStatements help
https://www.wikidata.org/wiki/Help:QuickStatements#Add_statement_with_sources

Societies and Open Access Research project, part of the Harvard Open Access Project
bit.ly/hoap-soar

 

 

]]>
http://blogs.harvard.edu/britton/2019/09/06/open-access-society-publishers-in-wikidata/feed/ 0 https://creativecommons.org/licenses/by-nc-nd/4.0/
http://blogs.harvard.edu/britton/feed/
blogs.harvard.edu
crawl=CC-MAIN-2019-43
20134
application/http; msgtype=response
sha1:K7ZGNUW6HXWIIPAMBEYAWSEA64EUSBCQ
<urn:uuid:62a611a2-172f-4548-8fbf-b3ba0a9fe488>
2019-10-22T22:51:25Z
128.103.64.114
application/rss+xml
sha1:5ILVB4EH5MZPDN6OJ7F3FR4JUVLLQWK6
<urn:uuid:aad1c0f3-b337-41d4-816b-379524bfc7b9>
http://blogs.harvard.edu/britton/feed/
response
<urn:uuid:d2bd02a2-f9b8-492e-961e-e47eb61bbf0d>
isPartOf: CC-MAIN-2019-43
publisher: Common Crawl
description: Wide crawl of the web for October 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-141.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/