Measuring Scientific Broadness

Authors : Tom Price, Sabine Hossenfelder

Who has not read letters of recommendations that comment on a student’s `broadness’ and wondered what to make of it?

We here propose a way to quantify scientific broadness by a semantic analysis of researchers’ publications. We apply our methods to papers on the open-access server arXiv.org and report our findings.

URL : https://arxiv.org/abs/1805.04647

The Journal Impact Factor: A brief history, critique, and discussion of adverse effects

Authors : Vincent Lariviere, Cassidy R. Sugimoto

The Journal Impact Factor (JIF) is, by far, the most discussed bibliometric indicator. Since its introduction over 40 years ago, it has had enormous effects on the scientific ecosystem: transforming the publishing industry, shaping hiring practices and the allocation of resources, and, as a result, reorienting the research activities and dissemination practices of scholars.

Given both the ubiquity and impact of the indicator, the JIF has been widely dissected and debated by scholars of every disciplinary orientation. Drawing on the existing literature as well as on original research, this chapter provides a brief history of the indicator and highlights well-known limitations-such as the asymmetry between the numerator and the denominator, differences across disciplines, the insufficient citation window, and the skewness of the underlying citation distributions.

The inflation of the JIF and the weakening predictive power is discussed, as well as the adverse effects on the behaviors of individual actors and the research enterprise. Alternative journal-based indicators are described and the chapter concludes with a call for responsible application and a commentary on future developments in journal indicators

URL : https://arxiv.org/abs/1801.08992

Comparing scientific and technological impact of biomedical research

Author : Qing Ke

Traditionally, the number of citations that a scholarly paper receives from other papers is used as the proxy of its scientific impact. Yet citations can come from domains outside the scientific community, and one such example is through patented technologies—paper can be cited by patents, achieving technological impact.

While the scientific impact of papers has been extensively studied, the technological aspect remains largely unknown. Here we aim to fill this gap by presenting a comparative study on how 919 thousand biomedical papers are cited by U.S. patents and by other papers over time.

We observe a positive correlation between citations from patents and from papers, but there is little overlap between the two domains in either the most cited papers, or papers with the most delayed recognition.

We also find that the two types of citations exhibit distinct temporal variations, with patent citations lagging behind paper citations for a median of 6 years for the majority of papers. Our work contributes to the understanding of the technological, and societal in general, impact of papers.

URL : https://arxiv.org/abs/1804.04105

Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

Authors : Clayton T. Lamb​, Sophie L. Gilbert, Adam T. Ford

Science communication is seen as critical for the disciplines of ecology and conservation, where research products are often used to shape policy and decision making. Scientists are increasing their online media communication, via social media and news.

Such media engagement has been thought to influence or predict traditional metrics of scholarship, such as citation rates. Here, we measure the association between citation rates and the Altmetric Attention Score—an indicator of the amount and reach of the attention an article has received—along with other forms of bibliometric performance (year published, journal impact factor, and article type).

We found that Attention Score was positively correlated with citation rates. However, in recent years, we detected increasing media exposure did not relate to the equivalent citations as in earlier years; signalling a diminishing return on investment.

Citations correlated with journal impact factors up to ∼13, but then plateaued, demonstrating that maximizing citations does not require publishing in the highest-impact journals. We conclude that ecology and conservation researchers can increase exposure of their research through social media engagement and, simultaneously, enhance their performance under traditional measures of scholarly activity.

URL : Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

DOI : https://doi.org/10.7717/peerj.4564

Ethnic Diversity Increases Scientific Impact

Authors : Bedoor K AlShebli, Talal Rahwan, Wei Lee Woon

Inspired by the numerous social and economic benefits of diversity, we analyze over 9 million papers and 6 million scientists spanning 24 fields of study, to understand the relationship between research impact and five types of diversity, reflecting (i) ethnicity, (ii) discipline, (iii) gender, (iv) affiliation and (v) academic age.

For each type, we study group diversity (i.e., the heterogeneity of a paper’s set of authors) and individual diversity (i.e., the heterogeneity of a scientist’s entire set of collaborators). Remarkably, of all the types considered, we find that ethnic diversity is the strongest predictor of a field’s scientific impact (r is 0.77 and 0.55 for group and individual ethnic diversity, respectively).

Moreover, to isolate the effect of ethnic diversity from other confounding factors, we analyze a baseline model in which author ethnicities are randomized while preserving all other characteristics.

We find that the relation between ethnic diversity and impact is stronger in the real data compared to the randomized baseline model, regardless of publication year, number of authors per paper, and number of collaborators per scientist.

Finally, we use coarsened exact matching to infer causality, whereby the scientific impact of diverse papers and scientists are compared against closely matched control groups. In keeping with the other results, we find that ethnic diversity consistently leads to higher scientific impact.

URL : https://arxiv.org/abs/1803.02282

Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

Authors : Alison Boba, Jill Emery

Utilizing the Project COUNTER Release 4 JR1-GOA report, two librarians explore these data in comparison to journal package subscriptions represented via the JR1 reports. This paper outlines the methodology and study undertaken at the Portland State University Library and the University of Nebraska Medical Center Library using these reports for the first time.

The initial outcomes of the study are provided in various Tables for 2014 and 2015. The intent of the study was to provide both institutions with a baseline from which to do further study. In addition, some ideas are given for how these reports can be used in vendor negotiations going forward.

URL : Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

DOI : http://dx.doi.org/10.1629/uksg.291

Who needs access to research? Exploring the societal impact of open access

Author : ElHassan ElSabry

Studies about open access (OA) have predominantly focused it impact on communication within the scholarly community. For example, many studies have been published on what is called the “Open Access Citation Advantage (OACA)”.

On the other hand, implications of OA in non-academic contexts (e.g. medical practice, policymaking, patient advocacy and citizen science) have been the subject of and the basis for a lot of the advocacy work and many funding agencies’ OA policies, but not so much the subject of original research studies.

To date, this study is the first attempt to collect and synthesize the available evidence on the societal impact of open access. It further builds on this evidence base by introducing a typology of the various science-society interfaces where demand for access to research potentially exists.

The proposed scheme is anticipated to provide guidance for future research on the issue of OA’s societal impact. The paper concludes with a discussion of the implications of non-academic usage of research on the open access debate, especially on the question of who should bear the cost of scholarly publishing.

URL : https://rfsic.revues.org/3271
http://microblogging.infodocs.eu/?tag=research-impact
microblogging.infodocs.eu
crawl=CC-MAIN-2018-22
49054
application/http; msgtype=response
sha1:VF3VR2RTB6QK6TMEQFAOKRWYHYSM2V6B
<urn:uuid:d8055ad1-2756-4fee-9d89-6660a2107245>
2018-05-23T06:59:18Z
54.36.55.13
text/html
sha1:JUFAVB65I43MMEK5O24JY4ZEIQJWFAHI
<urn:uuid:7b8f88fa-86b3-42f6-8ef4-920a5f9bf9ee>
http://microblogging.infodocs.eu/?tag=research-impact
response
<urn:uuid:f382b8c5-98dc-4f0f-aa8a-98f8ad8dc2b5>
robots: classic
hostname: ip-10-148-11-10.ec2.internal
software: Nutch 1.6 (CC)
isPartOf: CC-MAIN-2018-22
operator: Common Crawl Admin
description: Wide crawl of the web for May 2018
publisher: Common Crawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf