Journal- or article-based citation measure? A study of academic promotion at a Swiss university [version 1].

Steck, Nicole; Stalder, Lukas; Egger, Matthias (2020). Journal- or article-based citation measure? A study of academic promotion at a Swiss university [version 1]. F1000Research, 9, p. 1188. F1000 Research Ltd 10.12688/f1000research.26579.1

[img]
Preview
Text
Steck F1000Res 2020_v1.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (1MB) | Preview

In academia, decisions on promotions are influenced by the citation impact of the works published by the candidates. The Medical Faculty of the University of Bern used a measure based on the journal impact factor (JIF) for this purpose: the JIF of the papers submitted for promotion should rank in the upper third of journals in the relevant discipline (JIF rank >0.66). The San Francisco Declaration on Research Assessment (DORA) aims to eliminate the use of journal-based metrics in academic promotion. We examined whether the JIF rank could be replaced with the relative citation ratio (RCR), an article-level measure of citation impact developed by the National Institutes of Health (NIH). An RCR percentile >0.66 corresponds to the upper third of citation impact of articles from NIH-sponsored research. We examined 1525 publications submitted by 64 candidates for academic promotion at University of Bern. There was only a moderate correlation between the JIF rank and RCR percentile (Pearson correlation coefficient 0.34, 95% CI 0.29-0.38). Among the 1,199 articles (78.6%) published in journals ranking >0.66 for the JIF, less than half (509, 42.5%) were in the upper third of the RCR percentile. Conversely, among the 326 articles published in journals ranking <0.66 regarding the JIF, 72 (22.1%) ranked in the upper third of the RCR percentile. Our study demonstrates that the rank of the JIF is a bad proxy measure for the actual citation impact of individual articles. The Medical Faculty of University of Bern has signed DORA and replaced the JIF rank with the RCR percentile to assess the citation impact of papers submitted for academic promotion.

Item Type:

Journal Article (Original Article)

Division/Institute:

04 Faculty of Medicine > Pre-clinic Human Medicine > Institute of Social and Preventive Medicine (ISPM)
04 Faculty of Medicine > Faculty Institutions > Office of the Dean, Faculty of Medicine > Office of the Dean, Medicine

UniBE Contributor:

Steck, Nicole; Stalder, Lukas and Egger, Matthias

Subjects:

600 Technology > 610 Medicine & health
300 Social sciences, sociology & anthropology > 360 Social problems & social services

ISSN:

2046-1402

Publisher:

F1000 Research Ltd

Funders:

[4] Swiss National Science Foundation

Language:

English

Submitter:

Doris Kopp Heim

Date Deposited:

10 Nov 2020 22:01

Last Modified:

12 Nov 2020 06:44

Publisher DOI:

10.12688/f1000research.26579.1

PubMed ID:

33149900

Uncontrolled Keywords:

DORA Declaration Journal Impact Factor Relative Citation Ratio

BORIS DOI:

10.7892/boris.148019

URI:

https://boris.unibe.ch/id/eprint/148019

Actions (login required)

Edit item Edit item
Provide Feedback