Publication cultures and Dutch research output: a quantitative assessment

Krämer, Bianca; Bosman, Jeroen

doi:10.5281/zenodo.2643360

Cited by 1 publication

(1 citation statement)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Completeness, correctness, consistency, and timeliness are required of any publication data used for evaluative metrics, however CRIS data requires relatively strong effort to ensure sufficiently rich and structured metadata on outputs including all types and languages (Azeroual & Schöpfel, 2019;Sīle et al, 2019). Self-reporting of outputs by researchers and/or other personnel may result in less than optimal coverage, findability, traceability, comparability and reproducibility of CRIS data (Bosman & Kramer, 2019;van Leeuwen et al, 2016). Institutional incentives and requirements for reporting, as well as data-collection guidelines and communities for dedicated data-collection personnel, are important means to promote the quality and comprehensiveness of CRIS data (Pölönen et al, 2020b;Sivertsen, 2019).…”

Section: Discussionmentioning

confidence: 99%

Research performance and scholarly communication profile of competitive research funding: the case of Academy of Finland

Pölönen

Auranen

2022

Scientometrics

View full text Add to dashboard Cite

The Academy of Finland (AKA), Finland’s major public research funding agency, uses a Web of Science (WoS) based bibliometric indicator to assess the performance of research it has funded. We use an alternative methodology to compare (1) the research performance and (2) the scholarly communication profile of AKA-funded research to the Finnish universities’ entire output across the major fields of arts and sciences. Our data consists of 142,742 publications (years 2015–2018) registered in the national information service, which integrates Current Research Information System (CRIS) data of 13 Finnish universities. Research performance is analyzed using the Finnish community-curated expert-based rating of publication channels (so-called JUFO). Our results show that compared to the Finnish universities’ entire output a larger share of AKA-funded research is published in leading JUFO rated journals and book publishers. JUFO and WoS-based indicators produced consonant results regarding the performance of AKA-funded research. Analysis of publication profiles shows that AKA-funded research is more focused than the universities’ output on using peer-reviewed publications, articles published in journals, English language, foreign publishers and open access publishing. We conclude that the CRIS-based publication data can support multidimensional assessments of research performance and scholarly communication profiles, potentially also in other countries and institutions. CRIS development and maintenance require multi-stakeholder commitment, resources and incentives to ensure data quality and coverage. To fully recognize diverse open science practices and to enable international comparisons, CRISs need further development and integration as data sources.

show abstract