Identifying benchmark units for research management and evaluation

Abstract

While normalized bibliometric indicators are expected to resolve the subject-field differences between organizations in research evaluations, the identification of reference organizations working on similar research topics is still of importance. Research organizations, policymakers and research funders tend to use benchmark units as points of comparison for a certain research unit in order to understand and monitor its development and performance. In addition, benchmark organizations can also be used to pinpoint potential collaboration partners or competitors. Therefore, methods for identifying benchmark research units are of practical significance. Even so, few studies have further explored this problem. This study aims to propose a bibliometric approach for the identification of benchmark units. We define an appropriate benchmark as a well-connected research environment, in which researchers investigate similar topics and publish a similar number of publications compared to a given research organization during the same period. Four essential attributes for the evaluation of benchmarks are research topics, output, connectedness, and scientific impact. We apply this strategy to two research organizations in Sweden and examine the effectiveness of the proposed method. Identified benchmark units are evaluated by examining the research similarity and the robustness of various measures of connectivity.

A bibliometric approach to understanding the recent development of self-sufficient fish feed production utilizing agri-food wastes and by-products towards sustainable aquaculture

“…Online publication of journal articles has made it possible to easily track citations and interactive features, such as the number of article downloads, which has resulted in the creation of a new set of indices that can be used to assess and value the relative value of contributions made by various researchers, journals, and articles [ [78] , [79] , [80] ]. Indicators of researcher performance and dominance in a field concentrate on one or a combination of four essential aspects that include the value of the topics, the quantity of researcher outputs, the number of connections, and the scientific impact of the publications or authors on society [ 81 ]. Research collaboration is required to maintain sustainability, reduce costs, and address complex scientific issues in research works that otherwise cannot be solved or addressed by individual researchers [ 82 , 83 ].…”