Benchmarking systems are important features for the implementation of efficacy in basic and applied sciences. These systems are urgently needed for many fields of science since there is an imbalance present between funding policies and research evaluation. Here, a new approach is presented with an international study project that uses visualisation techniques for benchmarking processes. The project is entitled New Quality and Quantity Indices in Science (NewQIS). The juxtaposition of classical scientometric tools and novel visualisation techniques can be used to assess quality and quantity in science. In specific, the tools can be used to assess quality and quantity of research activity for distinct areas of science, for single institutions, for countries, for single time periods, or for single scientists. Also, NewQIS may be used to compare different fields, institutions, countries, or scientists for their scientific output. Thus, decision making for funding allocation can be made more transparent. Since governmental bodies that supervise funding policies and allocation processes are often not equipped with an in depth expertise in this area, special attention is given to data visualisation techniques that allow to visualize mapping of research activity and quality.
BackgroundInstitutional operating figures and benchmarking systems are important features for the implementation of efficacy in basic and applied sciences. They are needed for research evaluation and funding policy. However, the current policy settings for research evaluation urgently need review since there may be imbalances present in many areas.MethodsThe present study assessed benchmarking of research output. By the use of large data bases research output was categorized and analyzed. Specific areas of major research activity were identified by comparing publication density on different organ systems and inter- and intrafield comparison was performed for selected countries.ResultsNovel density-equalizing mappings were constructed that illustrate trends of publication activity and identify subsets of major interest in a total of 5,527,558 published items. A dichotomy was present between Western countries such as the US, UK or Germany and Asian countries such as Japan, China or South Korea concerning research focuses.ConclusionThe present study is the first large scale analysis of global research activity and output over the last 50 years. The presently described assessment of operating figures at the national and international level can be used to identify single areas of research that are heavily focused. Further research on qualitative output benchmarking is needed to improve current policy settings for research evaluation.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.