Proposal of the S-score for measuring the performance of researchers, institutions, and journals in Indonesia

Abstract

This study aimed to propose a tool for measuring the research performance of researchers, institutions, and journals in Indonesia based on bibliometrics. Specifically, the output of this measurement tool, referred to as the S-score, is described, as well as its implementation on the main database portal in Indonesia. The S-score was developed by a focus group discussion. The following 8 evaluation items for journal accreditation were analyzed in the development process: journal title, aims and scope; publisher; editorial and journal management; quality of articles; writing style; format of PDF and e-journal; regularity; and dissemination. The elements of the S-score are as follows: number of journal article documents in Scopus, number of non-journalarticle in Scopus, number of citations in Scopus, number of citations in Google Scholar, the hindex in Scopus, and the h-index in Google Scholar. The S-score yields results ranging from S1 to S6. The above metrics were implemented on the Science and Technology Index, a database portal in Indonesia. The measurement tool developed through the focus group discussion was successfully implemented on the database portal. Its validity and reliability should be monitored consistently through regular assessments of S-scores. The S-score may be a good example of a metric for measuring the performance of researchers, institutions, and journals in countries where most journals are not indexed by Scopus.

Building Research Productivity Framework in Higher Education Institution

“…Another reason is because SINTA as an online database accommodates research data from lecturers from all over Indonesia, which is needed to carry out this research. The SINTA platform is equipped with a rating system for researchers and journals in Indonesia [21].…”

Policies of scholarly journal accreditation in Indonesia

“…A proposal for accreditation of a scholarly journal is handled by considering whether the scholarly journal fulfilled following conditions: 1) It contains articles that significantly advance science, technology, and/or art based on the results of research, engineering, and/or studies containing original findings and/or thoughts without plagiarism; 2) presents a qualified journal editorial board in accordance with the field of science that represents the fields of science, technology, and/or art; 3) involves qualified peer reviewers in accordance with the journal's scientific field from various universities and/or research and development agencies and different industries from within and/or abroad who screen manuscripts objectively; 4) utilizes Indonesian and/or an official language of the United Nations; 5) maintains consistency of writing style and appearance format; 6) is managed and published electronically through information and communication technology networks; 7) is published according to a schedule; and 8) has an e-ISSN (electronic international standard serial number) and a DOI (digital object identifier) [6].…”

Analysis and Measurement of Scientific Collaboration Networks Performance

“…The main data source comes from the SINTA database, which is the largest author and affiliation indexation system in Indonesia built by the government, namely the Research and Technology and Higher Education Commission in 2017. In SINTA, there is university profile data and college performance scores based on published research outputs [17]. Performance measures are calculated with a 3-year window and overalls.…”

“…Figure 2 is the list of affiliates indexed by SINTA, complete with the calculation of the affiliate score. Affiliation score is a composite calculation from various sources, especially the number of publications, quartile scopus, number of citations, indexation of journals whose formula we can see in the writings of Lukman et.al [17]. Furthermore, this score is used as the basis for cluster formation for the calculation of the higher education collaboration index.…”