Abstract:Many governments wish to assess the quality of their universities. A prominent example is the UK's new Research Excellence Framework (REF) 2014. In the REF, peer-review panels will be provided with information on publications and citations. This paper suggests a way in which panels could choose the weights to attach to these two indicators. The analysis draws in an intuitive way on the concept of Bayesian updating (where citations gradually reveal information about the initially imperfectly-observed importance… Show more
“…However, it may also aggravate the problem if reviewers use citations or the impact factor of a journal as a proxy for the quality of an article. In the British Research Assessment Exercise, it became obvious that citations were the most important predictor of the evaluation outcomes by peers (Sgroi and Oswald 2013).…”
Section: Suggestions To Overcome the Negative Consequences Of Researcmentioning
We suggest as alternatives careful socialization and selection of scholars, supplemented by periodic self-evaluations and awards. The aim is to encourage controversial discourses in order to contribute meaningful to the advancement of science.
“…However, it may also aggravate the problem if reviewers use citations or the impact factor of a journal as a proxy for the quality of an article. In the British Research Assessment Exercise, it became obvious that citations were the most important predictor of the evaluation outcomes by peers (Sgroi and Oswald 2013).…”
Section: Suggestions To Overcome the Negative Consequences Of Researcmentioning
We suggest as alternatives careful socialization and selection of scholars, supplemented by periodic self-evaluations and awards. The aim is to encourage controversial discourses in order to contribute meaningful to the advancement of science.
“…The prestige of the journal publishing an article should become less informative over time, since articles are accepted based on their predicted likelihood of having an impact, while citation‐based measures of actual impact become available as time passes. Thus, Sgroi and Oswald () show how citations give new information, in a Bayesian sense, and as time passes the weight on this information should rise while the weight on the prestige of the journal should fall toward zero. Also, citations may be less affected by nepotism; according to Liebowitz (, 1): Because a journal's decision depends on the opinion of only an editor and a few referees chosen by the editor, there is a great deal of latitude for gratuitous decisions.…”
Research quality can be evaluated from citations or from the prestige of journals publishing the research. We relate salary of tenured University of California (UC) economists to their lifetime publications of 5,500 articles and to the 140,000 citations to these articles. Citations hardly affect salary, especially in top‐ranked UC departments where impacts of citations are less than one‐tenth those of journals. In lower ranked departments, and when journal quality is less comprehensively measured, effects of citations on salary increase. If journal quality is just measured by counting articles in journal tiers, apparent effects of citations are overstated. (JEL A14, J44)
“…The implementation of peer review approach was by hired numbers of expert panel to do the assessment, but there are numbers of unsatisfied studies that gives peer review approach a bad reputation. [150,151,152,153] Another national assessment exists in Malaysia is Malaysia research assessment, called MyRA. [154] MyRA is an assessment that involves a number of institutions and measures their research, development and innovation (R & D & I) and contradict with SETARA, MyRA is leaning towards mixed approach whereby bibliometric analysis combined with peer review assessment.…”
Aim: This study is to understand and analyze the publication productivity as one of the important scientometric indicators of HEI's performance in Malaysia for duration time of 20 years. Method: This study conducted the scientometric analysis of the research productivity performance of Malaysia's researchers from June 1995 to June 2015 using Scopus database. All type' field in the search box where chosen and the chosen keyword is 'Malaysia'. All related papers are extracted, retrieved and compiled into the personal database in Microsoft Excel. Pre-processing task such as data cleaning were done and with total of 290 093 publications records was identified. These publications records included all type of documents such as articles, conference, review paper, book chapter and books. Result: The remarkably numbers of publication growth from 1995 to 2015. There are huge development of research happens in these 20 years in Malaysia with only 1,610 publication in 1995 increased to 180,797 publication in 2015. Subject area of pure science dominated the percentage of publication such as engineering with 15% from total and the small percentage with total of 5% comes from pure science as well which are physic and astronomy. Conclusion: The increase in publication productivity is a sign of good R&D that is actively happened in this country. This has a positive impact towards Malaysia as well as the related institutions in order to introduce and stamp their name to the world. Therefore, the numbers of collaboration with others countries especially with European countries and America is worth to emphasize. Nonetheless, we understand that there are numbers of factors that associated in producing the publication that can be barriers to the authors such as personal factors, environment factors and behavioral factors.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
