Research performance evaluation: some critical thoughts on standard bibliometric indicators

Anninos, Loukas

doi:10.1080/03075079.2013.801429

Cited by 23 publications

(15 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Science studies have predominantly engaged with the accuracy of contemporary performance indicators, such as productivity, citation indexes and peer review (e.g., Anninos 2014;Basu 2006;Werner 2015). Human Resource Management-oriented research has examined the HR practices facilitating the recruitment, selection and retention of academics and has recently centred on talent management (Davies and Davies 2010;Thunnissen et al 2013).…”

Section: Evaluating Academic Staff In the Neoliberal Universitymentioning

confidence: 99%

Selecting early-career researchers: the influence of discourses of internationalisation and excellence on formal and applied selection criteria in academia

2018

View full text Add to dashboard Cite

This article examines how macro-discourses of internationalisation and excellence shape formal and applied selection criteria for early-career researcher positions at the mesoorganisational and micro-individual levels, demonstrating how tensions between the various levels produce inequalities in staff evaluation. In this way, this article contributes to the literature on academic staff evaluation by showing that Selection Committee members do not operate in a vacuum, and that their actions are inextricably linked to the meso-and macrocontext. This study draws on qualitative multi-level data that comprise institutional-level policies, recruitment and staff protocols, job postings and individual-level interviews and focus groups with Selection Committee members. Findings show that a majority of Selection Committee members consent to university policies and macro-discourses when evaluating early-career researchers, but a smaller group questions and resists these criteria. Furthermore, the analysis revealed four inequalities that emerge in the application of criteria and reflect on disciplinary differences between the Natural and Social Sciences. The article concludes that with only a few Committee members to critically question and resist formal selection criteria, they limit the pool of acceptable candidates to those who fit the narrow definition of the internationally mobile and excellent early-career researcher, which may exclude talented scholars.

show abstract

Section: Evaluating Academic Staff In the Neoliberal Universitymentioning

confidence: 99%

Selecting early-career researchers: the influence of discourses of internationalisation and excellence on formal and applied selection criteria in academia

2018

View full text Add to dashboard Cite

show abstract

“…It is important to acknowledge that the indices used for purposes of comparison in the present paper also have inherent limitations that must be taken into account when interpreting the global or more granular results obtained through their use. The technical limitations of bibliometric indices have been the focus of a substantial literature (see for example van Raan, 2005a;Vinkler, 2007;Costas & Bordons, 2008;Bornmann, 2011;Anninos, 2013).Without insisting on a detailed review, at least one general limitation of the h and g indices should be borne in mind throughout the forthcoming analysis. Similar to other bibliometric indicators, the h and g indices operate with a limited informational basis that only includes the number of published papers and the number of citations they received.…”

Section: Evaluating Academic Departments In Romaniamentioning

confidence: 98%

Ranking Romanian academic departments in three fields of study using theg-index

Miroiu

Păunescu

Vîiu

2015

Quality in Higher Education

View full text Add to dashboard Cite

The scientific performance of 64 political science, sociology and marketing departments in Romania is investigated with the aid of the g-index.The assessment of departments based on the g-index shows, within each of the three types of departments that make up the population of the study, a strong polarisation between top performers (very few) and weak performers (much more numerous). This alternative assessment is also found to be largely consistent with an official ranking of departments carried out in 2011 by the Ministry of Education. To conduct the evaluation of departments the individual scientific output of 1385 staff members working in the fields of political science, sociology and marketing is first determined with the aid of the 'Publish or Perish' software based on the Google Scholar database. Distinct department rankings are then created within each field using a successive (second-order) g-index.

show abstract

“…Several pieces of work related to the investigation of research performance using bibliometrics may be found; the two main kinds of bibliometric indicators used to measure research performance in literature are number of publications and citation count [10] . Güneş et al [9] presented examples of the use of bibliometric measurements of research performance in several areas, such as Abramo et al [11] or Anninos [12] in the area of higher education, Davarpanah [13] in that of social sciences publications, or Pendlebury [14] in that of research performance evaluation.…”

Section: Related Workmentioning

confidence: 99%

5Ws of green and sustainable software

Calero

Mancebo

García

et al. 2020

Tinshhua Sci. Technol.

View full text Add to dashboard Cite

Green and Sustainable Software has emerged as a new and highly active area in the software community. After several years of research and work, we believe that it is now necessary to obtain a general snapshot of how the research in this area is evolving. To do so, we have applied the 5Ws (why, when, who, where, and what), a formula for getting the complete story on a subject. We have therefore carried out a study, using 542 publications related to Green and Sustainable Software research; these were recovered using SCOPUS. The results obtained allow us to conclude that it is important to identify key elements of the research to allow researchers be fully aware of the state of the research on Green and Sustainable Software (why); the study uses papers published between 2000 and the beginning of November 2018 (when); the most prolific authors are mainly from Europe, although the USA is the most active country, Green and Sustainable Software being a very interactive area with a good number of multinational publications (who); the top five keywords related to sustainable aspects are Green Software, Green IT, Software Sustainability, Energy Consumption, and Energy Efficiency (what); finally, as regards the places authors prefer to publish in, there is almost a complete balance between conferences and journals, with a trend towards an increase in the number of publications (where).

show abstract

Research performance evaluation: some critical thoughts on standard bibliometric indicators

Cited by 23 publications

References 44 publications

Selecting early-career researchers: the influence of discourses of internationalisation and excellence on formal and applied selection criteria in academia

Selecting early-career researchers: the influence of discourses of internationalisation and excellence on formal and applied selection criteria in academia

Ranking Romanian academic departments in three fields of study using theg-index

5Ws of green and sustainable software

Contact Info

Product

Resources

About