The wisdom of citing scientists

Bornmann, Lutz; Marx, Werner

doi:10.1002/asi.23100

Cited by 45 publications

(34 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This selection is based on field-and time-normalised impact indicators which are the best available indicators in bibliometrics for the quality assessment of journals. According to Bornmann and Marx (2014b), the benefit of citation analysis is based on what Galton (1907) called the "wisdom of crowds". In the next few years, future studies should investigate with field-normalised indicators whether both journals can hold this position or will be replaced by other journals.…”

Section: Discussionmentioning

confidence: 99%

Normalisation of citation impact in economics

Bornmann

Wohlrabe

2019

Scientometrics

Self Cite

View full text Add to dashboard Cite

This study is intended to facilitate fair research evaluations in economics. Field-and timenormalisation of citation impact is the standard method in bibliometrics. Since citation rates for journal papers differ substantially across publication years and Journal of Economic Literature classification codes, citation rates should be normalised for the comparison of papers across different time periods and economic subfields. Without normalisation, both factors that are independent of research quality might lead to misleading results of citation analyses. We apply two normalised indicators in economics, which are the most important indicators in bibliometrics: (1) the mean normalised citation score (MNCS) compares the citation impact of a focal paper with the mean impact of similar papers published in the same economic subfield and publication year. (2) PP top 10 % is the share of papers that belong to the 10% most cited papers in a certain subfield and time period. Since the MNCS is based on arithmetic averages despite skewed citation distributions, we recommend using PP top 10 % for fair comparisons of entities in economics. In this study, we apply the normalisation methods to 294 journals (including normalised scores for 192,524 papers). We used the PP top 10 % results for assigning the journals to four citation impact classes. Seventeen journals have been identified as outstandingly cited. Two journals, Quarterly Journal of Economics and Journal of Economic Literature, perform statistically significantly better than all other journals. Thus, only two journals can be clearly separated from the rest in economics.

show abstract

Section: Discussionmentioning

confidence: 99%

Normalisation of citation impact in economics

Bornmann

Wohlrabe

2019

Scientometrics

Self Cite

View full text Add to dashboard Cite

show abstract

“…A number of studies in the life and natural sciences have used citation impact to evaluate review decisions. 1 The logic is attractive: for many tasks, decisions of a crowd are more accurate than decisions of a few individuals, so perhaps citing decisions of a crowd of scientists represent a suitable gold standard against which to evaluate (the few) reviewers' decisions (Bornmann and Marx 2014;Lee et al 2013). The present study extends this line of research for the first time to sociology, in which evaluation is among the least understood steps of the research process (Leahey 2008).…”

Section: Original Articlementioning

confidence: 75%

Do Peer Reviews Predict Impact? Evidence from the American Sociological Review, 1978 to 1982

Teplitskiy

Bakanic

2016

Socius

View full text Add to dashboard Cite

The authors investigate how well peer reviews of articles published in the journal American Sociological Review between 1978 and 1982 predict the articles' citation impact in the following 32 years. The authors find no evidence of a relationship between review outcomes and citation impact at any time after publication, even when citations are normalized by subfield. Qualitative analysis of the review texts rules out the interpretation that reviewers focused on potential impact but failed to predict it. Instead, reviewers focused on the soundness of the manuscripts' arguments. The authors discuss how organizational characteristics of review can decouple reviewers' judgments from impact.

show abstract

“…The commonly cited references of a specific research area can reveal the knowledge base of this field [18]. Table 1 lists the basic information regarding the 11 most frequently cited references in the articles from 1990-2018 in the agroforestry field, such as the total referenced frequency, article titles, author names, publication years, and journal titles/publisher.…”

Section: Most Cited Referencesmentioning

confidence: 99%

Trends and Features of Agroforestry Research Based on Bibliometric Analysis

et al. 2019

View full text Add to dashboard Cite

The world is faced with dual challenges to ensure food security for its large and still growing population and to mitigate climate change. It is necessary to develop more diversified and multifunction agricultural systems to address the challenges. Therefore, as a reasonable land use practice, agroforestry has become the hotspot in scientific research in recent decades. This study performed quantitative and qualitative analyses of agroforestry research published between 1990 and 2018 based on bibliometric methods, expecting to guidance for further research in order to scientifically understand of the trends and features of agroforestry research over time and by region. A total of 4204 publications were obtained from Web of Science. The results show that the research interest in the agroforestry field has significantly enhanced, and about 139 countries have been involved with the research in this field. These publications cover 66 subject categories and a great diversity research theme. Since 1990, the popular keywords in agroforestry research have been changed from “Intercropping”, “Alley cropping”, and “Multipurpose trees” to “Carbon sequestration”, “Ecosystem service”, and “Climate change”. This indicates that the theme of agroforestry research has changed and the research scale is gradually expanding. Furthermore, agroforestry research themes vary with regions, since different regions have various requirements on the function of the agroforestry system. In the end, given the current trend of agroforestry science, we conclude a list of research potentials of agroforestry in the future.

show abstract

The wisdom of citing scientists

Cited by 45 publications

References 29 publications

Normalisation of citation impact in economics

Normalisation of citation impact in economics

Do Peer Reviews Predict Impact? Evidence from the American Sociological Review, 1978 to 1982

Trends and Features of Agroforestry Research Based on Bibliometric Analysis

Contact Info

Product

Resources

About