2013
DOI: 10.1257/jel.51.1.173
|View full text |Cite
|
Sign up to set email alerts
|

Uncertainty Measures for Economics Journal Impact Factors

Abstract: Academic economists appear to be intensely interested in rankings of journals, institutions, and individuals. Yet there is little discussion of the uncertainty associated with these rankings. To illustrate the uncertainty associated with citations-based rankings, I compute the standard error of the impact factor for all economics journals with a five-year impact factor in the 2011 Journal Citations Report. I use these to derive confidence intervals for the impact factors as well as ranges of possible rank for … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

4
41
1

Year Published

2014
2014
2024
2024

Publication Types

Select...
7
2

Relationship

0
9

Authors

Journals

citations
Cited by 64 publications
(47 citation statements)
references
References 40 publications
4
41
1
Order By: Relevance
“…These differences may be due to: (1) a delayed update of the database (the IPPs were published by Scopus in June 2015), and (2) a larger set of citing sources and documents (with Scopus, it is not possible to limit the citation report to particular citing sources or documents). Similar differences between official and observed values have been found and discussed, for instance, by Leydesdorff and Opthof (2010), Stern (2013) and Seiler and Wohlrabe (2014). Nonetheless, in this case the ACPP should, theoretically, represent a 3-year synchronous impact factor for the year 2014 (Ingwersen et al 2001; Ingwersen 2012) in that we considered only citations received during 2014 of papers published within the previous 3 years.…”
Section: Two Empirical Studiessupporting
confidence: 88%
“…These differences may be due to: (1) a delayed update of the database (the IPPs were published by Scopus in June 2015), and (2) a larger set of citing sources and documents (with Scopus, it is not possible to limit the citation report to particular citing sources or documents). Similar differences between official and observed values have been found and discussed, for instance, by Leydesdorff and Opthof (2010), Stern (2013) and Seiler and Wohlrabe (2014). Nonetheless, in this case the ACPP should, theoretically, represent a 3-year synchronous impact factor for the year 2014 (Ingwersen et al 2001; Ingwersen 2012) in that we considered only citations received during 2014 of papers published within the previous 3 years.…”
Section: Two Empirical Studiessupporting
confidence: 88%
“…The results found were consistent with common knowledge -the most influential journals included the American Economic Review, Econometrica and the Journal of Political Economy. Recently, several similar studies have been developed (Card and DellaVigna 2013;Laband 2013;Stern 2013). Some other studies have analysed the influence of authors and institutions (Autor 2012;Kocher and Sutter 2001;Süssmuth et al 2006).…”
Section: Literature Reviewmentioning
confidence: 99%
“…So whilst all would likely agree on which journals make up the top six or so, beyond that the correlation between studies falls sharply. This is made even clearer by noting the rankings of our journals in Stern (2013), who computed standard errors for the 5-year impact factors for 230 journals in the 2011 Journal Citations report 14 We have included these rankings in the fourth column of Table 2. Whilst these rankings are based on a short citation window, there are nevertheless substantial differences of opinion between our list and the rankings in Stern (2013).…”
Section: The World's Best Economics Journalsmentioning
confidence: 99%
“…25 This could be viewed as cause for concern given that none of the three Australian journal rankings studies discussed above ranked this journal as A*. Also, neither Pieters and Baumgartner (2002) nor Kim et al (2006) included this journal in their list of top journals, whilst Stern (2013) ranked it at only 190. Other important outlets for Australian economics research include Journal of Economic Behavior and Organisation (7 per cent of Australian articles), Journal of Econometrics (7 per cent) and Journal of Health Economics (6.4 per cent).…”
Section: Australia's Contribution To the World's Bestmentioning
confidence: 99%