Understanding Traditional Research Impact Metrics

Butler, Joseph S.; Sebastian, Arjun S.; Kaye, I. David; Wagner, Scott C.; Morrissey, Patrick B; Schroeder, Gregory D.; Kepler, Christopher K.; Vaccaro, Alexander R.

doi:10.1097/bsd.0000000000000530

Cited by 16 publications

(11 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although recent publications have displayed that the IF has been surpassed by other bibliometrics in journals in the Gastroenterology and Hepatology [ 20 ]; Neurosciences [ 21 ]; and Radiology , Nuclear Medicine & Medical Imaging [ 22 ] categories, we recognize that the success of researchers is nowadays judged by the number of publications they have published in high IF journals [ 27 ].…”

Section: Discussionmentioning

confidence: 99%

Impact factor JUMPS after the 2020 COVID-19 pandemic: a retrospective study in Dermatology journals

González-Hermosillo

Roldan-Valadez

2022

Ir J Med Sci

View full text Add to dashboard Cite

Background The term “JUMPS” was used to describe the impact factor (IF) in an article published in PubMed in 2021, representing an increase of more than 40% of IF. Aims In this study, we aimed to compare the growth rate of IF JUMPS in Dermatology in the last 5 years, and particularly the effect of the 2020 COVID-19 pandemic. Methods This study evaluated the growth rate (JUMP) in IF from 2016 to 2020. We used the Friedman and Wilcoxon signed ranks tests. We classified JUMPS in negative growth rate; Q1 to Q4 quartiles; and journals with > 100%. A 76–100% growth rate was observed in five (7%) journals, and twelve journals (17%) depicted a 51–75% percentage of change. Results Several journals in the Dermatology category increased their IF by 50%. Repeated measures analyses showed a significant difference ( p < .001). Conclusion Although we found journals with growth rates in the four quartiles, no journals depicted negative growth rates nor > 100% growth. Knowing the growing trends in this category might supplement the assessment of target journals for authors looking to submit their works.

show abstract

Section: Discussionmentioning

confidence: 99%

Impact factor JUMPS after the 2020 COVID-19 pandemic: a retrospective study in Dermatology journals

González-Hermosillo

Roldan-Valadez

2022

Ir J Med Sci

View full text Add to dashboard Cite

show abstract

“…Also, when citable articles are accessible online before printing (prepublication online access), citation number will be added to the nominator but not the denominator. This can falsely increase the IF 10…”

Section: Definitionmentioning

confidence: 99%

“…Also, self-citations are not effective in its calculation, which is over 3 years’ time. However, considering the large database raises a question regarding the accuracy and transparency of SJR 10 28…”

Section: Definitionmentioning

confidence: 99%

Journal Impact Factor: A Bumpy Ride in an Open Space

Kaldas

Michael

Hanna

et al. 2020

Journal of Investigative Medicine

View full text Add to dashboard Cite

The journal impact factor (IF) is the leading method of scholarly assessment in today’s research world. An important question is whether or not this is still a constructive method. For a specific journal, the IF is the number of citations for publications over the previous 2 years divided by the number of total citable publications in these years (the citation window). Although this simplicity works to an advantage of this method, complications arise when answers to questions such as ‘What is included in the citation window’ or ‘What makes a good journal impact factor’ contain ambiguity. In this review, we discuss whether or not the IF should still be considered the gold standard of scholarly assessment in view of the many recent changes and the emergence of new publication models. We will outline its advantages and disadvantages. The advantages of the IF include promoting the author meanwhile giving the readers a visualization of the magnitude of review. On the other hand, its disadvantages include reflecting the journal’s quality more than the author’s work, the fact that it cannot be compared across different research disciplines, and the struggles it faces in the world of open access. Recently, alternatives to the IF have been emerging, such as the SCImago Journal & Country Rank, the Source Normalized Impact per Paper and the Eigenfactor Score, among others. However, all alternatives proposed thus far are associated with their own limitations as well. In conclusion, although IF contains its cons, until there are better proposed alternative methods, IF remains one of the most effective methods for assessing scholarly activity.

show abstract

“…Academic productivity worldwide has been estimated to exceed 2.5 million research articles annually [31], presenting a significant challenge for researchers and clinicians to filter through literature. Citation rate (CR) has traditionally been used as an important measure of article influence [7], but it may take years for citations to accumulate, and important articles are at risk of going unrecognized for an extended period of time. Citation rates are also limited in that they do not represent impact beyond the sphere of academia [28,30].…”

Section: Introductionmentioning

confidence: 99%

The Altmetric Attention Score Is Associated With Citation Rates and May Reflect Academic Impact in the Total Joint Arthroplasty Literature

Kunze

Vadhera²,

Polce³

et al. 2022

HSS Journal®: The Musculoskeletal Journal of Hospital for Speci

View full text Add to dashboard Cite

Background: Given the increasing interest and potential use of social media for the promotion of orthopedic literature, there is a need to better understand Altmetrics. Purposes: We sought to determine the relationship between the Altmetric Attention Score (AAS) and the number of citations for articles on total joint arthroplasty (TJA) published in orthopedics journals. We also sought to determine the predictors of greater social media attention for these articles. Methods: Articles on TJA published in Bone and Joint Journal (BJJ), Journal of Bone and Joint Surgery (JBJS), Clinical Orthopedics and Related Research (CORR), Journal of Arthroplasty, Journal of Knee Surgery, Hip International, and Acta Orthopaedica in 2016 were extracted ( n = 498). One-way analysis of variance with Bonferroni corrections was used to compare AAS and citations across journals. Multivariate regressions were used to determine predictors of social media attention and number of citations. Results: The mean AAS and number of citations were 7.5 (range: 0–289) and 16.7 (range: 0–156), respectively. Significant between-group effects were observed according to journal for AAS and number of citations. Publishing an article in JBJS was the strongest predictor of higher number of citations. Publishing an article in BJJ was the only independent predictor of higher AAS, while publishing an article in JBJS or CORR trended toward statistical significance. A higher AAS was a significant predictor of a higher number of citations. Number of citations and number of study references were positive predictors of greater social media attention on Twitter and Facebook. Conclusions: In articles on TJA published in 7 journals in 2016, a higher AAS was a associated with a higher number of citations. Various bibliometric characteristics were found to be significantly associated with greater social media attention; the most common influences were number of citations and number of references. Researchers in orthopedics can use this information when considering how to assess the impact of their work.

show abstract

Understanding Traditional Research Impact Metrics

Cited by 16 publications

References 5 publications

Impact factor JUMPS after the 2020 COVID-19 pandemic: a retrospective study in Dermatology journals

Impact factor JUMPS after the 2020 COVID-19 pandemic: a retrospective study in Dermatology journals

Journal Impact Factor: A Bumpy Ride in an Open Space

The Altmetric Attention Score Is Associated With Citation Rates and May Reflect Academic Impact in the Total Joint Arthroplasty Literature

Contact Info

Product

Resources

About