Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles in Rotator Cuff Repair Surgery

Sochacki, Kyle R.; Jack, Robert A.; Nauert, Richard F.; Harris, Joshua D.

doi:10.1177/2325967118776635

Cited by 32 publications

(56 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, only 2 of the prior studies examined the methodological quality of the most cited literature with regard to a specific pathology. 23,58 Corroborating what has been previously described, our findings show a continued need for emphasis on high-quality studies in terms of treatment of KD and MLKI in patients.…”

Section: Discussionsupporting

confidence: 82%

Critical Evaluation of the Methodologic Quality of the Top 50 Cited Articles Relating to Knee Dislocation and Multiligamentous Knee Injury

Hankins

Fletcher

Prieto

et al. 2019

Orthopaedic Journal of Sports Medicine

View full text Add to dashboard Cite

Background:Many studies have evaluated the management of knee dislocations (KDs) and multiligamentous knee injuries (MLKIs). However, no study to date has analyzed the quality of the most cited articles in this literature.Hypothesis:There is a positive correlation between the number of article citations in the KD and MLKI literature and their methodologic quality.Study Design:Systematic review.Methods:The Web of Science online database was searched to identify the top 50 cited articles in KD and MLKI care. Demographic data were recorded for each study. The Modified Coleman Methodology Score (MCMS) and the Methodological Index for Non-randomized Studies (MINORS) were used to analyze the methodological quality of each article. Spearman correlation coefficients (r s) were then calculated.Results:The articles identified were published between 1958 and 2015 in a wide variety of peer-reviewed journals (n = 16). The majority of study level of evidence (LOE) was of low quality (level 5, 16%; level 4, 54%; level 3, 16%; level 2, 14%). There were no studies of level 1 evidence. The mean MCMS and MINORS scores were 29.0 (SD, 19.1; range, 3-72) and 6.1 (SD, 3.7; range, 0-14), respectively. No significant correlation was identified between the number of citations and the publication year, LOE, MCMS, or MINORS (r s = 0.123 [P = .396]; r s = 0.125 [P = .389]; r s = 0.182 [P = .204]; and r s = 0.175 [P = .224], respectively). Positive correlations were observed between improved MCMS and MINORS scores and more recent year of publication (r s = 0.43 [P = .002]; r s = 0.32 [P = .022]) as well as improved study LOE (r s = 0.65 [P < .001]; r s = 0.67 [P < .001]).Conclusion:The top 50 cited articles on KD and MLKI care consisted of low LOE and methodological quality, with no existing level 1 articles. There was no significant correlation between the number of citations and publication year, LOE, or study methodological quality. Positive correlations were observed between later publication date and improved methodological quality.

show abstract

Section: Discussionsupporting

confidence: 82%

Critical Evaluation of the Methodologic Quality of the Top 50 Cited Articles Relating to Knee Dislocation and Multiligamentous Knee Injury

Hankins

Fletcher

Prieto

et al. 2019

Orthopaedic Journal of Sports Medicine

View full text Add to dashboard Cite

show abstract

“…The reviewers used 3 scoring systems, selected to maintain consistency with similar bibliometric studies in other areas of orthopaedics. 25,41 The range of scores for each scoring system is listed in parentheses, with higher scores indicating higher methodological quality: the Modified Coleman Methodology Score (MCMS) 37 (0-100), the Jadad scale 26 (0-5), and the Methodological Index for Non-Randomized Studies (MINORS) 39 (0-24). The MCMS is a tool that accounts for the study design, methodology, and quality of outcome reporting, and its reliability has been validated with 99% reproducibility.…”

Section: Methodsmentioning

confidence: 99%

Assessment and Trends in the Methodological Quality of the Top 50 Most Cited Articles in Shoulder Instability

Agarwalla

Yao

Gowd

et al. 2020

Orthopaedic Journal of Sports Medicine

View full text Add to dashboard Cite

Background: Citation counts have often been used as a surrogate for the scholarly impact of a particular study, but they do not necessarily correlate with higher-quality investigations. In recent decades, much of the literature regarding shoulder instability is focused on surgical techniques to correct bone loss and prevent recurrence. Purpose: To determine (1) the top 50 most cited articles in shoulder instability and (2) if there is a correlation between the number of citations and level of evidence or methodological quality. Study Design: Cross-sectional study. Methods: A literature search was performed on both the Scopus and the Web of Science databases to determine the top 50 most cited articles in shoulder instability between 1985 and 2019. The search terms used included “shoulder instability,” “humeral defect,” and “glenoid bone loss.” Methodological scores were calculated using the Modified Coleman Methodology Score (MCMS), Jadad scale, and Methodological Index for Non-Randomized Studies (MINORS) score. Results: The mean number of citations and mean citation density were 222.7 ± 123.5 (range, 124-881.5) and 16.0 ± 7.9 (range, 6.9-49.0), respectively. The most common type of study represented was the retrospective case series (evidence level, 4; n = 16; 32%) The overall mean MCMS, Jadad score, and MINORS score were 61.1 ± 10.1, 1.4 ± 0.9, and 16.0 ± 3.0, respectively. There were also no correlations found between mean citations or citation density versus each of the methodological quality scores. Conclusion: The list of top 50 most cited articles in shoulder instability comprised studies with low-level evidence and low methodological quality. Higher-quality study methodology does not appear to be a significant factor in whether studies are frequently cited in the literature.

show abstract

“…10 This study is the first to examine the relationship between quality and impact in Otolaryngology. 12 Nieminen et al also did not find a significant relationship between the quality of psychiatric research among four journals and the total number of citations per article over 9 years. However, they only used half the articles and the quality of the research was evaluated by the primary author using their own rubric.…”

Section: Discussionmentioning

confidence: 91%

“…Similar assessments have been performed in other medical specialties including orthopedic surgery, psychiatry and oral and maxillofacial surgery. Sochacki et al found no correlation between the level of evidence and the number of citations in the top 50 articles related to rotator cuff repair surgery 12 . Nieminen et al also did not find a significant relationship between the quality of psychiatric research among four journals and the total number of citations per article over 9 years.…”

Section: Discussionmentioning

confidence: 97%

Does quality of research in otolaryngology correlate with academic impact?

Kazi

Vahidi

Sinkovich

et al. 2020

Laryngoscope Investig Oto

View full text Add to dashboard Cite

Objective: To determine if the quality of otolaryngology-related journal articles correlates with traditional measures of article impact. Methods: All articles published by Laryngoscope in 2011 were categorized according to level of evidence (LOE) according to the Oxford Center for Evidence Based Medicine rubric. Articles without a level of evidence assigned were alphabetically subcategorized type with letters AD corresponding to Contemporary Reports, Case Reports, Basic Science or Animal Studies, and Other respectively. Citations per article were then recorded per article each year from 2012 to 2018. Results: A total of 494 articles were included for analysis, 315 had numerical LOE and 179 had alphabetical LOE. There was a strong negative correlation between numerical LOE and median and interquartile number of citations (R = −.9014, P = .037). Overall, numerical LOE had a significantly higher median number of citations per article compared with the non-number/alphabetical group (14 vs 6, P < .001). Conclusions: Higher quality research as determined by level of evidence is in fact being cited more frequently than lower quality articles. Although the scope of this study was relatively limited, these data suggest that better designed studies may exhibit greater impact by traditional measures. Such findings should serve as an impetus for (and validation of) continued pursuit of high LOE research.

show abstract

Correlation Between Quality of Evidence and Number of Citations in Top 50 Cited Articles in Rotator Cuff Repair Surgery

Cited by 32 publications

References 29 publications

Critical Evaluation of the Methodologic Quality of the Top 50 Cited Articles Relating to Knee Dislocation and Multiligamentous Knee Injury

Critical Evaluation of the Methodologic Quality of the Top 50 Cited Articles Relating to Knee Dislocation and Multiligamentous Knee Injury

Assessment and Trends in the Methodological Quality of the Top 50 Most Cited Articles in Shoulder Instability

Does quality of research in otolaryngology correlate with academic impact?

Contact Info

Product

Resources

About