The Relative Citation Ratio: An Impartial Assessment of Productivity in Academic Otolaryngologists

Abstract

ObjectivesQuantification of academic productivity relies on bibliometric measurements, such as the Hirsch index (h‐index). The National Institutes of Health (NIH) recently developed the relative citation ratio (RCR), an article‐level, citation‐driven metric that compares researchers with others within their respective fields. Our study is the first to compare the usage of RCR in academic otolaryngology.Study DesignRetrospective Database Review.MethodsAcademic otolaryngology residency programs were identified using the 2022 Fellowship and Residency Electronic Interactive Database. Demographic and training data were collected for surgeons using institutional websites. RCR was calculated using the NIH iCite tool, and h‐index was calculated using Scopus. Mean RCR (m‐RCR) is the average score of the author's articles. Weighted RCR (w‐RCR) is the sum of all article scores. These derivatives are a measure of impact and output, respectively. The career duration of a physician was categorized into the following cohorts: 0–10, 11–20, 21–30, and 31+ years.ResultsA total of 1949 academic otolaryngologists were identified. Men had higher h‐indices and w‐RCRs than women (both p less than 0.001). m‐RCR was not different between genders (p = 0.083). There was a difference in h‐index and w‐RCR (both p less than 0.001) among the career duration cohorts, but there was no difference in m‐RCR among the cohorts (p = 0.416). The faculty rank professor was the greatest for all metrics (p < 0.001).ConclusionCritics of the h‐index argue that it is reflective of the time a researcher has spent in the field, instead of impact. The RCR may reduce historic bias against women and younger otolaryngologists.Level of EvidenceN/A Laryngoscope, 2023

Factors Associated with Research Productivity and National Institutes of Health Funding in Academic Otology

“…32,34,35 Previous studies have shown that bibliometrics including the h-index and RCR are positively correlated with academic promotion and career duration. 3,6,8,34 Our study similarly demonstrated an association between both the h-index and w-RCR and academic rank, and the h-index and career duration. Full professors had higher h-index and w-RCR scores than associate and assistant professors.…”

“…Otologists receiving NIH funding were more likely to have a master's degree (18.3% vs. 8.2%, p = 0.020) or PhD (31.0% vs. 7.2%, p < 0.001) than those not receiving NIH funding. Otologists receiving NIH funding had significantly greater median (interquartile range [IQR]) h-index (25 vs. 11 [7][8][9][10][11][12][13][14][15][16][17]), m-RCR (1.6 [1.3-2.2] vs. 1.2 [0.9-1.7]), and w-RCR (105.4 [55.7-175.1] vs. 26.6 [12.2-61.8]) than those not receiving NIH funding (all p < 0.001).…”

“…1). Men had higher median (IQR) h-index (16 [9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25][26] vs 9 [6][7][8][9][10][11][12][13][14]) and w-RCR (51.8 [17.4-101.2] vs. 23.0 [13.0-37.4]) than women (both p < 0.001) (Table IV). Men and women had similar m-RCRs (1.3 [1.0-1.9] vs. 1.3 [1.0-1.8], p = 0.269).…”

“…However, full professors had higher h-index (29 [20][21][22][23][24][25][26][27][28][29][30][31][32][33][34][35][36][37][38] vs. 14 [9][10][11][12][13][14][15][16][17][18][19][20]) and w-RCR (99.9 [51. 6-198.8] vs. 32.7 [14.0-66.3]) than associate professors; associate professors had higher h-index (14 [9][10][11][12][13][14][15][16][17][18][19][20] vs. 9 [5][6][7][8][9][10][11]…”

“…To account for discrepancies in search results based on author name in iCite, the Scopus author lookup feature was utilized to export PubMed IDs from an author's profile into iCite to record m-RCR and w-RCR, as previously described. 8…”