Measuring the impact of pharmacoepidemiologic research using altmetrics: A case study of a<scp>CNODES</scp>drug‐safety article

Gamble, John‐Michael; Traynor, Robyn; Gruzd, Anatoliy; Mai, Philip; Dormuth, Colin R.; Sketris, Ingrid

doi:10.1002/pds.4401

Cited by 17 publications

(6 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…4 A recent study concerning pharmacoepidemiologic research concluded that altmetrics confer a more comprehensive evaluation of research impact, as they are able to incorporate the activity and engagement of scholarly and nonacademic communities alike. 10 Future research will need to focus on better delineating the impact of altmetrics in the age of growing social media, as it appears that altmetrics may have a large role in disseminating publications regarding the orthopaedic surgery literature.…”

Section: Discussionmentioning

confidence: 99%

What Is the Predictive Ability and Academic Impact of the Altmetrics Score and Social Media Attention?

et al. 2020

View full text Add to dashboard Cite

Background: Citation rate and journal impact factor have traditionally been used to assess research impact; however, these may fail to represent impact beyond the sphere of academics. Given that social media is now used to disseminate research, alternative web-based metrics (altmetrics) were recently developed to better understand research impact on social media. However, the relationship between altmetrics and traditional bibliometrics in orthopaedic literature is poorly understood. Purpose: To (1) assess the extent that altmetrics correlate with traditional bibliometrics and (2) identify publication characteristics that predict greater altmetrics scores. Study Design: Cross-sectional study. Methods: Articles published in The American Journal of Sports Medicine ( AJSM), The Journal of Bone and Joint Surgery, Clinical Orthopaedics and Related Research, Acta Orthopaedica, and Knee Surgery, Sports Traumatology, Arthroscopy between January 2016 and December 2016 were analyzed. Among the extracted publication characteristics were journal, number of authors, geographic region of origin, highest degree of first author, study subject and design, sample size, conflicts of interest, and level of evidence; number of references, institutions, citations, tweets, Facebook mentions, and news mentions; and Altmetric Attention Score (AAS). Multivariate regressions were used to determine (1) publication characteristics predictive of AAS and social media attention (mentions on Twitter, Facebook, and the news) and (2) the relationship between AAS and citation rate. Results: A total of 496 published articles were included, with a mean AAS of 8.6 (SD, 31.7; range, 0-501) and a mean citation rate of 15.0 (SD, 16.1; range, 0-178). Articles in AJSM (β = 19.9; P < .001), publications from North America (β = 8.5; P = .033), and studies concerning measure validation/reliability (β = 25.5; P = .004) were independently associated with higher AAS. Greater AAS score significantly predicted a greater citation rate (β = 0.16; P < .0001). The citation rate was an independent predictor of greater social media attention on Twitter, Facebook, and the news (odds ratio range, 1.02-1.03; P < .05 all). Conclusion: AAS had a significant positive association with citation rates of articles in 5 high-impact orthopaedic journals. Articles in AJSM, studies concerning measure validation and reliability, and publications from North America were positively associated with greater AAS. A greater number of citations was consistently associated with publication attention received on social media platforms.

show abstract

Section: Discussionmentioning

confidence: 99%

What Is the Predictive Ability and Academic Impact of the Altmetrics Score and Social Media Attention?

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Extending this study to social media coverage would be a valuable addition; there are large and meaningful discussion sections accompanying some of the articles in this study (eg, doc09). Our research group has studied the altmetrics of our research on social media [81]. Combining these two research arms in a single stream could provide more nuanced results.…”

Section: Future Studymentioning

confidence: 99%

Using Natural Language Processing to Examine the Uptake, Content, and Readability of Media Coverage of a Pan-Canadian Drug Safety Research Project: Cross-Sectional Observational Study

et al. 2020

Self Cite

View full text Add to dashboard Cite

Background Isotretinoin, for treating cystic acne, increases the risk of miscarriage and fetal abnormalities when taken during pregnancy. The Health Canada–approved product monograph for isotretinoin includes pregnancy prevention guidelines. A recent study by the Canadian Network for Observational Drug Effect Studies (CNODES) on the occurrence of pregnancy and pregnancy outcomes during isotretinoin therapy estimated poor adherence to these guidelines. Media uptake of this study was unknown; awareness of this uptake could help improve drug safety communication. Objective The aim of this study was to understand how the media present pharmacoepidemiological research using the CNODES isotretinoin study as a case study. Methods Google News was searched (April 25-May 6, 2016), using a predefined set of terms, for mention of the CNODES study. In total, 26 articles and 3 CNODES publications (original article, press release, and podcast) were identified. The article texts were cleaned (eg, advertisements and links removed), and the podcast was transcribed. A dictionary of 1295 unique words was created using natural language processing (NLP) techniques (term frequency-inverse document frequency, Porter stemming, and stop-word filtering) to identify common words and phrases. Similarity between the articles and reference publications was calculated using Euclidian distance; articles were grouped using hierarchical agglomerative clustering. Nine readability scales were applied to measure text readability based on factors such as number of words, difficult words, syllables, sentence counts, and other textual metrics. Results The top 5 dictionary words were pregnancy (250 appearances), isotretinoin (220), study (209), drug (201), and women (185). Three distinct clusters were identified: Clusters 2 (5 articles) and 3 (4 articles) were from health-related websites and media, respectively; Cluster 1 (18 articles) contained largely media sources; 2 articles fell outside these clusters. Use of the term isotretinoin versus Accutane (a brand name of isotretinoin), discussion of pregnancy complications, and assignment of responsibility for guideline adherence varied between clusters. For example, the term pregnanc appeared most often in Clusters 1 (14.6 average times per article) and 2 (11.4) and relatively infrequently in Cluster 3 (1.8). Average readability for all articles was high (eg, Flesch-Kincaid, 13; Gunning Fog, 15; SMOG Index, 10; Coleman Liau Index, 15; Linsear Write Index, 13; and Text Standard, 13). Readability increased from Cluster 2 (Gunning Fog of 16.9) to 3 (12.2). It varied between clusters (average 13th-15th grade) but exceeded the recommended health information reading level (grade 6th to 8th), overall. Conclusions Media interpretation of the CNODES study varied, with differences in synonym usage and areas of focus. All articles were written above the recommended health information reading level. Analyzing media using NLP techniques can help determine drug safety communication effectiveness. This project is important for understanding how drug safety studies are taken up and redistributed in the media.

show abstract

“…In this paper wider interest in scientific outputs is measured by altmetric indicators. We are aware that altmetric data are not standardized, that impact may be manipulated due to gaming (Gamble et al, 2017), that it lacks an integrative theory and may not reflect scientific impact (Williams, 2017;Roemer and Borchardt, 2015). However, altmetric interest in Biomedical and Life sciences is likely to be high (Fang et al, 2020) and use of Internet and related social media can be intensified for the acquisition of information during health emergency (An et al, 2018).…”

Section: Rapid Response To Covid-19 In Latin Americamentioning

confidence: 99%

The nature of rapid response to COVID-19 in Latin America: an examination of Argentina, Brazil, Chile, Colombia and Mexico

Costa

Campos

Cintra

et al. 2021

OIR

View full text Add to dashboard Cite

PurposeThe coronavirus-19 (COVID-19) pandemic mobilized the international scientific community in the search for its cure and containment. The purpose of this paper is to examine the nature of the rapid response to the COVID-19 of the scientific community in selected Latin American countries (Argentina, Brazil, Chile, Colombia and Mexico) in the period running from January to August 2020. Rapid response is reconceptualized from its original meaning in health policy, as the swift mobilization of existing scientific resources to address an emergency (DeVita et al., 2017).Design/methodology/approachThe paper explores the rapid response of the Argentinian, Brazilian, Chilean, Colombian and Mexican scientific communities from the perspective of bibliometric and altmetric data. The authors will examine scientific publications indexed to the Web of Science (WoS) dealing with COVID-19. Besides patterns of scientific output and impact as measured by citations, the authors complement the analysis with altmetric analysis. The aim is to verify whether or not factors that explain the extent of scientific impact can also be identified with respect to the wider impact made evident by altmetric indicators (Haustein, 2016).Findingshe authors identified a somewhat limited response of the Argentinian, Brazilian, Chilean, Colombian and Mexican scientific communities to COVID-19 in terms of quantity of publications. The authorship of publications in the topic of COVID-19 was associated with authorship of publications dealing with locally relevant diseases. Some factors appear to contribute to visibility of scientific outputs. Papers that involved wider international collaborations and authors with previous publications in arboviruses were associated with higher levels of citations. Previous work on arbovirus was also associated with higher altmetric attention. The country of origin of authors exerted a positive effect on altmetric indicators.Research limitations/implicationsA limitation in the analysis is that, due to the nature of the data source (WoS), the authors were unable to verify the career status and the productivity of the authors in the sample. Nonetheless, the results appear to suggest that there is some overlapping in authors conducting research in Arboviruses and COVID-19. Career status and productivity should be the focus of future research.Practical implicationsIn the context of countries with limited scientific resources, like the ones investigated in our Latin American sample, previous efforts in the study of locally relevant diseases may contribute to the creation of an expertise that can be applied when a health emergency brings about a novel disease.Originality/valueThe originality of the paper rests on the fact that the authors identified that previous work on arbovirus contributed to the scientific visibility of publications on COVID-19.

show abstract

Measuring the impact of pharmacoepidemiologic research using altmetrics: A case study of aCNODESdrug‐safety article

Cited by 17 publications

References 39 publications

What Is the Predictive Ability and Academic Impact of the Altmetrics Score and Social Media Attention?

What Is the Predictive Ability and Academic Impact of the Altmetrics Score and Social Media Attention?

Using Natural Language Processing to Examine the Uptake, Content, and Readability of Media Coverage of a Pan-Canadian Drug Safety Research Project: Cross-Sectional Observational Study

The nature of rapid response to COVID-19 in Latin America: an examination of Argentina, Brazil, Chile, Colombia and Mexico

Contact Info

Product

Resources

About