How accurate are policy document mentions? A first look at the role of altmetrics database

Yu, Houqiang; Cao, Xueting; Xiao, Tingting; Yang, Zhenyi

doi:10.1007/s11192-020-03558-7

Cited by 13 publications

(5 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Chinese scholars also conducted some empirical research as investigating the comprehensive evaluation model integrating altmetrics and citation indicators (H. Li & Ren, 2020;Peng et al, 2018;Zhai et al, 2020), the factors associated with altmetric indicators (Li & Hao, 2019), and design and develop of altmetric indicator on Sina Weibo (Yu et al, 2017), news report (Yu, Cao, & Wang, 2020), policy documents (Yu Cao, Xiao, & Yang, 2020), social impact of individuals ( Guo & Xiao, 2019), books (Jiang et al, 2020;Wang et al, 2019;, journals , datasets (L. and papers .…”

Section: Local Altmetric Studies In Chinamentioning

confidence: 99%

Academic use of social media in China: A review of the Literature

2023

DSI

View full text Add to dashboard Cite

Altmetric indicators are largely affected by countries or regions, especially for non-English speaking countries such as China, Japan, Russia, etc. Although China is the largest county in terms of the number of social media users, we still know little on the academic use of local social media tools and local altmetric indicators in China. The purpose of this paper is to present the landscape of local altmetrics in China, including the local social media platform for academic use, local altmetric data sources and indicators, as well as the local altmetric studies conducted by Chinese scholars.

show abstract

Section: Local Altmetric Studies In Chinamentioning

confidence: 99%

Academic use of social media in China: A review of the Literature

2023

DSI

View full text Add to dashboard Cite

show abstract

“…Research in this area is in its infancy, but at least one recent study sought to evaluate the accuracy of policy document altmetrics. Yu, Cao, Xiao, and Yang (2020) examined 2079 records from all 79 (as of the study date) policy document source platforms drawn on for the AAS, then checked for errors in policy document altmetrics data relative to citation data (e.g., were author names correctly recorded across both sources?). Altmetrics were not without their shortcomings, but the authors concluded: "Considering the high complexity of extracting mentions of publications from various sources and formats of policy documents as well as its short history, [the] Altmetric database has achieved excellent performance" (p. 1517).…”

Section: Altmetrics and Aas Researchmentioning

confidence: 99%

Is Criminology & Public Policy “influential?” Answers from altmetrics

Worrall

Gordon

2022

Criminology & Public Policy

View full text Add to dashboard Cite

Research Summary We use an altmetric aggregator, the Altmetric Attention Score (AAS), to rank the influence of articles published in Criminology & Public Policy from the journal's inception through July 31, 2022. We also rank articles based on specific AAS components, namely, Twitter, news, and policy document mentions. Last, we regress AASs on article‐level predictors, including research category, funding, open access type, and time since publication. With few exceptions, policing scholarship far outweighs other categories of research in terms of AAS‐measured societal impact. Policy Implications In contrast to bibliometrics (e.g., citation counts), altmetrics measure scholarship's societal impact, including its influence on policy. Since Criminology & Public Policy was initially created with the intention of influencing crime‐related policy, it is important to gauge the extent to which that has occurred. Other policy‐oriented (or perhaps all) criminal justice/criminology journals should evaluate their influence via altmetrics.

show abstract

“…For example, through a series of studies (Yu et al. , 2020a, b, 2017a,b, 2016, 2019a,b), scholars have found that the journal distribution of altmetrics data on Sina Weibo satisfies the logarithmic curve rule, while the journal level distribution of policy documents and news altmetrics data follow Bradford's law. However, compared with the former two indicators, news indicators have their unique core sources.…”

Section: Literature Reviewmentioning

confidence: 99%

Research on the relationships between discourse leading indicators and citations: perspectives from altmetrics indicators of international multidisciplinary academic journals

Wang

Feng

2022

LHT

View full text Add to dashboard Cite

PurposeThis paper aims to analyze the relationships between discourse leading indicators and citations from perspectives of integrating altmetrics indicators and tries to provide references for comprehending the quantitative indicators of scientific communication in the era of open science, constructing the evaluation indicator system of the discourse leading for academic journals and then improving the discourse leading of academic journals.Design/methodology/approachBased on the theory of communication and the new pattern of scientific communication, this paper explores the formation process of academic journals' discourse leading. This paper obtains 874,119 citations and 6,378,843 altmetrics indicators data from 65 international multidisciplinary academic journals. The relationships between indicators of discourse leading (altmetrics) and citations are studied by using descriptive statistical analysis, correlation analysis, principal component analysis, negative binomial regression analysis and marginal effects analysis. Meanwhile, the connotation and essential characteristics of the indicators, the strength and influence of the relationships are further analyzed and explored. It is proposed that academic journals' discourse leading is composed of news discourse leading, social media discourse leading, peer review discourse leading, encyclopedic discourse leading, video discourse leading and policy discourse leading.FindingsIt is discovered that the 15 altmetrics indicators data have a low degree of centralization to the center and a high degree of polarization dispersion overall; their distribution patterns do not follow the normal distributions, and their distributions have the characteristics of long-tailed right-peaked curves. Overall, 15 indicators show positive correlations and wide gaps exist in the number of mentions and coverage. The academic journals' discourse leading significantly affects total cites. When altmetrics indicators of international mainstream academic and social media platforms are used to explore the connotation and characteristics of academic journals' discourse leading, the influence or contribution of social media discourse, news discourse, video discourse, policy discourse, peer review discourse and encyclopedia discourse on the citations decreases in turn.Originality/valueThis study is innovative from the academic journal level to analyze the deep relationships between altmetrics indicators and citations from the perspective of correlation. First, this paper explores the formation process of academic journals' discourse leading. Second, this paper integrates altmetrics indicators to study the correlation between discourse leading indicators and citations. This study will help to enrich and improve basic theoretical issues and indicators’ composition, provide theoretical support for the construction of the discourse leading evaluation system for academic journals and provide ideas for the evaluation practice activities.

show abstract

How accurate are policy document mentions? A first look at the role of altmetrics database

Cited by 13 publications

References 30 publications

Academic use of social media in China: A review of the Literature

Academic use of social media in China: A review of the Literature

Is Criminology & Public Policy “influential?” Answers from altmetrics

Research on the relationships between discourse leading indicators and citations: perspectives from altmetrics indicators of international multidisciplinary academic journals

Contact Info

Product

Resources

About