Journal impact evaluation: a webometric perspective

Thelwall, Mike

doi:10.1007/s11192-012-0669-x

Cited by 37 publications

(31 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Webometrics and altmetrics can be applied at the level of a journal (Thelwall, 2012;Vaughan & Hysen, 2002), a single article (Kousha, Thelwall, & Rezaie, 2010;Vaughan & Shaw, 2003), or an individual researcher (Aguinis, Suárez-González, Lannelongue, & Joo, 2012). In their roadmap, the authors of the Altmetrics Manifesto call for research that compares altmetrics with other measures of academic influence: "Researchers must ask if altmetrics really reflect impact, or just empty buzz.…”

Section: New Approaches: Altmetricsmentioning

confidence: 99%

A relational altmetric? Network centrality onResearchGate as an indicator of scientific impact

Hoffmann

Lutz

Meckel

2015

Asso for Info Science & Tech

View full text Add to dashboard Cite

Social media are becoming increasingly popular in scientific communication. A range of platforms, such as academic social networking sites (SNS), are geared specifically towards the academic community. Proponents of the altmetrics approach have pointed out that new media allow for new avenues of scientific impact assessment. Traditional impact measures based on bibliographic analysis have long been criticized for overlooking the relational dynamics of scientific impact. We therefore propose an application of social network analysis to researchers' interactions on an academic social networking site to generate potential new metrics of scientific impact. Based on a case study conducted among a sample of Swiss management scholars, we analyze how centrality measures derived from the participants' interactions on the academic SNS ResearchGate relate to traditional, offline impact indicators. We find that platform engagement, seniority, and publication impact contribute to members' indegree and eigenvector centrality on the platform, but less so to closeness or betweenness centrality. We conclude that a relational approach based on social network analyses of academic SNS, while subject to platform-specific dynamics, may add richness and differentiation to scientific impact assessment.

show abstract

Section: New Approaches: Altmetricsmentioning

confidence: 99%

A relational altmetric? Network centrality onResearchGate as an indicator of scientific impact

Hoffmann

Lutz

Meckel

2015

Asso for Info Science & Tech

View full text Add to dashboard Cite

show abstract

“…Many studies have found correlations between usage and bibliometric indicators for articles and usage data could be extracted from different sources such as publishers, aggregator services, digital libraries and academic social web sites. Nonetheless, the usage statistics could be inflated or manipulated and some articles may be downloaded or printed but not read or may be read offline or via different websites such as authors' CVs and digital repositories (Thelwall, 2012). Hence, integrated usage statistics from different sources such as publisher's websites, repositories and academic social web sites, if they are not manipulated in advance, would be optimal for global usage data.…”

Section: Discussionmentioning

confidence: 99%

“…Another important genre is the medical blog, which tends to have an educated professional author that attempts to communicate the implications of research findings to the general public ( . In terms of authorship, about 60% of a sample of 126 ResearchBlogging.org bloggers were affiliated with academic institutions, 65% were graduate students, and 72% of ResearchBlogging.org blogs were written by one or two male authors, indicating important gender differences (Shema; Bar-Ilan; Thelwall, 2012). Academics appear to be less dominant in one German scientific blogging platform, however, and 60% declared that dissemination of their field of research to general public was their main reason for blogging (Puschmann; Mahrt, 2012).…”

Section: Science Blogsmentioning

confidence: 99%

Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web

Thelwall¹,

Kousha²

2015

EPI

Self Cite

View full text Add to dashboard Cite

The extensive use of the web by many sectors of society has created the potential for new wider impact indicators. This article reviews research about Google Scholar and Google Patents, both of which can be used as sources of impact indicators for academic articles. It also briefly reviews methods to extract types of links and citations from the web as a whole, although the indicators that these generate are now probably too broad and too dominated by automatically generated websites, such as library and publisher catalogues, to be useful in practice. More valuable web-based indicators can be derived from specific types of web pages that cite academic research, such as online presentations, course syllabi, and science blogs. These provide evidence that is easier to understand and use and less likely to be affected by unwanted types of automatically generated content, although they are susceptible to gaming. KeywordsWebometrics; Altmetrics; Alternative metrics; Alternative indicators; Citation analysis; Web indicators; Scientometrics; Google Scholar. ResumenEl gran uso de la web por parte de muchos sectores de la sociedad ha creado el potencial para nuevos indicadores de impacto más amplios. Este artículo revisa la investigación sobre Google Scholar y Google Patents, servicios que pueden ser utilizados como fuente de indicadores de impacto de artículos académicos. También se examinan brevemente los métodos para extraer tipos de enlaces y citas de la Web en su conjunto, aunque para que sean útiles en la práctica los indicadores que éstos generan ahora son probablemente demasiado amplios y demasiado dominados por sitios web generados automáticamente, como catálogos de biblioteca y de editoriales. Indicadores basados en la web más valiosos se pueden derivar Manuscript

show abstract

“…Firstly, using article usage data in scientometrics research needs to be scrutinized. For example, downloads may not have equal value, and papers may be downloaded but never read (Thelwall 2012). Also, sometimes, the download of an article may be intended for teaching purpose, rather than research purpose (Thelwall 2008).…”

Section: Conclusion and Discussionmentioning

confidence: 99%

“…A variety of usage metrics are applied in scientometrics studies, for instance, research evaluation (Davis et al 2008;Davis and Solla 2003), impact assessment (Brody et al 2006;Davis et al 2008;Shuai et al 2012), and user behavior study (Davis and Price 2006;Davis and Solla 2003). Scientific publishers record and store usage information of each article, and sometimes they report this information to editors or editorial board (Thelwall 2012). However, this kind of usage data is rarely made public.…”

Section: Introductionmentioning

confidence: 99%

Usage history of scientific literature: Nature metrics and metrics of Nature publications

Wang

Mao

et al. 2013

Scientometrics

View full text Add to dashboard Cite

Abstract:In this study, we analyze the dynamic usage history of Nature publications over time using Nature metrics data. We conduct analysis from two perspectives. On the one hand, we examine how long it takes before the articles' downloads reach 50%/80% of the total; on the other hand, we compare the percentage of total downloads in 7 days, 30 days, and 100 days after publication. In general, papers are downloaded most frequently within a short time period right after their publication. And we find that compared with Non-Open Access papers, readers' attention on Open Access publications are more enduring. Based on the usage data of a newly published paper, regression analysis could predict the future expected total usage counts.

show abstract

Journal impact evaluation: a webometric perspective

Cited by 37 publications

References 55 publications

A relational altmetric? Network centrality onResearchGate as an indicator of scientific impact

A relational altmetric? Network centrality onResearchGate as an indicator of scientific impact

Web indicators for research evaluation. Part 1: Citations and links to academic articles from the Web

Usage history of scientific literature: Nature metrics and metrics of Nature publications

Contact Info

Product

Resources

About