The use and misuse of journal metrics and other citation indicators

Pendlebury, David

doi:10.1007/s00005-009-0008-y

Cited by 183 publications

(143 citation statements)

References 54 publications

Supporting

Mentioning

127

Contrasting

Unclassified

Order By: Relevance

“…Citation rates tend to be skewed (Pendlebury, 2009;Seglen, 1997) with a small number of articles being cited frequently and a large number of articles being cited infrequently. This pattern was evident in the citations to publications using GAP data.…”

Section: Resultsmentioning

confidence: 99%

“…The results of bibliometric analyses have been used as components in the performance evaluation process for research programs (Campbell and others, 2010;Frame, 1983;Gauthier, 1998;Kostoff, 1995;Leydesdorff, 2005;Narin, 1987;Trochim and others, 2008;Verbeek and others, 2002) and in science policy and planning (Irvine and others, 1987). Bibliometric analyses are not recommended as stand alone methods for evaluation but are considered a useful component to use in conjunction with other methods (Melkers, 1993;Pendlebury, 2009).…”

Section: Bibliometric Analysismentioning

confidence: 99%

See 1 more Smart Citation

Review and bibliometric analysis of published literature citing data produced by the Gap Analysis Program (GAP)

Ratz¹,

Conk²

2014

Open-File Report

View full text Add to dashboard Cite

For more information on the USGS-the Federal source for science about the Earth, its natural and living resources, natural hazards, and the environment-visit http://www.usgs.gov or call 1-888-ASK-USGS For an overview of USGS information products, including maps, imagery, and publications, visit http://www.usgs.gov/pubprodTo order this and other USGS information products, visit http://store.usgs.gov Suggested citation: Ratz, J.M., and Conk, S.J., 2014, Review and bibliometric analysis of published literature citing data produced by the Gap Analysis Program (GAP): U.S. Geological Survey Open-File Report 2013-1294. ISSN 2331ISSN -1258 Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government.Although this information product, for the most part, is in the public domain, it also may contain copyrighted materials as noted in the text. Permission to reproduce copyrighted items must be secured from the copyright owner. Tables Table 1. Journal title and number of articles from each journal . Executive SummaryThe Gap Analysis Program (GAP) of the U.S. Geological Survey (USGS) produces geospatial datasets providing information on land cover, predicted species distributions, stewardship (ownership and conservation status), and an analysis dataset which synthesizes the other three datasets. The intent in providing these datasets is to support the conservation of biodiversity. The datasets are made available at no cost. The initial datasets were created at the state level. More recent datasets have been assembled at regional and national levels.GAP entered an agreement with the Policy Analysis and Science Assistance branch of the USGS to conduct an evaluation to describe the effect that using GAP data has on those who utilize the datasets (GAP users). The evaluation project included multiple components: a discussion regarding use of GAP data conducted with participants at a GAP conference, a literature review of publications that cited use of GAP data, and a survey of GAP users. The findings of the published literature search were used to identify topics to include on the survey.This report summarizes the literature search, the characteristics of the resulting set of publications, the emergent themes from statements made regarding GAP data, and a bibliometric analysis of the publications. We cannot claim that this list includes all publications that have used GAP data. Given the time lapse that is common in the publishing process, more recent datasets may be cited less frequently in this list of publications. Reports or products that used GAP data may be produced but never published in print or released online. In that case, our search strategies would not have located those reports. Authors may have used GAP data but failed to cite it in such a way that the search strategies we used would have located those publications. These are common issues when using a literature search as part of an evaluation project. Although the final list of publications we...

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Bibliometric Analysismentioning

confidence: 99%

Review and bibliometric analysis of published literature citing data produced by the Gap Analysis Program (GAP)

Ratz¹,

Conk²

2014

Open-File Report

View full text Add to dashboard Cite

show abstract

“…Three major indicators are often used: the number of citations, the impact factor [25] (which is a timerelated average number of citations of a collection) and the h-index [19]. These are popular indicators used for the evaluation of scientists, however they can be subject to controversy [24] and are designed to reflect only the productivity of a scientist rather than measuring the production of knowledge.…”

Section: Introductionmentioning

confidence: 99%

Flows of Knowledge in Citation Networks

Renoust

Claver

Baffier

2016

Complex Networks &Amp; Their Applications V

View full text Add to dashboard Cite

Knowledge is created and transmitted through generation. Innovation is often seen as a generative process from collective intelligence, but how does innovation emerges from the blending of accumulated knowledge, and from which path an innovation mostly inherit? A citation network can be seen as a perfect example of a generative process leading to innovation. Inspired by the notion of "stream of knowledge", we propose to look at the question of production of knowledge under the lens of DAGs. Although many works look for the evaluation of publications, we propose to look for production of knowledge within a framework for analyzing DAGs. In this framework inspired by the work of Strahler, we can also account for other well known measures of influence such as the h-index. We propose then to analyze flows of influence in a citation networks as an ascending flow. We propose an efficient dynamic algorithm for integration with modern graph databases, conducting our experiment with the Arxiv HEP-TH dataset. Our results validate the use of DAG flows for citation flows and show evidence of the relevance of the h-index.

show abstract

“…Examples that illustrate this point are the journals in the field of mathematics, which generally accept about ten references and show a tendency of citations of old, usually classic, articles on the subject. Another example is the field of biological sciences, whose journals accept a greater number of references (about 40) and the cited articles tend to be recent ones (Fonseca, 2015;Andrés, 2011;Pendlebury, 2009). In this sense, the two databases under analysis classify the journals into categories, considering the scope of the journal and its characteristics.…”

mentioning

confidence: 99%

“…Considering that both the (1) Web of Science/ Thomson Reuters and (2) Scopus/SCImago/Elsevier databases provide bibliometric indicators that allow comparing the impact/quality of the journals, it seems to be outdated to classify the journals based on the impact factor using absolute counts instead of relative measures (Pendlebury, 2009).…”

mentioning

confidence: 99%