Abstract:Authors' motivations for citing documents are addressed through a literature review and an empirical study. Replicating an investigation in psychology, the works of two highly‐cited authors in the discipline of communication were identified, and all of the authors who cited them during the period 1995–1997 were surveyed. The instrument posed 32 questions about why a certain document was cited, plus questions about the citer's relationship to the cited author and document. Most findings were similar to the psyc… Show more
“…References are known to be made for a diverse set of reasons, not all positive, yet they can yield useful information (Garfield, 1979). The causes for concern over the reliability of traditional citation counts are numerous, but include their use for criticism of previous work (Case & Higgins, 2000) and that the figures are a potential source of manipulation (Gowrishankar, Divakar, Baylis, Gravenor, & Kao, 1999). With refereed online journals, moreover, new motivations for referencing can be ascertained that have not been observed in traditional journals (Kim, 2000).…”
Much has been written about the potential and pitfalls of macroscopic Web-based link analysis, yet there have been no studies that have provided clear statistical evidence that any of the proposed calculations can produce results over large areas of the Web that correlate with phenomena external to the Internet. This article attempts to provide such evidence through an evaluation of Ingwersen's (1998) proposed external Web Impact Factor (WIF) for the original use of the Web: the interlinking of academic research. In particular, it studies the case of the relationship between academic hyperlinks and research activity for universities in Britain, a country chosen for its variety of institutions and the existence of an official government rating exercise for research. After reviewing the numerous reasons why link counts may be unreliable, it demonstrates that four different WIFs do, in fact, correlate with the conventional academic research measures. The WIF delivering the greatest correlation with research rankings was the ratio of Web pages with links pointing at research-based pages to faculty numbers. The scarcity of links to electronic academic papers in the data set suggests that, in contrast to citation analysis, this WIF is measuring the reputations of universities and their scholars, rather than the quality of their publications.
“…References are known to be made for a diverse set of reasons, not all positive, yet they can yield useful information (Garfield, 1979). The causes for concern over the reliability of traditional citation counts are numerous, but include their use for criticism of previous work (Case & Higgins, 2000) and that the figures are a potential source of manipulation (Gowrishankar, Divakar, Baylis, Gravenor, & Kao, 1999). With refereed online journals, moreover, new motivations for referencing can be ascertained that have not been observed in traditional journals (Kim, 2000).…”
Much has been written about the potential and pitfalls of macroscopic Web-based link analysis, yet there have been no studies that have provided clear statistical evidence that any of the proposed calculations can produce results over large areas of the Web that correlate with phenomena external to the Internet. This article attempts to provide such evidence through an evaluation of Ingwersen's (1998) proposed external Web Impact Factor (WIF) for the original use of the Web: the interlinking of academic research. In particular, it studies the case of the relationship between academic hyperlinks and research activity for universities in Britain, a country chosen for its variety of institutions and the existence of an official government rating exercise for research. After reviewing the numerous reasons why link counts may be unreliable, it demonstrates that four different WIFs do, in fact, correlate with the conventional academic research measures. The WIF delivering the greatest correlation with research rankings was the ratio of Web pages with links pointing at research-based pages to faculty numbers. The scarcity of links to electronic academic papers in the data set suggests that, in contrast to citation analysis, this WIF is measuring the reputations of universities and their scholars, rather than the quality of their publications.
“…Both approaches have pros and cons (Case & Higgins, 2000;Harwood, 2008;Prabha, 1983;Shadish et al, 1995), and the present study chose to use the latter, which relies on the researchers' judgment or interpretation instead of the citing authors' motivational claims. This approach is unobtrusive but speculative, and can suffer from a low degree of confidence and accuracy, thus creating reliability concerns.…”
Section: Methodsmentioning
confidence: 99%
“…Beginning in the 1970s, a great deal of research has been done on citer motives, citing behaviors, and citation functions. It was at this time that the use of citation analysis in research evaluation caused concerns that citations may not represent the actual use of the cited documents, and that citation counts that do not take into account citers' motives, citing behavior, and citation functions may not reflect the impact or merit of the cited documents (Brooks 1985(Brooks , 1986Case & Higgins, 2000;Chubin & Moitra, 1975;Garfield, 1962;Liu, 1993;Moravcsik & Murugesan, 1975;Shadish et al, 1995;Vinkler, 1987;White & Wang, 1997). These studies have also been reviewed in various contexts and for different purposes (e.g.…”
Purpose: (1) To test basic assumptions underlying frequency-weighted citation analysis: (a) Uni-citations correspond to citations that are nonessential to the citing papers; (b) The influence of a cited paper on the citing paper increases with the frequency with which it is cited in the citing paper. (2) To explore the degree to which citation location may be used to help identify nonessential citations. Findings: Filtering out nonessential citations before assigning weight is important for frequency-weighted citation analysis. For this purpose, removing citations by location is more effective than re-citation analysis that simply removes uni-citations. Removing all citation occurrences in the Background and Literature Review sections and uni-citations in the Introduction section appears to provide a good balance between filtration and error rates.
Research limitations:This case study suffers from the limitation of scalability and generalizability. We took careful measures to reduce the impact of other limitations of the data collection approach used. Relying on the researcher's judgment to attribute citation functions, this approach is unobtrusive but speculative, and can suffer from a low degree of confidence, thus creating reliability concerns.
Practical implications:Weighted citation analysis promises to improve citation analysis for research evaluation, knowledge network analysis, knowledge representation, and information retrieval. The present study showed the importance of filtering out nonessential citations before assigning weight in a weighted citation analysis, which may be a significant step forward to realizing these promises.
“…When an individual publication is being analysed, a classification scheme may be designed that is specific to that publication: examples of this approach include studies of books on software engineering (McCain and Salvucci, 2006) and on strategic management (Anderson, 2006) and of articles on molecular biology (Ahmed et al, 2004;McCain and Turner, 1989), organizational theory (Anderson and Sun, 2010;Lounsbury and Carberry, 2005;Mizruchi and Fein, 1999) and neuropharmacology and the sociology of science (Cozzens, 1985). Other classification schemes have been developed for analyzing citations to the works of an individual author (Brittain, 2000) and to an individual journal (Spiegel-Rosing, 1977) or, most commonly, for use across the whole range of subjects and types of publication (Bonzi and Snyder, 1991;Cano, 1989;Case and Higgins, 2000;Chubin and Moitra, 1975;Meho and Sonnenwald, 2000;Moravesik and Murugesan, 1975;Oppenheim and Renn, 1978;Peritz, 1983;Shadish et al, 1995;Vinkler, 1987).…”
Section: Classifications Of Citer Motivationsmentioning
Purpose -The aim of this paper is to determine the extent to which readers perceive correctly the reasons why authors cite items in scholarly texts. Design/methodology/approach -The authors of ten library and information science articles provided the reasons for citing material in their articles and these reasons were compared with those suggested independently by readers of the articles. Findings -Readers are able to perceive correctly author reasons for citation only to a very limited extent.Research limitations/implications -Limitations are a small sample of ten articles and 45 reader assessments of those articles, and the use of a single classification of reasons for citation. Practical implications -The findings call into question techniques such as citation context analysis that are based on the assumption that readers understand the reasons why authors cite material. Originality/value -This is the first attempt to compare author and reader reasons for citation and hence to validate the use of citation context analysis.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.