Scholarly Context Not Found: One in Five Articles Suffers from Reference Rot

Abstract

The emergence of the web has fundamentally affected most aspects of information communication, including scholarly communication. The immediacy that characterizes publishing information to the web, as well as accessing it, allows for a dramatic increase in the speed of dissemination of scholarly knowledge. But, the transition from a paper-based to a web-based scholarly communication system also poses challenges. In this paper, we focus on reference rot, the combination of link rot and content drift to which references to web resources included in Science, Technology, and Medicine (STM) articles are subject. We investigate the extent to which reference rot impacts the ability to revisit the web context that surrounds STM articles some time after their publication. We do so on the basis of a vast collection of articles from three corpora that span publication years 1997 to 2012. For over one million references to web resources extracted from over 3.5 million articles, we determine whether the HTTP URI is still responsive on the live web and whether web archives contain an archived snapshot representative of the state the referenced resource had at the time it was referenced. We observe that the fraction of articles containing references to web resources is growing steadily over time. We find one out of five STM articles suffering from reference rot, meaning it is impossible to revisit the web context that surrounds them some time after their publication. When only considering STM articles that contain references to web resources, this fraction increases to seven out of ten. We suggest that, in order to safeguard the long-term integrity of the web-based scholarly record, robust solutions to combat the reference rot problem are required. In conclusion, we provide a brief insight into the directions that are explored with this regard in the context of the Hiberlink project.

Reference rot in scholarly statement: threat and remedy

“…What is reported here complements previously published research papers 2, 3 and follows on from workshops delivered at two recent conferences: Electronic Theses and Dissertations 2014 (ETD2014) 4 and the UKSG 38th Annual Conference and Exhibition (UKSG2015). 5 The Hiberlink project was funded by the Andrew W Mellon Foundation and brought together the Los Alamos National Laboratory Research Library and the University of Edinburgh (EDINA and the Language Technology Group of the School of Informatics).…”

Doing Web history with the Internet Archive: screencast documentaries

“…Apart from the reputation problem, it is often argued that the Web's ephemerality, or perhaps its uneven maintenance, disproves its worthiness as source. Referenced URLs break, as links rot (Klein et al, 2014;Veronin, 2002). In this context, the WayBack Machine may be viewed as a set of well-tethered (rather than broken) source links.…”

Linkkimätä + sisältönyrjähdys = viitemätä

“…Viittausten määrä muuhun verkkoaineistoon kuin tieteellisiin artikkeleihin, URI references, kasvaa koko ajan. 2,4 Koska tieteellisillä artikkeleilla on usein pysyvä tunniste ja niihin suositellaan viitattavaksi hyperlinkin muodossa, käytän tässä muista verkkoaineistoviittauksista sanaa URI-viitteet*.…”