The Cyberarchive: A Look at the Storage and Preservation of Web Sites

Casey, Carol

doi:10.5860/crl.59.4.304

Cited by 10 publications

(4 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although the need for Web archiving has been understood since nearly the dawn of the Web [3], these efforts are for the most part independent in motivation, requirements, and scope. The Internet Archive 2 , the first archive to attempt global scope, came into existence in 1995 [10].…”

Section: Related Workmentioning

confidence: 99%

How much of the web is archived?

Ainsworth

AlSum

SalahEldeen

et al. 2011

Proceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries

View full text Add to dashboard Cite

Although the Internet Archive's Wayback Machine is the largest and most well-known web archive, there have been a number of public web archives that have emerged in the last several years. With varying resources, audiences and collection development policies, these archives have varying levels of overlap with each other. While individual archives can be measured in terms of number of URIs, number of copies per URI, and intersection with other archives, to date there has been no answer to the question "How much of the Web is archived?" We study the question by approximating the Web using sample URIs from DMOZ, Delicious, Bitly, and search engine indexes; and, counting the number of copies of the sample URIs exist in various public web archives. Each sample set provides its own bias. The results from our sample sets indicate that range from 35%-90% of the Web has at least one archived copy, 17%-49% has between 2-5 copies, 1%-8% has 6-10 copies, and 8%-63% has more than 10 copies in public web archives. The number of URI copies varies as a function of time, but no more than 31.3% of URIs are archived more than once per month.

show abstract

Section: Related Workmentioning

confidence: 99%

How much of the web is archived?

Ainsworth

AlSum

SalahEldeen

et al. 2011

Proceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries

View full text Add to dashboard Cite

show abstract

“…Although the need for web archiving has been understood since nearly the dawn of the Web [8], these efforts have been for the most part independent in motivation, requirements, and scope. The Internet Archive, the first archive to attempt global scope, came into existence in 1995 [15].…”

Section: Related Workmentioning

confidence: 99%

Evaluating sliding and sticky target policies by measuring temporal drift in acyclic walks through a web archive

Ainsworth

Nelson

2014

Int J Digit Libr

View full text Add to dashboard Cite

When a user views an archived page using the archive's user interface (UI), the user selects a datetime to view from a list. The archived web page, if available, is then displayed. From this display, the web archive UI attempts to simulate the web browsing experience by smoothly transitioning between archived pages. During this process, the target datetime changes with each link followed; drifting away from the datetime originally selected. When browsing sparselyarchived pages, this nearly-silent drift can be many years in just a few clicks. We conducted 200,000 acyclic walks of archived pages, following up to 50 links per walk, comparing the results of two target datetime policies. The Sliding Target policy allows the target datetime to change as it does in archive UIs such as the Internet Archive's Wayback Machine. The Sticky Target policy, represented by the Memento API, keeps the target datetime the same throughout the walk. We found that the Sliding Target policy drift increases with the number of walk steps, number of domains visited, and choice (number of links available). However, the Sticky Target policy controls temporal drift, holding it to less than 30 days on average regardless of walk length or number of domains visited. The Sticky Target policy shows some increase as choice increases, but this may be caused by other factors. We conclude that based on walk length, the Sticky Target policy generally produces at least 30 days less drift than the Sliding Target policy.

show abstract

“…The process of change often leaves no trace. Casey has commented that she got the impression that "a significant percentage of Web sites have the life span of a housefly and about as much chance as meeting an untimely end" [12]. A major concern has been the Web sites of major events, e.g.…”

Section: Technical Challengesmentioning

confidence: 99%

Preserving the Fabric of Our Lives: A Survey of Web Preservation Initiatives

Day

2003

Lecture Notes in Computer Science

View full text Add to dashboard Cite

This paper argues that the growing importance of the World Wide Web means that Web sites are key candidates for digital preservation. After an brief outline of some of the main reasons why the preservation of Web sites can be problematic, a review of selected Web archiving initiatives shows that most current initiatives are based on combinations of three main approaches: automatic harvesting, selection and deposit. The paper ends with a discussion of issues relating to collection and access policies, software, costs and preservation.

show abstract

The Cyberarchive: A Look at the Storage and Preservation of Web Sites

Cited by 10 publications

References 1 publication

How much of the web is archived?

How much of the web is archived?

Evaluating sliding and sticky target policies by measuring temporal drift in acyclic walks through a web archive

Preserving the Fabric of Our Lives: A Survey of Web Preservation Initiatives

Contact Info

Product

Resources

About