Analyzing web archives through topic and event focused sub-collections

Gossen, Gerhard; Demidova, Elena; Risse, Thomas

doi:10.1145/2908131.2908175

Cited by 5 publications

(6 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The goal of the event-centric extraction process is, given an event input and a Web archive, generate an interlinked collection of documents relevant to the input event that meet the collection specification. The differences of our research with Gossen's previous work [12] transfer to this work. However, we adapted Gossen's categorization of events as either planned or unexpected, and we renamed planned to expected (Table 2).…”

Section: Acronym Post Count Author Countmentioning

confidence: 48%

“…Not all collection building uses focused crawling. Gossen et al [12] proposed a methodology for extracting sub-collections from Web archive collections focused on specific topics and events (called the topic and event focused sub-collection). The topic and event focused sub-collection is defined as a collection of documents in a Web archive collected using a sub-collection specification.…”

Section: Acronym Post Count Author Countmentioning

confidence: 99%

See 1 more Smart Citation

Using Micro-Collections in Social Media to Generate Seeds for Web Archive Collections

Nwala

Weigle

Nelson

2019

2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL)

View full text Add to dashboard Cite

In a Web plagued by disappearing resources, Web archive collections provide a valuable means of preserving Web resources important to the study of past events ranging from elections to disease outbreaks. These archived collections start with seed URIs (Uniform Resource Identifiers) hand-selected by curators. Curators produce high quality seeds by removing non-relevant URIs and adding URIs from credible and authoritative sources, but it is time consuming to collect these seeds. Two main strategies adopted by curators for discovering seeds include scraping Web (e.g., Google) Search Engine Result Pages (SERPs) and social media (e.g., Twitter) SERPs. In this work, we studied three social media platforms in order to provide insight on the characteristics of seeds generated from different sources. First, we developed a simple vocabulary for describing social media posts across different platforms. Second, we introduced a novel source for generating seeds from URIs in the threaded conversations of social media posts created by single or multiple users. Users on social media sites routinely create and share posts about news events consisting of hand-selected URIs of news stories, tweets, videos, etc. In this work, we call these posts micro-collections, and we consider them as an important source for seeds because the effort taken to create micro-collections is an indication of editorial activity, and a demonstration of domain expertise. Third, we generated 23,112 seed collections with text and hashtag queries from 449,347 social media posts from Reddit, Twitter, and Scoop.it. We collected in total 120,444 URIs from the conventional scraped SERP posts and micro-collections. We characterized the resultant seed collections across multiple dimensions including the distribution of URIs, precision, ages, diversity of webpages, etc. We showed that seeds generated by scraping SERPs had a higher median probability (0.63) of producing relevant URIs than micro-collections (0.5). However, micro-collections were more likely to produce seeds with a higher precision than conventional SERP collections for Twitter collections generated with hashtags. Also, micro-collections were more likely to produce older webpages and more non-HTML documents.

show abstract

Section: Acronym Post Count Author Countmentioning

confidence: 48%

Section: Acronym Post Count Author Countmentioning

confidence: 99%

Using Micro-Collections in Social Media to Generate Seeds for Web Archive Collections

Nwala

Weigle

Nelson

2019

2019 ACM/IEEE Joint Conference on Digital Libraries (JCDL)

View full text Add to dashboard Cite

show abstract

“…Thus, we reviewed the collection structures of Archive-It 7 , the National Library of Australia's (NLA) PANDORA 8 and Trove 9 archives, the Croatian Web Archive (HAW) 10 , the Library of Congress Web Archive (LC), the United Kingdom Web Archive (UKWA) 11 , Conifer 12 (formerly Webrecorder [27]). Finally, we include the Internet Archive's 13 (IA) user account web archives because IA's Wayback Machine is synonymous with web archiving, even though its collections are tied to a specific user rather than a theme. While there are many web archiving initiatives [12,42], we focused on these eight platforms because they provide collections as defined above.…”

Section: Introductionmentioning

confidence: 99%

Creating Structure in Web Archives with Collections: Different Concepts from Web Archivists

Jones

Klein

et al. 2022

Linking Theory and Practice of Digital Libraries

View full text Add to dashboard Cite

As web archives' holdings grow, archivists subdivide them into collections so they are easier to understand and manage. In this work, we review the collection structures of eight web archive platforms: : Archive-It, Conifer, the Croatian Web Archive (HAW), the Internet Archive's user account web archives, Library of Congress (LC), PANDORA, Trove, and the UK Web Archive (UKWA). We note a plethora of different approaches to web archive collection structures. Some web archive collections support sub-collections and some permit embargoes. Curatorial decisions may be attributed to a single organization or many. Archived web pages are known by many names: mementos, copies, captures, or snapshots. Some platforms restrict a memento to a single collection and others allow mementos to cross collections. Knowledge of collection structures has implications for many different applications and users. Visitors will need to understand how to navigate collections. Future archivists will need to understand what options are available for designing collections. Platform designers need it to know what possibilities exist. The developers of tools that consume collections need to understand collection structures so they can meet the needs of their users. CCS CONCEPTS• Information systems → Web searching and information discovery; Digital libraries and archives.

show abstract

“…Instead, automatic methods are needed that can extract collections of documents related to a particular event of user interest. These collections need to preserve the original link structure to achieve a high degree of authenticity and enable the application of analytical methods on the relevant parts of the Web archive [14].…”

Section: Introductionmentioning

confidence: 99%

“…In previous work [26,14] we have argued that these users are typically interested in studying smaller and more focused event-centric collections of documents contained in a Web archive. Such collections can reflect specific events such as elections, sports tournaments or natural disasters, for example the Fukushima nuclear disaster in 2011, the German federal election in 2009 or the FIFA World Cup 2006, especially in regard to their media coverage and public reactions.…”

Section: Introductionmentioning

confidence: 99%

Extracting Event-Centric Document Collections from Large-Scale Web Archives

Gossen

Demidova

Risse

2017

Research and Advanced Technology for Digital Libraries

Self Cite

View full text Add to dashboard Cite

Abstract. Web archives are typically very broad in scope and extremely large in scale. This makes data analysis appear daunting, especially for non-computer scientists. These collections constitute an increasingly important source for researchers in the social sciences, the historical sciences and journalists interested in studying past events. However, there are currently no access methods that help users to efficiently access information, in particular about specific events, beyond the retrieval of individual disconnected documents. Therefore we propose a novel method to extract event-centric document collections from large scale Web archives. This method relies on a specialized focused extraction algorithm. Our experiments on the German Web archive (covering a time period of 19 years) demonstrate that our method enables the extraction of event-centric collections for different event types.

show abstract

Analyzing web archives through topic and event focused sub-collections

Cited by 5 publications

References 13 publications

Using Micro-Collections in Social Media to Generate Seeds for Web Archive Collections

Using Micro-Collections in Social Media to Generate Seeds for Web Archive Collections

Creating Structure in Web Archives with Collections: Different Concepts from Web Archivists

Extracting Event-Centric Document Collections from Large-Scale Web Archives

Contact Info

Product

Resources

About