Hypercane: Intelligent Sampling for Web Archive Collections

Jones, Shawn; Weigle, Michele C.; Klein, Martin; Nelson, Michael L.

doi:10.1109/jcdl52503.2021.00049

Cited by 5 publications

(4 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A good example is a local newspaper. A resident of Santa Fe, for example, will likely want to know what content is relevant to their city, and hence would be better served by the curation services of the Santa Fe New Mexican 18 than they would by the Seattle Times 19 . The newspaper changes every day, but the content reflects the local area.…”

Section: Only Displaying the Presentmentioning

confidence: 99%

“…We designed Raintale this way so that users can easily integrate it into shell scripts with other utilities, such as Hypercane [19,20,21], that can provide it a list of mementos or an automated utility that might produce different templates for different use cases. We intend for Raintale to be part of an automated web archiving workflow, and we provide features that allow the archivist to customize its output to their needs.…”

Section: Telling Stories From Web Archives With Raintalementioning

confidence: 99%

See 1 more Smart Citation

MementoEmbed and Raintale for Web Archive Storytelling

Jones,

Klein,

Weigle

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

For traditional library collections, archivists can select a representative sample from a collection and display it in a featured physical or digital library space. Web archive collections may consist of thousands of archived pages, or mementos. How should an archivist display this sample to drive visitors to their collection? Search engines and social media platforms often represent web pages as cards consisting of text snippets, titles, and images. Web storytelling is a popular method for grouping these cards in order to summarize a topic. Unfortunately, social media platforms are not archive-aware and fail to consistently create a good experience for mementos. They also allow no UI alterations for their cards. Thus, we created MementoEmbed to generate cards for individual mementos and Raintale for creating entire stories that archivists can export to a variety of formats.

show abstract

Section: Only Displaying the Presentmentioning

confidence: 99%

Section: Telling Stories From Web Archives With Raintalementioning

confidence: 99%

MementoEmbed and Raintale for Web Archive Storytelling

Jones,

Klein,

Weigle

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…-StoryGraph: a platform that downloads RSS feeds and analyzes the linked articles to cluster news stories [12] http://storygraph.cs.odu.edu/ -Hypercane: a framework for intelligently sampling and analyzing documents from web archive collections [5] https://oduwsdl.github.io/hypercane -ArchiveNow: a library developed by Aturban et al [2] that submits live web URI-Rs to web archives to create URI-Mshttps://github.com/oduwsdl/archivenow -Raintale: a MementoEmbed [3] client that creates stories from a sample of mementoshttps://oduwsdl. { "config": "/files/config/polar−media−consensus−graph/f6e84be9969ecef7adb20689002608d0/", "connected−comps": [ { "avg−degree": 4.318181818181818, "density": 0.10042283298097252, "node−details": { "annotation": "polarity", "color": "green", "connected−comp−type": "event" }, "nodes": [ 0, 1, ... additional node ids omitted for brevity ... ], "unique−source−count": 14 }, { "avg−degree": 1, "density": 1, "node−details": { "annotation": "polarity", "color": "red", "connected−comp−type": "cluster" }, "nodes": [ 9, 67 ], "unique−source−count": 2 } ], "links": [ { "rank": 1, "sim": 0.57, "source": 2, "target": 21, "label": "1 (0.57)", "label−description": "rank (sim)" }, ... additional link definitions omitted for brevity ... { "rank": 96, "sim": 0.3, "source": 53, "target": 73, "label": "96 (0.3)", "label−description": "rank (sim)" } ], "ner−version": "3.8.0", "nodes": [ ... other nodes omitted for brevity ... { "entities": [ { "class": "LOCATION", "entity": "Coney Island" }, { "class": "LOCATION", "entity": "Brooklyn" }, { "class": "PERSON", "entity": "Victor J.…”

Section: Introductionmentioning

confidence: 99%

“…Klein et al [8] have built collections from web archives by conducting focused crawls. Jones developed Hypercane [5] to intelligently sample mementos from larger collections. Jones also developed Raintale [4] for generating social media stories to summarize groups of mementos, providing visualizations that employ familiar techniques, like cards, that require no training for most users to understand.…”

Section: Introductionmentioning

confidence: 99%

SHARI -- An Integration of Tools to Visualize the Story of the Day

Jones,

Nwala,

Klein

et al. 2020

Preprint

Self Cite

View full text Add to dashboard Cite

Tools such as Google News and Flipboard exist to convey daily news, but what about the past? In this paper, we describe how to combine several existing tools with web archive holdings to perform news analysis and visualization of the "biggest story" for a given date. StoryGraph clusters news articles together to identify a common news story. Hypercane leverages ArchiveNow to store URLs produced by StoryGraph in web archives. Hypercane analyzes these URLs to identify the most common terms, entities, and highest quality images for social media storytelling. Raintale then takes the output of these tools to produce a visualization of the news story for a given day. We name this process SHARI (StoryGraph Hypercane ArchiveNow Raintale Integration).

show abstract

Creating Structure in Web Archives with Collections: Different Concepts from Web Archivists

Jones

Klein

et al. 2022

Linking Theory and Practice of Digital Libraries

Self Cite

View full text Add to dashboard Cite

As web archives' holdings grow, archivists subdivide them into collections so they are easier to understand and manage. In this work, we review the collection structures of eight web archive platforms: : Archive-It, Conifer, the Croatian Web Archive (HAW), the Internet Archive's user account web archives, Library of Congress (LC), PANDORA, Trove, and the UK Web Archive (UKWA). We note a plethora of different approaches to web archive collection structures. Some web archive collections support sub-collections and some permit embargoes. Curatorial decisions may be attributed to a single organization or many. Archived web pages are known by many names: mementos, copies, captures, or snapshots. Some platforms restrict a memento to a single collection and others allow mementos to cross collections. Knowledge of collection structures has implications for many different applications and users. Visitors will need to understand how to navigate collections. Future archivists will need to understand what options are available for designing collections. Platform designers need it to know what possibilities exist. The developers of tools that consume collections need to understand collection structures so they can meet the needs of their users. CCS CONCEPTS• Information systems → Web searching and information discovery; Digital libraries and archives.

show abstract

Hypercane: Intelligent Sampling for Web Archive Collections

Cited by 5 publications

References 2 publications

MementoEmbed and Raintale for Web Archive Storytelling

MementoEmbed and Raintale for Web Archive Storytelling

SHARI -- An Integration of Tools to Visualize the Story of the Day

Creating Structure in Web Archives with Collections: Different Concepts from Web Archivists

Contact Info

Product

Resources

About