New Formats and Interfaces for Multi-Document News Summarization and its Evaluation

Abstract

News production, delivery, and consumption are increasing in ubiquity and speed, spreading over more software and hardware platforms, in particular mobile devices. This has led to an increasing interest in automated methods for multi-document summarization. The authors start this chapter with discussing several new alternatives for automated news summarization, with a particular focus on temporal text mining, graph-based methods, and graphical interfaces. Then they present automated and user-centric frameworks for cross-evaluating summarization methods that output different summary formats and describe the challenges associated with each evaluation framework. Based on the results of the user studies, the authors argue that it is crucial for effective summarization to integrate the user into sense-making through usable, entertaining, and ultimately useful interactive summarization-plus-document-search interfaces. In particular, graph-based methods and interfaces may be a better preparation for people to concentrate on what is essential in a collection of texts, and thus may be a key to enhancing the summary evaluation process by replacing the “one gold standard fits all” approach with carefully designed user studies built upon a variety of summary representation formats.

Text Mining for News and Blogs Analysis

“…Texts, or text summaries, can be represented not only as bags of words, sets of topics or events, but also as graphs in which words and/or named entities stand in multiple relations to one another (see Berendt et al, 2014, for examples and further references). (Shallow) semantic parsing is often used to extract triples (e.g.…”

“…One reason for this is that different people read a given text differently, which is well-known in social-science media research but still often neglected in computational research -maybe because it requires us to question key methodological concepts of text mining such as "the ground truth". Interactive tools for story detection and tracking have been proposed as an answer to this dilemma (Berendt et al, 2014), and drag-and-drop story editors are used to create one's own new story (storify.com).…”