Summarization of changes in dynamic text collections using Latent Dirichlet Allocation model

Abstract

a b s t r a c tIn the area of Information Retrieval, the task of automatic text summarization usually assumes a static underlying collection of documents, disregarding the temporal dimension of each document. However, in real world settings, collections and individual documents rarely stay unchanged over time. The World Wide Web is a prime example of a collection where information changes both frequently and significantly over time, with documents being added, modified or just deleted at different times. In this context, previous work addressing the summarization of web documents has simply discarded the dynamic nature of the web, considering only the latest published version of each individual document. This paper proposes and addresses a new challenge -the automatic summarization of changes in dynamic text collections. In standard text summarization, retrieval techniques present a summary to the user by capturing the major points expressed in the most recent version of an entire document in a condensed form. In this new task, the goal is to obtain a summary that describes the most significant changes made to a document during a given period. In other words, the idea is to have a summary of the revisions made to a document over a specific period of time. This paper proposes different approaches to generate summaries using extractive summarization techniques. First, individual terms are scored and then this information is used to rank and select sentences to produce the final summary. A system based on Latent Dirichlet Allocation model (LDA) is used to find the hidden topic structures of changes. The purpose of using the LDA model is to identify separate topics where the changed terms from each topic are likely to carry at least one significant change. The different approaches are then compared with the previous work in this area. A collection of articles from Wikipedia, including their revision history, is used to evaluate the proposed system. For each article, a temporal interval and a reference summary from the article's content are selected manually. The articles and intervals in which a significant event occurred are carefully selected. The summaries produced by each of the approaches are evaluated comparatively to the manual summaries using ROUGE metrics. It is observed that the approach using the LDA model outperforms all the other approaches. Statistical tests reveal that the differences in ROUGE scores for the LDA-based approach is statistically significant at 99% over baseline.

Summarizing Online Movie Reviews: A Machine Learning Approach to Big Data Analytics

“…Previous research shows that text summarization has been successfully applied in numerous domains [12][13][14][15][16]. e text summarization technique is employed to mine the salient information from source document and produce a short version of the document for different users [17][18][19][20].…”

Latent Dirichlet allocation-based temporal summarization

“…In Kar et al (2015), authors proposed an extractive temporal summarization approach that exploits the detection of changes within Wikipedia documents during user-defined time periods. Their system employs LDA to discover the latent structures of changes to produce summaries.…”

An improved ant algorithm with LDA-based representation for text document clustering

“…In addition to this basic utilisation, LDA and other probabilistic topic modelling approaches have been widely applied in a large number of natural language processing applications, e.g. for the temporal topic detection [32], attribute authorship to text documents [33], summarising the opinions about product reviews [34], understanding topic evolution [35], detecting aspects in review documents [36], building a knowledge organisation system [37], dividing text documents into semantically coherent segments [38], fine-grained sentiment analysis [39] and identifying the hidden topic structures of changes in dynamic text collections [40].…”