News Relation Discovery Based on Association Rule Mining with Combining Factors

Abstract

Nichnan KITTIPHATTANABAWON†a) , Student Member, Thanaruk THEERAMUNKONG †b) , and Ekawit NANTAJEEWARAWAT †c) , Members SUMMARY Recently, to track and relate news documents from several sources, association rule mining has been applied due to its performance and scalability. This paper presents an empirical investigation on how term representation basis, term weighting, and association measure affects the quality of relations discovered among news documents. Twenty four combinations initiated by two term representation bases, four term weightings, and three association measures are explored with their results compared to human judgment of three-level relations: completely related, somehow related, and unrelated relations. The performance evaluation is conducted by comparing the top-k results of each combination to those of the others using so-called rank-order mismatch (ROM). The experimental results indicate that a combination of bigram (BG), term frequency with inverse document frequency (TFIDF) and confidence (CONF), as well as a combination of BG, TFIDF and conviction (CONV), achieves the best performance to find the related documents by placing them in upper ranks with 0.41% ROM on top-50 mined relations. However, a combination of unigram (UG), TFIDF and lift (LIFT) performs the best by locating irrelevant relations in lower ranks (top-1100) with 9.63% ROM. A detailed analysis on the number of the three-level relations with regard to their rankings is also performed in order to examine the characteristic of the resultant relations. Finally, a discussion and an error analysis are given. key words: news relations, news relation discovery, association rule mining, combining factors

Characterization of Interestingness Measures Using Correlation Analysis and Association Rule Mining

“…A representative pattern is generated in either linear-or exponential scale. As the graphic relationship, the relation discovered among news documents [29] is presented on the measurement values with its confidence and the size ratio.…”

Improving Seeded k-Means Clustering with Deviation- and Entropy-Based Term Weightings

“…However, most works on these approaches focused on classification, not clustering. Some researchers suggested a combined term weighting to avoid bias from a single source of information [17]. While most works on term weighting focused on classification, it is still an open question on which statistical approaches are suitable for unsupervised learning, like the clustering task.…”