Distilling Informative Content from HTML News Pages

Ziegler, Cai-Nicolas; Vögele, Christian; Viermetz, Maximilian

doi:10.1109/wi-iat.2009.119

Cited by 2 publications

(1 citation statement)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The involved features include syntactic/semantic features [9], HTML tags [5,10,11], HTML tags/literal words [7,12,13,14], visual features [4,6,15], DOM tree path addressing [16] and so on. The corresponding algorithms include the ILP method, ad-hoc generalization learning and pattern mining etc.…”

Section: Introductionmentioning

confidence: 99%

Extracting Web News Using Tag Path Patterns

2012

2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology

View full text Add to dashboard Cite

How to accurately extract the content of Web news is a popular and significant issue in Web Intelligence. Many Web news sites have similar structures and layout styles, and there are potential correlations between Web content layouts and tag path patterns. Compared with other extraction features, such as HTML tags, literal words and visual features, a tag path pattern not only addresses content segments well, but also has an advantage in the generalization. However, can we accurately extract Web news using only tag path patterns? Motivated by this problem, we propose a PPWIE extraction model. We design an extraction algorithm WEtr using selfdefined tag path patterns, and then define a special tag path pattern called the distinguishing tag path pattern. In addition, to tackle the NPC-hard problem in path pattern mining, we propose a polynomial-time (ln|n|+1)-approximation algorithm MPM, in which n indicates the scale of positive samples. Our experiments show that our integration method WEtr+MPM in PPWIE can achieve better performance with more than 98% of precision, recall and the F-score on real world datasets.

show abstract