Vi-DIFF: Understanding Web Pages Changes

Pehlivan, Zeynep; Ben-Saad, Myriam; Gançarski, Stéphane

doi:10.1007/978-3-642-15364-8_1

Cited by 9 publications

(10 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We also extract some features from the difference tree returned by the VI-DIFF algorithm [4] that detects some operations between the VIPS structures of versions, e.g. insertions, deletions or updates of VIPS blocks, or even a boolean value returning whether two versions have the same VIPS structure.…”

Section: Structural Descriptorsmentioning

confidence: 99%

See 1 more Smart Citation

Structural and visual comparisons for web page archiving

Law¹,

Thome²,

Gançarski³

et al. 2012

Proceedings of the 2012 ACM Symposium on Document Engineering

Self Cite

View full text Add to dashboard Cite

In this paper, we propose a Web page archiving system that combines state-of-the-art comparison methods based on the source codes of Web pages, with computer vision techniques. To detect whether successive versions of a Web page are similar or not, our system is based on: (1) a combination of structural and visual comparison methods embedded in a statistical discriminative model, (2) a visual similarity measure designed for Web pages that improves change detection, (3) a supervised feature selection method adapted to Web archiving. We train a Support Vector Machine model with vectors of similarity scores between successive versions of pages. The trained model then determines whether two versions, defined by their vector of similarity scores, are similar or not. Experiments on real archives validate our approach.

show abstract

Section: Structural Descriptorsmentioning

confidence: 99%

“…Most archivists only take into account the Web page source code (code string, DOM tree...) [2] and not the visual rendering [3,4,1]. However, the code may not be sufficient to describe the content of Web pages, e.g.…”

Section: Introductionmentioning

confidence: 99%

Structural and visual comparisons for web page archiving

Law¹,

Thome²,

Gançarski³

et al. 2012

Proceedings of the 2012 ACM Symposium on Document Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Changes between two page versions are detected by the Vi-DIFF algorithm [14]. First, Vi-DIFF extends a visual segmentation algorithm to partition the web page into multiple blocks.…”

Section: • Importance Of a Versionmentioning

confidence: 99%

“…The larger the number of significant changes occurred inside important blocks is, the higher the estimated importance of changes. For more details about the algorithm Vi-DIFF used to detect changes between two versions of pages, please refer to [14]. The estimator of the importance of changes is detailed in [2].…”

Section: • Importance Of a Versionmentioning

confidence: 99%

Improving the Quality of Web Archives through the Importance of Changes

Saâd¹,

Gançarski²

2011

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract. Due to the growing importance of the Web, several archiving institutes (national libraries, Internet Archive, etc.) are harvesting sites to preserve (a part of) the Web for future generations. A major issue encountered by archivists is to preserve the quality of web archives. One way of assessing the quality of an archive is to quantify its completeness and the coherence of its page versions. Due to the large number of pages to be captured and the limitations of resources (storage space, bandwidth, etc.), it is impossible to have a complete archive (containing all the versions of all the pages). Also it is impossible to assure the coherence of all captured versions because pages are changing very frequently during the crawl of a site. Nonetheless, it is possible to maximize the quality of archives by adjusting web crawlers strategy. Our idea for that is (i) to improve the completeness of the archive by downloading the most important versions and (ii) to keep the most important versions as coherent as possible. Moreover, we introduce a pattern model which describes the behavior of the importance of pages changes over time. Based on patterns, we propose a crawl strategy to improve both the completeness and the coherence of web archives. Experiments based on real patterns show the usefulness and the effectiveness of our approach.

show abstract

“…The first step of the analyzer consists on segmenting each captured pages into blocks that describe the hierarchical structure of the page. Then, successive versions of a same page are compared to detect structural 1 and content 2 changes by using Vi-DIFF algorithm [12]. Afterwards, the importance of changes between two successive versions is evaluated based on the estimator proposed in [1].…”

Section: Pattern-based Archivingmentioning

confidence: 99%

Coherence-Oriented Crawling and Navigation Using Patterns for Web Archives

Saâd

Pehlivan

Gançarski

2011

Research and Advanced Technology for Digital Libraries

Self Cite

View full text Add to dashboard Cite

Abstract. We point out, in this paper, the issue of improving the coherence of web archives under limited resources (e.g. bandwidth, storage space, etc.). Coherence measures how much a collection of archived pages versions reflects the real state (or the snapshot) of a set of related web pages at different points in time. An ideal approach to preserve the coherence of archives is to prevent pages content from changing during the crawl of a complete collection. However, this is practically infeasible because web sites are autonomous and dynamic. We propose two solutions: a priori and a posteriori. As a priori solution, our idea is to crawl sites during the off-peak hours (i.e. the periods of time where very little changes is expected on the pages) based on patterns. A pattern models the behavior of the importance of pages changes during a period of time. As an a posteriori solution, based on the same patterns, we introduce a novel navigation approach that enables users to browse the most coherent page versions at a given query time.

show abstract

Vi-DIFF: Understanding Web Pages Changes

Cited by 9 publications

References 13 publications

Structural and visual comparisons for web page archiving

Structural and visual comparisons for web page archiving

Improving the Quality of Web Archives through the Importance of Changes

Coherence-Oriented Crawling and Navigation Using Patterns for Web Archives

Contact Info

Product

Resources

About