Structural and visual comparisons for web page archiving

Law, Marc T.; Thome, Nicolas; Gançarski, Stéphane; Cord, Matthieu

doi:10.1145/2361354.2361380

Cited by 6 publications

(5 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On a structural level of HTML documents (Adar et al, 2009b) presented algorithms for describing DOM tree elements modifications as well as persistence of structural blocks. Several recent studies make use of visual features of web pages to detect and measure changes (Saad and Gançarski, 2010;Law et al, 2012).…”

Section: Methods Of Change Detectionmentioning

confidence: 99%

Web Forums Change Analysis

Kaczmarek

Węckowski

2013

Proceedings of the 9th International Conference on Web Information Systems and Technologies

View full text Add to dashboard Cite

In this paper we present results from an experiment conducted on over 27 900 web pages gathered every 2 hours over 22 days from 16 forums (4256 independent crawls), to investigate how these web pages evolve over time. The results of the experiment became a basis for design choices for a focused incremental crawler, that will be specialized for efficient gathering of documents from web forums, maintaining high freshness of the local collection of obtained pages. The data analysis shows, that forums differ from generic web portals and identifying places in the source navigational structure, where new documents occur more often, would allow to improve the crawler's performance and the collection freshness.

show abstract

Section: Methods Of Change Detectionmentioning

confidence: 99%

Web Forums Change Analysis

Kaczmarek

Węckowski

2013

Proceedings of the 9th International Conference on Web Information Systems and Technologies

View full text Add to dashboard Cite

show abstract

“…Similarly, experiment automation in Plato and, equally important, the feasibility of large-scale preservation operations in general, is entirely dependent on the existence of well-tested, efficient and effective mechanisms for quality assurance. Recent work is showing promising advances (Jurik and Nielsen, 2012;Bauer and Becker, 2011;Law et al, 2012), but there is still a wide gap to be addressed for preservation operations to be broadly supported. It seems crucial that this gap is made explicit and shared with a wide community so that efforts to close it can be based on a solid assessment of the shortcomings of existing tools rather than isolated ad hoc identification of application scenarios within single institutions, as is often practiced today.…”

Section: Coverage and Correctness Of Available Measurement Techniquesmentioning

confidence: 99%

“…Digital preservation content profiles and an automated rendering and comparison tool (Law et al, 2012). A prioritization approach is taken to target first and foremost those aspects that are perceived most critical.…”

mentioning

confidence: 99%

Scalable decision support for digital preservation: an assessment

Becker

Faria

Duretec

2015

OCLC Systems &Amp; Services: International Digital Library Perspectives

View full text Add to dashboard Cite

Structured Abstract:Purpose -Scalable decision support and business intelligence capabilities are required to effectively secure content over time. This article evaluates a new architecture for scalable decision making and control in preservation environments for its ability to address five key goals: (1) Scalable content profiling, (2) Monitoring of compliance, risks and opportunities, (3) Efficient creation of trustworthy plans, (4) Context awareness, and (5) Loosely-coupled preservation ecosystems.Design/methodology/approach -We conduct a systematic evaluation of the contributions of the SCAPE Planning and Watch suite to provide effective and scalable decision support capabilities. We discuss the quantitative and qualitative evaluation of advancing the state of art and report on a case study with a national library.Findings -The system provides substantial capabilities for semi-automated, scalable decision making and control of preservation functions in repositories. Well-defined interfaces allow a flexible integration with diverse institutional environments. The free and open nature of the tool suite further encourages global take-up in the repository communities.Research limitations/implications -The article discusses a number of bottlenecks and factors limiting the realworld scalability of preservation environments. This includes data-intensive processing of large volumes of information, automated quality assurance for preservation actions, and the element of human decision making. We outline open issues and future work.Practical implications -The open nature of the software suite enables stewardship organizations to integrate the components with their own preservation environments and to contribute to the ongoing improvement of the systems.Originality/value -The paper reports on innovative research and development to provide preservation capabilities. The results of the assessment demonstrate how the system advances the control of digital preservation operations from ad-hoc decision making to proactive, continuous preservation management, through a contextaware planning and monitoring cycle integrated with operational systems. Keywords:Repositories, preservation planning, preservation watch, monitoring, scalability, digital libraries. Scalable Decision Support for Digital Preservation: An AssessmentThis article presents a systematic assessment and evaluation of the SCAPE decision support environment comprising PLATO, SCOUT and c3po. We discuss the improvements and identified limitations of the presented system. We furthermore discuss the quantitative and qualitative evaluation of advancing the state of art and report on a case study with a national library. Finally, we summarize the contributions and provide an outlook on future work.

show abstract

“…It already implements source adaptors for the PRONOM registry, content profiles from C3PO, repository events (ingest, access, and migration), policies and other specific adaptors. The combination of content profiles from C3PO with repository events from the Report API provides a complete overview of Continuous automated rendering experiments [26] can be used to track the ability of viewing environments to display content and verify whether it corresponds to the original performance (Law et al, 2012).…”

Section: Scout: Scalable Monitoringmentioning

confidence: 99%

Scalable decision support for digital preservation

Becker

Faria

Duretec

2014

OCLC Systems &Amp; Services: International Digital Library Perspectives

View full text Add to dashboard Cite

Abstract:Purpose -Preservation environments such as repositories need scalable and context-aware preservation planning and monitoring capabilities to ensure continued accessibility of content over time. This article identifies a number of gaps in the systems and mechanisms currently available, and presents a new, innovative architecture for scalable decision making and control in such environments.Design/methodology/approach -The paper illustrates the state of the art in preservation planning and monitoring, highlights the key challenges faced by repositories to provide scalable decision making and monitoring facilities, and presents the contributions of the SCAPE Planning and Watch suite to provide such capabilities.Findings -The presented architecture makes preservation planning and monitoring context-aware through a semantic representation of key organizational factors, and integrates this with a business intelligence system that collects and reasons upon preservation-relevant information.Research limitations/implications -The architecture has been implemented in the SCAPE Planning and Watch suite. Integration with repositories and external information sources provide powerful preservation capabilities that can be freely integrated with virtually any repository.Practical implications -The open nature of the software suite enables stewardship organizations to integrate the components with their own preservation environments and to contribute to the ongoing improvement of the systems.Originality/value -The paper reports on innovative research and development to provide preservation capabilities. The results enable proactive, continuous preservation management through a context-aware planning and monitoring cycle integrated with operational systems.

show abstract

Structural and visual comparisons for web page archiving

Cited by 6 publications

References 13 publications

Web Forums Change Analysis

Web Forums Change Analysis

Scalable decision support for digital preservation: an assessment

Scalable decision support for digital preservation

Contact Info

Product

Resources

About