Detection and Localization of HTML Presentation Failures Using Computer Vision-Based Techniques

Abstract

An attractive and visually appealing appearance is important for the success of a website. Presentation failures in a site's web pages can negatively impact end users' perception of the quality of the site and the services it delivers. Debugging such failures is challenging because testers must visually inspect large web pages and analyze complex interactions among the HTML elements of a page. In this paper we propose a novel automated approach for debugging web page user interfaces. Our approach uses computer vision techniques to detect failures and can then identify HTML elements that are likely to be responsible for the failure. We evaluated our approach on a set of real-world web applications and found that the approach was able to accurately and quickly identify faulty HTML elements.

Pesto: Automated migration of DOM‐based Web tests towards the visual approach

“…The problem of automatically supporting maintenance of test suites for Web applications has been studied from different points of view [33,34,35], including refactoring techniques applied in the industry [36,37], Web re-engineering and testing [38,39,40,41,42], refactoring of test code [43,44,45,46], and GUI testing and refactoring [8,47,48,49,50,51,52,53,54,55,56]. Nevertheless, none of these works specifically addresses the problem of the automated migration of DOM-based Web test suites to the visual approach.…”

WebSee: A Tool for Debugging HTML Presentation Failures

“…To address these limitations we proposed a novel automated technique in prior work [12]. This technique is implemented as a tool, WebSee, for detecting presentation failures and then identifying the corresponding faulty HTML elements.…”

“…Lastly, in Section VIII we describe the location of availability of the tool for public use. Note that we will only summarize the underlying technique and evaluation results in this paper, as a detailed description is available in the paper accepted for publication at ICST 2015 [12].…”

XFix: an automated tool for the repair of layout cross browser issues

“…Work in the eld of web app presentation testing, such as WebSee [5][6][7] and FieryEye [8,9] focuses on detecting and localizing presentation failures -a discrepancy in the actual and intended appearance of a web page . Another technique, GWALI [1], can detect layout failures in web pages a er they are translated from one language to another.…”