Detecting and summarizing GUI changes in evolving mobile apps

Moran, Kevin; Watson, Corey T.; Hoskins, John; Purnell, George; Poshyvanyk, Denys

doi:10.1145/3238147.3238203

Cited by 30 publications

(23 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some tools touch text inconsistencies and defects [35], [36], [43], similar to some text style don'tguidelines our tool supports. Moran et al [10], [44] develops techniques for detecting presentation inconsistencies between UI mockups and implemented Uls, and the UI changes during evolution. Their methods contrast two similar UIs and find their differences.…”

Section: ) User Study Designmentioning

confidence: 99%

Don’t Do That! Hunting Down Visual Design Smells in Complex UIs Against Design Guidelines

Yang

Xing

Xia

et al. 2021

2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE)

View full text Add to dashboard Cite

Just like code smells in source code, UI design has visual design smells. We study 93 don t-do-that guidelines in the Material Design, a complex design system created by Google. We find that these don t-guidelines go far beyond U I aesthetics, and involve seven general design dimensions (layout, typography, iconography, navigation, communication, color, and shape) and four component design aspects (anatomy, placement, behavior, and usage). Violating these guidelines results in visual design smells in UIs (or U I design smells). In a study of 60,756 UIs of 9,286 Android apps, we find that 7,497 UIs of 2,587 apps have at least one violation of some Material Design guidelines. This reveals the lack of developer training and tool support to avoid U I design smells. To fill this gap, we design an automated UI design smell detector (UIS-Hunter) that extracts and validates multi-modal U I information (component metadata, typography, iconography, color, and edge) for detecting the violation of diverse don t-guidelines in Material Design. The detection accuracy of UIS-Hunter is high (precision=0.81, recall=0.90) on the 60,756 UIs of 9,286 apps. We build a guideline gallery with real-world U I design smells that UIS-Hunter detects for developers to learn the best Material Design practices. Our user studies show that UIS-Hunter is more effective than manual detection of UI design smells, and the U I design smells that are detected by UIS-Hunter have severely negative impacts on app users.

show abstract

Section: ) User Study Designmentioning

confidence: 99%

Don’t Do That! Hunting Down Visual Design Smells in Complex UIs Against Design Guidelines

Yang

Xing

Xia

et al. 2021

2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE)

View full text Add to dashboard Cite

show abstract

“…We will rst rapidly mention recent work on GUI generation using Articial Intelligence (from screenshot examples). This is the case of Beltramelli (2017); Chen et al (2018); Moran et al (2018). These approaches rely on a huge dataset of screenshot examples (14,382 screenshots for (Moran et al, 2018) and 10,804 for (Chen et al, 2018)), to train the model.…”

Section: State Of the Artmentioning

confidence: 99%

GUI visual aspect migration: a framework agnostic solution

et al. 2021

View full text Add to dashboard Cite

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

show abstract

“…Yet other techniques, such as ReDeCheck [38‐42], WebSee [11‐13,43‐45], VFDetector [46], CANVASURE [47], Ply [48], Fighting Layout Bugs [49], Sikuli [50], and techniques based on computer vision [51] and CSS/Javascript analysis [52], detect certain types of presentation failures in web pages. There also exists a group of parallel techniques [53‐55] focusing on the detection and reporting of GUI violations in mobile apps. However, none of them are designed to repair IPFs.…”

Section: Related Workmentioning

confidence: 99%

Effective automated repair of internationalization presentation failures in web applications using style similarity clustering and search‐based techniques

Mahajan

Alameer

McMinn

et al. 2020

Software Testing Verif & Rel

View full text Add to dashboard Cite

Summary Companies often employ (i18n) frameworks to provide translated text and localized media content on their websites in order to effectively communicate with a global audience. However, the varying lengths of text from different languages can cause undesired distortions in the layout of a web page. Such distortions, called Internationalization Presentation Failures (IPFs), can negatively affect the aesthetics or usability of the website. Most of the existing automated techniques developed for assisting repair of IPFs either produce fixes that are likely to significantly reduce the legibility and attractiveness of the pages or are limited to only detecting IPFs, with the actual repair itself remaining a labour intensive manual task. To address this problem, we propose a search‐based technique for automatically repairing IPFs in web applications, while ensuring a legible and attractive page. The empirical evaluation of our approach reported that our approach was able to successfully resolve 94% of the detected IPFs for 46 real‐world web pages. In a user study, participants rated the visual quality of our fixes significantly higher than the unfixed versions and also considered the repairs generated by our approach to be notably more legible and visually appealing than the repairs generated by existing techniques.

show abstract

Detecting and summarizing GUI changes in evolving mobile apps

Cited by 30 publications

References 36 publications

Don’t Do That! Hunting Down Visual Design Smells in Complex UIs Against Design Guidelines

Don’t Do That! Hunting Down Visual Design Smells in Complex UIs Against Design Guidelines

GUI visual aspect migration: a framework agnostic solution

Effective automated repair of internationalization presentation failures in web applications using style similarity clustering and search‐based techniques

Contact Info

Product

Resources

About