This paper describes SSEA (System for Studying the Effectiveness of Animations), an environment designed to support the empirical study of program visualizations.
The VizEval Suite * is an environment designed to support experimentation with and evaluation of program visualization attributes that affect the user's ability to grasp essential concepts. In this paper, we describe the VizEval Suite and an initial experiment conducted both as a test-bed of the VizEval Suite and to study how perceptual/cognitive characteristics of the visualization affect the users' understanding of the program visualization. VizEval is designed to simplify the creation and analysis of such studies. Our experimental results show that some perceptual/cognitive characteristics that help one task (e.g., detection of critical information) may harm another (e.g., localization of critical items), and vice versa. The VizEval software is available for download at
Program visualizations (PVs) are sometimes less effective in teaching computer algorithms than desired. One reason may be that PV designers have largely ignored the users' perceptual capabilities. We examined perceptual characteristics of bar displays, similar to those used in teaching sorting algorithms. Within each experimental condition we varied the number of bars displayed, number of flashing cues, number of bars changing height, and whether bars were labeled. Across experimental conditions we examined placement of bars within the visual field and whether bar profiles were fixed or varied from trial to trial. Thirty-six university students participated. Bars placed in peripheral locations can harm performance because of human retinal eccentricity effects. Moreover, many perceptual characteristics that help localization of critical changes (e.g., labels and cues) do not help detection, whereas some that help detection (e.g., 2 simultaneous changes) hurt localization. Our results suggest that consideration of both users' perceptual capabilities and tasks may improve effectiveness of PVs.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.