A Grammar‐Based Approach for Applying Visualization Taxonomies to Interaction Logs

Abstract

Researchers collect large amounts of user interaction data with the goal of mapping user's workflows and behaviors to their high-level motivations, intuitions, and goals. Although the visual analytics community has proposed numerous taxonomies to facilitate this mapping process, no formal methods exist for systematically applying these existing theories to user interaction logs. This paper seeks to bridge the gap between visualization task taxonomies and interaction log data by making the taxonomies more actionable for interaction log analysis. To achieve this, we leverage structural parallels between how people express themselves through interactions and language by reformulating existing theories as regular grammars. We represent interactions as terminals within a regular grammar, similar to the role of individual words in a language, and patterns of interactions or non-terminals as regular expressions over these terminals to capture common language patterns. To demonstrate our approach, we generate regular grammars for seven existing visualization taxonomies and develop code to apply them to three public interaction log datasets. In analyzing these regular grammars, we find that the taxonomies at the low-level (i.e., terminals) show mixed results in expressing multiple interaction log datasets, and taxonomies at the high-level (i.e., regular expressions) have limited expressiveness, due to primarily two challenges: inconsistencies in interaction log dataset granularity and structure, and under-expressiveness of certain terminals. Based on our findings, we suggest new research directions for the visualization community to augment existing taxonomies, develop new ones, and build better interaction log recording processes to facilitate the data-driven development of user behavior taxonomies.

Deconstructing Human‐AI Collaboration: Agency, Interaction, and Adaptation

“…Similarly, previous work in VA has looked at not only categorizing low‐level interactions but also identifying usersâĂŹ motivations [BM13]. Another approach has looked at deconstructing interaction logs and establishing concrete start and end points of interactions [GMOB22].…”

Riverside: A design study on visualization for situation awareness in cybersecurity

“…Additionally, we coded technical visualization features and mapped them to low-level actions that could be used to infer higher level analysis tasks. 11 Using the interview data, we developed Riverside, the data-driven network security visualization that allows analysts to make informed decisions about the state of their network.…”