Scientific Sketching for Collaborative VR Visualization Design

Abstract

Abstract-We present four studies investigating tools and methodologies for artist-scientist-technologist collaboration in designing multivariate virtual reality (VR) visualizations. Design study 1 identifies the promise of 3D interfaces for rapid VR design and also establishes limitations of the particular tools tested with respect to precision and support for animation. Design study 2 explores animating artist-created visualization designs with scientific 3D fluid flow data. While results captured an accurate sense of flow that was advantageous as compared to the results of study 1, the potential for visual exploration using the design tools tested was limited. Design study 3 reveals the importance of a new 3D interface that overcomes the precision limitation found in study 1 while remaining accessible to artist collaborators. Drawing upon previous results, design study 4 engages collaborative teams in a design process that begins with traditional paper sketching and moves to animated interactive VR prototypes "sketched" by designers in VR using interactive 3D tools. Conclusions from these four studies identify important characteristics of effective artist-accessible VR visualization design tools and lead to a proposed formalized methodology for successful collaborative design that we expect to be useful in guiding future collaborations. We call this proposed methodology Scientific Sketching.

Sketching Designs Using the Five Design-Sheet Methodology

“…Users often sketch and plan, but usually don't follow a method, rather they do it in an ad hoc way. Recent work by Keefe [26] and Jackson et al [23] demonstrate the power of sketching; they explore one designer generating several solutions, and make comparison to other lo-fidelity prototyping methods. Sketching is also used by Walny et al [52], where users directly sketch the data.…”

“…While it is unclear whether working together, in this way, does actually create new ideas [54] -with people being cautious of engaging, embarrassed, or worried their ideas would be copied, or bullied by a strong person -certainly working with clients over a problem does help [26].…”

Reimagining the Scientific Visualization Interaction Paradigm

“…New display environments, such as the CAVE and Responsive Workbench, have enabled not only new methods for stereoscopic presentation of data but also new interaction paradigms. More recently, interfaces for Scientific Sketching have shown us how scientists and artists can prototype data visualizations in virtual reality using natural sketchbased input [5], and gesture and touch have been used to interact with volumetric scientific data [6].…”

“…The left and middle images depict a sketch-based interface for stylistic illustration of 2D vector fields [9]. The rightmost image shows a virtual reality 3D sketching tool used for both art practice and prototyping scientific visualizations [5].…”

“…The system thus combines artistic design decisions made by a trained graphic designer together with underlying data to produce accurate stylized hand-drawn renderings of flow patterns. The rightmost image portrays a 3D tool for creating virtual sculpture by "painting in the air," used both for art practice and as a valuable sketchpad for prototyping 3D scientific visualizations [5]. Due specifically to the natural user interfaces employed, both of these systems have enabled artists and designers trained in visual depiction to work creatively on scientific visualization problems using the latest computer graphics technologies and without any knowledge of programming.…”