A well-known definition of visualization is the mapping of initial data to a visual representation, which can be perceived and interpreted by humans. Human senses include not only vision, but also hearing, sense of touch, smell and others including their combinations. Visual analytics and its more general version that we call Multisensory Analytics are areas that consider visualization as one of its components. We present a particular case of the multisensory analytics with a hybrid visual-auditory representation of data to show how auditory display can be used in the context of data analysis. Some generalizations based on using real-valued vector functions for solving data analysis problems by means of multisensory analytics are proposed. These generalizations might be considered as a first step to formalization of the correspondence between the initial data and various sensory stimuli. An illustration of our approach with a case study of analysis of a scalar field using both visual and auditory data representations is given. 322Malikova E.

No abstract

In our day it's hard to imagine modern research in sophisticated scientific area without use of visual analytics tools. However, humans are able to receive and analyze information about world around them not only through their eyes, but with help of other sensory stimuli as well and there is no reason why scientific data analyses should be an exception. As a result there is a lot of research done recently in area of multimodal interfaces that are сcharacterized by various sensory stimuli involvement and especially in visual-auditory interfaces development. In this work we introduce multisensory analytics approach, discuss theoretical issues, introduce main concepts of software tools implementing our approach, describe one of the possible auditory-visual mappings methods for particular case of scalar fields analyses -simultaneous interconnected scalar fields analyses and give practical examples.

This work deals with a visual-auditory visualisation of dynamic heterogeneous objects represented by continuous scalar fields obtained from quantum chemistry. The research concentrates on complex phenomena modelling and rendering aspects and takes advantage of GPU implementation. The approach uses the constructive HyperVolume for the multi-scale representation of the molecular phenomena. To propose an approach to the visual-auditory rendering, we adapt the real-time interactive volume ray-casting to compute the optical and auditory properties. We demonstrate the approach application for the visual-auditory rendering of dynamic molecular structures.

No abstract