Visualizing Convolutional Neural Networks with Virtual Reality

Abstract

Software systems and components are increasingly based on machine learning methods, such as Convolutional Neural Networks (CNNs). Thus, there is a growing need for common programmers and machine learning newcomers to understand the general functioning of these algorithms. However, as neural networks are complex in nature, novel presentation means are required to enable rapid access to the functionality. For that purpose, this paper examines how CNNs can be visualized in Virtual Reality. A first exploratory study has confirmed that our visualization approach is both intuitive to use and conductive to learning. CCS CONCEPTS • Computer methodologies → Virtual Reality; Neural networks.

Visualization of AI Systems in Virtual Reality: A Comprehensive Review

“…During the study selection process, we identified several studies that appeared to meet the inclusion criteria but were eventually excluded: 1) In [14], the authors excluded due to similarity to [11]. 2) In [15], the authors Excluded due to significant overlap in content and authorship with [11]. 3) In [16], the authors excluded due to its focus on visual data mining and representation of data and symbolic knowledge within VR spaces for classification tasks, rather than AI system visualization in VR.…”