Enhancing Mobile VR Immersion: A Multimodal System of Neural Networks Approach to an IMU Gesture Controller

Nino, Juan C.; Kiss, Jocelyne; Edwards, Geoffrey; Morales, Ernesto; Ochoa, Sherezada; Bernier, Bruno

doi:10.2352/issn.2470-1173.2019.2.ervr-184

Cited by 2 publications

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An interesting experience is developed by Nino et al [33] on a VR mobile system based on Neural Network to an IMU gesture controller to simulate the feeling of embodiment [34] and presence. The application aims to demonstrate that combining a sound and motion controller with haptic feedback can improve immersion on mobile interfaces.…”

Section: − Collecting Training and Testing Data;mentioning

confidence: 99%

Neural Network Design using a Virtual Reality Platform

Bibbò¹,

Morabito²

2022

GJCST

View full text Add to dashboard Cite

The evolution of Deep Learning (DL), a subset of machine learning, has made their use very effective in many artificial intelligence(AI) fields. In parallel Virtual Reality is going wide in many applications thanks to the proliferation of cameras in mobile devices and improved processing efficiency. Data visualization in deep learning is a fundamental element for which it can benefit from the advantages offered by the visualization of the VR for the development of the models. In addition, the researchers can widely use the editing of images and videos in the machine learning process to design a convolutional network suitable for image recognition. In this study, we want to demonstrate the usefulness of this approach in collecting data within virtual reality to train and optimize a convolutional neural network used to recognize human activities (HAR).

show abstract

Section: − Collecting Training and Testing Data;mentioning

confidence: 99%

Neural Network Design using a Virtual Reality Platform

Bibbò¹,

Morabito²

2022

GJCST

View full text Add to dashboard Cite

show abstract

The effects of touchless interaction on usability and sense of presence in a virtual environment

Paolis

Luca

2022

Virtual Reality

View full text Add to dashboard Cite

For software applications with a significant level of user involvement, the traditional concept of usability has evolved into the more complex idea of user experience, which also covers emotional, cognitive or physical responses. In virtual reality, user experience also depends on the user perception related to some peculiarities of immersive environments, where also the devices employed for user interaction play a determinant role. This has led to the design of the Presence Questionnaire (PQ) for the evaluation of the effectiveness of virtual environments. This work analyzes the effects of two different interaction modalities on usability and sense of presence: in particular, the Myo armband, a gesture-based device for touchless interaction, is compared with the Vive handheld controller bundled with the HTC Vive headset. A total of 84 subjects were recruited to test the virtual environment and asked them to fill in a questionnaire obtained by combining the Usability Metric for User eXperience (UMUX) questionnaire, the System Usability Scale (SUS) and the presence questionnaire (PQ), which was specifically designed for virtual environments. A comparison between the scores obtained for the two interaction modalities revealed which questionnaire items are significantly influenced by the input interface and deduce some insights about the consequences on human factors.

show abstract

Enhancing Mobile VR Immersion: A Multimodal System of Neural Networks Approach to an IMU Gesture Controller

Cited by 2 publications

References 0 publications

Neural Network Design using a Virtual Reality Platform

Neural Network Design using a Virtual Reality Platform

The effects of touchless interaction on usability and sense of presence in a virtual environment

Contact Info

Product

Resources

About