A Study on Immersion of Hand Interaction for Mobile Platform Virtual Reality Contents

Abstract

This study proposes gaze-based hand interaction, which is helpful for improving the user's immersion in the production process of virtual reality content for the mobile platform, and analyzes efficiency through an experiment using a questionnaire. First, three-dimensional interactive content is produced for use in the proposed interaction experiment while presenting an experiential environment that gives users a high sense of immersion in the mobile virtual reality environment. This is designed to induce the tension and concentration of users in line with the immersive virtual reality environment. Additionally, a hand interaction method based on gaze-which is mainly used for the entry of mobile virtual reality content-is proposed as a design method for immersive mobile virtual reality environment. The user satisfaction level of the immersive environment provided by the proposed gaze-based hand interaction is analyzed through experiments in comparison with the general method that uses gaze only. Furthermore, detailed analysis is conducted by dividing the effects of the proposed interaction method on user's psychology into positive factors such as immersion and interest and negative factors such as virtual reality (VR) sickness and dizziness. In this process, a new direction is proposed for improving the immersion of users in the production of mobile platform virtual reality content.

A Study on the Presence of Immersive User Interface in Collaborative Virtual Environments Application

“…To enable users to realistically experience a variety of possible actions and behaviors inside virtual environments, the movement of their joints must be rapidly detected and accurately recognized, and reflected in the virtual environment. To this end, studies are being conducted on computing joint movements from videos captured with optical markers attached to the surfaces of a subject's joints [16]; as well as on detecting and recognizing the movements of the whole body, beyond merely the hands, with various equipment, including the Kinect and Leap Motion [2,17]. In recent years, studies have been conducted on detection models for computing movements made with elaborate hand joint models [18], and on realistically representing user behavior in a virtual space from video data obtained with motion capture equipment [6].…”

“…First, it is crucial to provide users with the feeling that they are actually using their own hands inside a virtual environment, based on the hand interface model proposed by Han et al [2]. For a more detailed development of the model, a three-dimensional hand model that includes joint data, which is used to represent finger movement in detail, is imported to the Unity 3D engine.…”

“…), which provide realistic spatial and temporal experiences, by stimulating the user's various senses inside a VR, as well as research on hardware technology (motion platforms, haptic systems, etc.) [1][2][3][4].…”

Maze Terrain Authoring System in Immersive Virtual Reality for New Visual Realism

“…To provide an improved presence to users through high immersion, it is necessary to provide interactions that are so realistic that the boundary between VR and reality is vague [4,5]. To this end, some studies have been carried out to accurately detect the movements of human body joints moving in a real space and to analyze the intention of the movements or the process of action to reflect it in the virtual environment.…”

A Study on Interaction of Gaze Pointer-Based User Interface in Mobile Virtual Reality Environment

“…Since then, studies have been conducted to analyze whether the user's posture while viewing VR contents or the visual elements transmitted via the HMD are interfering with the immersion experience [26][27][28][29][30]. When approaching with the same concept, the user interface can be an important factor in increasing immersion and convenience; nevertheless, it may even be a factor that causes motion sickness and the like.…”