Representation of Intractable Objects and Action Sequences in VR Using Hand Gesture Recognition

Abstract

Abstract. We propose a novel approach on using static and dynamic gesture recognition in VR games to represent interactive objects in games, such as equipment system, weapons and handy-tools. We examine various applications of gesture recognition in games, learning, medicine and VR, including how developers currently use the bundles of HDM devices paired with hand tracking sensors. The proposed approach provides game developers with a control over recording gestures and binding them to in-game intractable objects and equipment.

Hand Gesture Recognition with Generalized Hough Transform and DC-CNN Using Realsense

“…In recent years, the field and depth of HCI have been expanding in robot vision [1], speech recognition [2], face recognition [3], hand gesture recognition [4], etc. Therein, hand gesture recognition, which utilizes a computer to analyze the meanings of human's hand gestures, so as to achieve friendly and relaxed interaction experience for humans, has played a very important role and become a hot topic in HCI in many related fields, such as virtual reality [5], augmented reality [6], sign language recognition [7] and somatosensory games [8].…”