Vision based 3D Gesture Tracking using Augmented Reality and Virtual Reality for Improved Learning Applications

Abstract

3D gesture recognition and tracking based augmented reality and virtual reality have become a big interest of research because of advanced technology in smartphones. By interacting with 3D objects in augmented reality and virtual reality, users get better understanding of the subject matter where there have been requirements of customized hardware support and overall experimental performance needs to be satisfactory. This research investigates currently various vision based 3D gestural architectures for augmented reality and virtual reality. The core goal of this research is to present analysis on methods, frameworks followed by experimental performance on recognition and tracking of hand gestures and interaction with virtual objects in smartphones. This research categorized experimental evaluation for existing methods in three categories, i.e. hardware requirement, documentation before actual experiment and datasets. These categories are expected to ensure robust validation for practical usage of 3D gesture tracking based on augmented reality and virtual reality. Hardware set up includes types of gloves, fingerprint and types of sensors. Documentation includes classroom setup manuals, questionaries, recordings for improvement and stress test application. Last part of experimental section includes usage of various datasets by existing research. The overall comprehensive illustration of various methods, frameworks and experimental aspects can significantly contribute to 3D gesture recognition and tracking based augmented reality and virtual reality.

Revolutionary AI-Driven Skeletal Fingerprinting for Remote Individual Identification

“…Convolutional Neural Networks (CNNs) are a special type of neural networks specializing in processing grid-type topological data, such as images. The architecture of a CNN model generally contains three distinct types of layers: Convolution Layer, Pooling Layer and Fully connected Layer [1].…”

Spatio-Temporal Features based Human Action Recognition using Convolutional Long Short-Term Deep Neural Network

“…BSVM needs only a few abnormal detection training patterns and provides reasonable detection accuracy for new patterns with the same features. Several researchers use Deep convolutional neural networks (CNN) to detect violent scenes by transfer learning to classify aggressive human behaviors [28][31] [50]. Research in [30] recognized basic human activities using the Deep Belief Network (DBN) method which is a good candidate to the model activity recognition system.…”

Transformative Learning Through Augmented Reality Empowered by Machine Learning for Primary School Pupils: A Real-Time Data Analysis

“…AR can be used by primary school teachers to support individualised learning programmes, interactive scientific experiments, virtual field trips, and educational games. Access to AR devices, topnotch applications, and careful planning to match AR activities with the curriculum are necessary for a successful integration, though [26], [27]. AR is a potent tool that can improve learning outcomes and student engagement in elementary schools when used strategically.…”