Computer-Assisted Culture Learning in an Online Augmented Reality Environment Based on Free-Hand Gesture Interaction

Abstract

The physical-virtual immersion and real-time interaction play an essential role in cultural and language learning. Augmented reality (AR) technology can be used to seamlessly merge virtual objects with real-world images to realize immersions. Additionally, computer vision (CV) technology can recognize free-hand gestures from live images to enable intuitive interactions. Therefore, we incorporate the latest AR and CV algorithms into a Virtual English Classroom, called VECAR, to promote immersive and interactive language learning. By wearing a pair of mobile computing glasses, users can interact with virtual contents in a three-dimensional space by using intuitive free-hand gestures. We design three cultural learning activities that introduce students to authentic cultural products and new cultural practices, and allow them to examine various cultural perspectives. The objectives of the VECAR are to make cultural and language learning appealing, improve cultural learning effectiveness, and enhance interpersonal communication between teachers and students.

Evaluating the impact of the augmented reality learning environment on electronics laboratory skills of engineering students

“…AR has an enormous potential to represent the difficult concepts and theories in a more expressive manner. In the past, various learning environments, games, and simulations were developed by researchers using AR technology which presented the computer-generated graphics in an effective way to the student [10,20,27,37,40]. By employing AR technology in skill environments, it is possible to let the students comprehend the advanced concepts and complicated procedures with greater motivation and interest coupled with ease.…”

Mobile Interaction for Augmentative and Alternative Communication: a Systematic Mapping

“…This technology can be used to motivate and stimulate the use of AAC, or to aid in the learning of important concepts related to this theme merging virtual objects with real-world images. In addition, computer vision technology can recognize hands-free gestures from live images to allow intuitive interactions, such presented in Yang et al [64].…”

“…Salazar et al [70] presents a serious game designed to teaching concepts about cybersecurity using augmented reality. Yang et al [64] talk about gesture interaction for learning. Villamarin et al [58] talk about learning of gesture language by deaf people.…”

EAR: Enhanced Augmented Reality System for Sports Entertainment Applications

“…The AR and Computer Vision In the AR applications, virtual entities can change the way the real world is perceived by the users' by adding, removing, or changing few aspects of the real world [7]. For example, a simulated image or video of a city may contain useful information about buildings, parking-lots, and restaurants [2]. Such applications require object detection and recognition as a preprocessing step.…”

“…The AR applications add a layer of information over the data and depict innovative digital constructs in real space. With the help of the AR technology, information about the surrounding real world of the viewer becomes interactive and digitally manipulable [2], [3]. Typically, the AR creates a meaningful image by superseding chunks of the real world images with synthetic images by augmenting useful information [4].…”