VECAR: Virtual English Classroom with Markerless Augmented Reality and Intuitive Gesture Interaction

Yang, Mau-Tsuen; Liao, Wan-Che; Shih, Ya-Chun

doi:10.1109/icalt.2013.134

Cited by 9 publications

(5 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Therefore, the ease of use issues such as the hardware requirements and the acceptance of the technology have been addressed well. For the operation of virtual markers, gestures are used as methods of interaction based on previous research [58,59].…”

Section: Discussionmentioning

confidence: 99%

Virtual Marker Technique to Enhance User Interactions in a Marker-Based AR System

Liu

Tanaka

2021

Applied Sciences

View full text Add to dashboard Cite

In marker-based augmented reality (AR) systems, markers are usually relatively independent and predefined by the system creator in advance. Users can only use these predefined markers to complete the construction of certain specified content. Such systems usually lack flexibility and cannot allow users to create content freely. In this paper, we propose a virtual marker technique to build a marker-based AR system framework, where multiple AR markers including virtual and physical markers work together. Information from multiple markers can be merged, and virtual markers are used to provide user-defined information. We conducted a pilot study to understand the multi-marker cooperation framework based on virtual markers. The pilot study shows that the virtual marker technique will not significantly increase the user’s time and operational burdens, while actively improving the user’s cognitive experience.

show abstract

Section: Discussionmentioning

confidence: 99%

Virtual Marker Technique to Enhance User Interactions in a Marker-Based AR System

Liu

Tanaka

2021

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Banyak jenis teknologi terkini yang dapat dimanfaatkan untuk pembelajaran, baik di dalam kelas maupun di luar kelas dimana salah satu yang saat ini sangat menjadi tren adalah AR (Bakar, Zulkifli, & Mohamed, 2011). Banyak sekali penelitian yang telah menyatakan, melalui penggunaan teknologi AR, baik yang dengan bantuan fitur chroma key maupun tidak, mampu meningkatkan kualitas pembelajaran (Tan Esther, Arshad, & Abdullah, 2015;Yang, Liao, & Shih, 2013) dan motivasi serta hasil belajar peserta didik (Georgiou & Kyza, 2018). Guna mendorong pendidik agar memiliki keterampilan penggunaan teknologi untuk pembelajaran, beberapa Kegiatan Pengabdian kepada Masyarakat yang serupa dengan kegiatan yang Tim Pengabdian lakukan ini juga telah terlaksana (Hidayat, Sutikno, Patmanthara, Kartikasari, & Firdaus, 2019;Sari dkk., 2020).…”

Section: Hasil and Pembahasanunclassified

Penerapan Merged Animation Learning (Mal) Dengan Konsep Chroma Key Untuk Membantu Pendidik Kota Wisata Batu

Nidhom

Ningrum

Smaragdina

et al. 2020

JGP

View full text Add to dashboard Cite

Abstrak: Kegiatan Penerapan teknologi Merged Animation Learning ini bertujuan untuk mengenalkan Merged Animation Learning (MAL) dengan menggunakan konsep chroma key. MAL merupakan teknologi yang menggabungkan antara video real time dengan animasi, hal ini sangat cocok digunakan untuk pembelajaran jarak jauh selama masa pademi covid-19. Kegiatan pengabdian ini dilakukan untuk membantu pendidik memberikan fasilitas pembelajaran yang menarik. Hasil dari kegiatan pengabdian masyarakat ini menunjukkan pendidik berhasil menggunakan MAL dengan bantuan Chroma Key (Green Screen) dengan desain yang menarik dan memiliki animasi. Berdasarkan jumlah sampling pendidik di Kota Wisata Batu menunjukkan hasil yang cukup memuaskan, terdapat angka kenaikan yang cukup signifikan dalam pembelajaran, kemenarikan media dinyatakan sangat menarik dan kemudahan media dianggap cukup mudah. Secara Keseluruhan konsep MAL dengan bantuan chroma key tersebut mencapai kategori yang baik.Abstract: The activity of applying Merged Animation Learning technology aims to introduce Merged Animation Learning (MAL) using the chroma key concept. MAL is a technology that combines real time video with animation, which is very suitable for distance learning during the Covid-19 period. This service activity is carried out to help educators provide attractive learning facilities. The results of this community service activity show that educators have successfully used MAL with the help of a Chroma Key (Green Screen) with an attractive design and animation. Based on the number of sampling of educators in Kota Wisata Batu, the results are quite satisfactory, there is a significant increase in learning. attractiveness of the media is stated to be very attractive and media convenience is considered quite easy. Overall, the concept of MAL with the help of chroma keys reaches a good category.

show abstract

“…Hand gestures are an effective way of interacting with computers but various issues are associated with their recognition and application due to limitations in sensing technologies, complex nature of gestures, and unrealistic interaction techniques. Different computer vision and image processing systems have been proposed for gesture recognition [21][22][23][24], with some recently available sensors such as Microsoft Kinect [24] and Leap Motion [25][26][27]. For touchless interaction in Augmented Reality (AR) fiducial markers placed on fingers were used [28,29], while some systems used computer vision techniques for the detection of hands and fingers in AR interaction [30,31].…”

Section: Introductionmentioning

confidence: 99%

Fingertip Gestures Recognition Using Leap Motion and Camera for Interaction with Virtual Environment

et al. 2020

View full text Add to dashboard Cite

The emergence in computing and the latest hardware technologies realized the use of natural interaction with computers. Gesture-based interaction is one of the prominent fields of natural interactions. The recognition and application of hand gestures in virtual environments (VEs) need extensive calculations due to the complexities involved, which directly affect the performance and realism of interaction. In this paper, we propose a new interaction technique that uses single fingertip-based gestures for interaction with VEs. The objective of the study is to minimize the computational cost, increase performance, and improve usability. The interaction involves navigation, selection, translation, and release of objects. For this purpose, we propose a low-cost camera-based system that uses a colored fingertip for the fastest and accurate recognition of gestures. We also implemented the proposed interaction technique using the Leap Motion controller. We present a comparative analysis of the proposed system with the Leap Motion controller for gesture recognition and operation. A VE was developed for experimental purposes. Moreover, we conducted a comprehensive analysis of two different recognition setups including video camera and the Leap Motion sensor. The key parameters for analysis were task accuracy, interaction volume, update rate, and spatial distortion of accuracy. We used the Standard Usability Scale (SUS) for system usability analysis. The experiments revealed that camera implementation was found with good performance, less spatial distortion of accuracy, and large interaction volume as compared to the Leap Motion sensor. We also found the proposed interaction technique highly usable in terms of user satisfaction, user-friendliness, learning, and consistency.

show abstract

VECAR: Virtual English Classroom with Markerless Augmented Reality and Intuitive Gesture Interaction

Cited by 9 publications

References 4 publications

Virtual Marker Technique to Enhance User Interactions in a Marker-Based AR System

Virtual Marker Technique to Enhance User Interactions in a Marker-Based AR System

Penerapan Merged Animation Learning (Mal) Dengan Konsep Chroma Key Untuk Membantu Pendidik Kota Wisata Batu

Fingertip Gestures Recognition Using Leap Motion and Camera for Interaction with Virtual Environment

Contact Info

Product

Resources

About