A pen user interface for controlling a virtual puppet

Vanderdonckt, Jean; Vatavu, Radu-Daniel

doi:10.1145/3393672.3398637

Cited by 4 publications

(6 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Vanderdonckt and Vatavu [41] This study present a VR application where the user, a psychologist, controls a virtual puppet (a cartoon-like character in VR).…”

Section: Conflicts Of Interestmentioning

confidence: 99%

Application of Virtual Reality in Computer Science Education: A Systemic Review Based on Bibliometric and Content Analysis Methods

et al. 2021

View full text Add to dashboard Cite

This study investigated the role of virtual reality (VR) in computer science (CS) education over the last 10 years by conducting a bibliometric and content analysis of articles related to the use of VR in CS education. A total of 971 articles published in peer-reviewed journals and conferences were collected from Web of Science and Scopus databases to conduct the bibliometric analysis. Furthermore, content analysis was conducted on 39 articles that met the inclusion criteria. This study demonstrates that VR research for CS education was faring well around 2011 but witnessed low production output between the years 2013 and 2016. However, scholars have increased their contribution in this field recently, starting from the year 2017. This study also revealed prolific scholars contributing to the field. It provides insightful information regarding research hotspots in VR that have emerged recently, which can be further explored to enhance CS education. In addition, the quantitative method remains the most preferred research method, while the questionnaire was the most used data collection technique. Moreover, descriptive analysis was primarily used in studies on VR in CS education. The study concludes that even though scholars are leveraging VR to advance CS education, more effort needs to be made by stakeholders across countries and institutions. In addition, a more rigorous methodological approach needs to be employed in future studies to provide more evidence-based research output. Our future study would investigate the pedagogy, content, and context of studies on VR in CS education.

show abstract

“…Vanderdonckt and Vatavu [41] This study present a VR application where the user, a psychologist, controls a virtual puppet (a cartoon-like character in VR).…”

Section: Conflicts Of Interestmentioning

confidence: 99%

Application of Virtual Reality in Computer Science Education: A Systemic Review Based on Bibliometric and Content Analysis Methods

et al. 2021

View full text Add to dashboard Cite

show abstract

“…In the future, we will use the proposed microservice mechanism to integrate other Puppetry solutions to extend Avatar applications. For example, features described in [14] and [15] can be accommodated in AvatarTalk as new applications. Also, we will introduce the AI mechanism that interprets the puppet script to fine-tune the IK chain movements to enhance the avatar gestures in the performance.…”

Section: Discussionmentioning

confidence: 99%

“…In a different research study focusing on non-gesture control of virtual models [15], it is proposed that humans can express or simulate their emotions through virtual models. Therefore, a system was developed that utilizes a pen to control virtual models.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

An IoT-Based Microservice Platform for Virtual Puppetry Performance

Luo,

Lin,

Liao

et al. 2023

IEEE Access

View full text Add to dashboard Cite

This study proposes a web-based real-time remote-controlled virtual puppetry (avatar) performance platform called AvatarTalk to combine traditional Taiwanese puppetry, the Internet of Things (IoT), and 3D avatar models. AvatarTalk enables puppeteers to control avatar puppets on the web using either motion capture gloves or camera-based image recognition. This transformative performance approach not only facilitates remote performances and multi-screen presentations across various devices but also introduces a fresh gesture interpretation technique for dance artists. AvatarTalk supports a mechanism that can accommodate new control and puppet devices from other approaches through the IoT-based microservice concept. We develop a calibration procedure to enable the accurate capture of hand gestures to manipulate the movements of virtual puppets, empowering them to perform fundamental traditional puppetry poses such as nodding, bowing, and synchronized hand movements. We have conducted experiments to show the accuracy of AvatarTalk calibration. Our study indicates that AvatarTalk can almost detect the right gestures (98.75%-100% recall) and very seldom mistake the wrong gestures (90.8%-100% precision). Additionally, we also provide the mechanism to measure the delays of controlling the puppets. An analytic model is proposed to design the delay times of the messages between the control device of a puppeteer and the AvatarTalk server. In the current AvatarTalk implementation, if the message delay does not exceed 0.1 seconds, four puppeteers can synchronize their actions if the elapsed time between two actions of a puppeteer is longer than 0.3 second.

show abstract

“…The utilization of stimuli to induce emotional states is widely used in many kinds of research, especially psychological research. There are many stimuli used to induce emotion such as odors [4] [5], situational play [5] [6], cartoons [7] [8] [9] , puppets [9] [10] or graphics like pictures [11] [12] [13] [14] [15] They can invoke existing emotional memories. Other than pictures, videos have been accepted in the field of emotion research and have been used for decades [16] [17] [18] [19] [20].…”

Section: Introductionmentioning

confidence: 99%

Stimuli Video Quantification Based on Valence-Arousal Elicitation in Children With Autism Spectrum Disorder (ASD)

Rashidan,

Sidek,

Yusof

et al. 2023

IEEE Access

View full text Add to dashboard Cite

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder characterized by impaired social communication and repetitive behaviors. Understanding the emotional responses of children with ASD is crucial, especially for early interventions. Therefore, the study aims to validate appropriate stimuli in video forms that are able to elicit Autism Spectrum Disorder (ASD) children's emotions. The study involves 56 children, 28 of whom have ASD, from IDEAS Autism Center in Rawang, Malaysia, aged between five and nine years (M = 6.43, SD = 1.2), and 28 typically developed children (M = 5.65, SD = 2.2) from IIUM Educare, Gombak, Malaysia. The children were presented with 15 stimuli videos that are targeted to elicit five basic emotions which are happy, sad, fear, anger, and calm. The stimuli are validated by blind coders to mitigate potential sources of bias and errors in the experiment. The subjects' response towards the stimuli videos were mapped onto valence and arousal emotion model. The study observed that all stimuli were successfully classified into the respective emotion quadrants. The study also discovered certain video stimuli produce higher intensity in emotion elicitation than others. Significant and meaningful findings between ASD children's responses to the stimuli video are extensively discussed.

show abstract

A pen user interface for controlling a virtual puppet

Cited by 4 publications

References 24 publications

Application of Virtual Reality in Computer Science Education: A Systemic Review Based on Bibliometric and Content Analysis Methods

Application of Virtual Reality in Computer Science Education: A Systemic Review Based on Bibliometric and Content Analysis Methods

An IoT-Based Microservice Platform for Virtual Puppetry Performance

Stimuli Video Quantification Based on Valence-Arousal Elicitation in Children With Autism Spectrum Disorder (ASD)

Contact Info

Product

Resources

About