Puppet Narrator: Utilizing Motion Sensing Technology in Storytelling for Young Children

Liang, Hui; Chang, Jian; Kazmi, Ismail Khalid; Zhang, Jian Jun; Jiao, Pei-feng

doi:10.1109/vs-games.2015.7295784

Cited by 11 publications

(5 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recently, DST has been recognised as a catalyst for inspiring empathy and behavioral change, particularly in education and healthcare settings (Hidayat, 2023). The evolution of digital storytelling has been facilitated by modern technologies, such as virtual reality (VR), which have transformed traditional storytelling into a modern and challenging educational tool (Liang et al, 2015). Academics have regarded digital storytelling as a complement to conventional methods of learning and assessment, emphasising its potential to enhance learning and problem-solving skills (Clarke & Adam, 2011).…”

Section: Digital Storytelling (Dst) As a Catalyst To Enhance Ellmentioning

confidence: 99%

Digital Storytelling: A Catalyst to Enhance English Language Learning in Malaysia

Lim,

Hashim

2024

IJARBSS

View full text Add to dashboard Cite

English Language Learning (ELL) stands as a pivotal subject in worldwide education, gaining increasing significance in the landscape of 21st-century learning. The integration of Information and Communication Technology (ICT) in ELL, particularly from early childhood, has been a focal point. Nonetheless, a knowledge gap persists concerning the challenges and possibilities linked to the incorporation of Digital Storytelling (DST) within the Malaysian educational context. This conceptual paper explores the transformative role of DST as a catalyst for advancing ELL in the Malaysian educational landscape. Through an analysis of the global and Malaysian context, the paper sheds light on the unique opportunities and challenges associated with implementing DST in ELL. Additionally, it delves into the impact of DST on language skills, creative thinking, and critical analysis, offering insights that resonate with the goals of the Malaysian Education Blueprint and align with the aspirations of Sustainable Development Goal 4. The findings contribute to the ongoing discourse on effective strategies to enhance language education, particularly within the diverse and multicultural framework of Malaysia.

show abstract

Section: Digital Storytelling (Dst) As a Catalyst To Enhance Ellmentioning

confidence: 99%

Digital Storytelling: A Catalyst to Enhance English Language Learning in Malaysia

Lim,

Hashim

2024

IJARBSS

View full text Add to dashboard Cite

show abstract

“…The study "Puppet Narrator" evaluates the use of virtual puppet control programmed in Unity3D, via Leap Motion, for children storytelling (Liang, Chang, Kazmi, Zhang, & Jiao, 2015). The system associates some gestures with preprogrammed movements of the virtual puppet, without directly associating finger movements with puppets members.…”

Section: Related Workmentioning

confidence: 99%

MamuLEDs: Mixed Reality meets Mamulengo

Jácome¹,

Oliveira²,

Alvim³

et al. 2020

JIS

View full text Add to dashboard Cite

Techniques of Virtual, Augmented, and Mixed Reality (VR, AR, MR) have been used for puppet theater in different cultural contexts around the world. However, we are not yet aware of the use of these techniques in the Brazilian Northeast Popular Puppet Theater, a tradition known in Pernambuco as Mamulengo. We present here a system developed for “The Quarrel Between the Real Puppet and the Virtual Puppet,” a sketch created for the class Realidade Virtual e Aumentada of Computer Science program at CIn-UFPE. This paper aims to investigate how VR/AR/MR techniques can contribute to the creation of mamulengo shows. We used the method of qualitative case study, analyzing the audiovisual records of essays and presentation, the software solution developed in Unity 3D, and the data collected from a focus group interview with puppeteers. This study identified as weaknesses of our system: the hand tracking unreliability and the lack of tactile feedback, causing discomfort in experienced puppeteering professionals. As strengthens of the system, we found that the technology aroused interest because of its potential for expanding the options of tools available for popular puppetry shows creation in current times.

show abstract

“…For more details of hands movement control mechanism and gesture recognizing, please refer to our previous paper. 28 Except for the navigation, virtual puppets' actions are controlled by another set of predefined "trigger" gestures performed by another hand (the blue hand), as illustrated in Table 2(b). This hand is defined in the state of "trigger mode."…”

Section: Hand Gesture-based Interactionmentioning

confidence: 99%

Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices

Liang

Chang

Deng

et al. 2016

Computer Animation & Virtual

Self Cite

View full text Add to dashboard Cite

With the rapid development of human-computer interaction (HCI) technologies, the new media generation demands novel learning experiences with natural interaction and immersive experience. Considering that digital storytelling is a powerful pedagogical tool for young children, in this paper, we design an immersive storytelling environment which allows multiple players to use naturally interactive hand gestures to manipulate virtual puppetry for assisting narration. A set of multimodal interaction techniques is presented for a hybrid user interface that integrates existing 3D visualization and interaction devices including head-mounted displays (HMDs) and depth motion sensor. In this system, the young players could intuitively use hand gestures to manipulate a virtual puppet to perform a story and interact with props in a virtual stereoscopic environment. We have conducted a user experiment with four young children for pedagogical evaluation, as well as system acceptability and interactivity evaluation by postgraduate students. The results show that our framework has great potential to stimulate learning abilities of young children through collaboration tasks. The stereoscopic HMD outperformed the traditional monoscopic display in a comparison between the two.

show abstract

Puppet Narrator: Utilizing Motion Sensing Technology in Storytelling for Young Children

Cited by 11 publications

References 24 publications

Digital Storytelling: A Catalyst to Enhance English Language Learning in Malaysia

Digital Storytelling: A Catalyst to Enhance English Language Learning in Malaysia

MamuLEDs: Mixed Reality meets Mamulengo

Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices

Contact Info

Product

Resources

About