Tale of a robot: Humanoid robot assisted sign language tutoring

Köse, Hatice; Yorganci, Rabia

doi:10.1109/humanoids.2011.6100846

Cited by 34 publications

(23 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…An alternative to speech synthesis is to pre-record desired speech. This approach has been taken several times (e.g., References [13,50,61]). Although not common, this output may be processed after recording, for example by pitch shifting an adult voice to make it sound child-like [111,112].…”

Section: Voicementioning

confidence: 99%

“…It is unclear what identity robots' voices should project to influence optimal liking and learning. Sometimes, a voice is used that is similar to the students', such as using a child's voice when teaching children [31,32,61,111]. Kose and Yorganci reported that this had a "positive effect" on children [61].…”

Section: Voicementioning

confidence: 99%

“…Sometimes, a voice is used that is similar to the students', such as using a child's voice when teaching children [31,32,61,111]. Kose and Yorganci reported that this had a "positive effect" on children [61]. This could be attributable to the age of the voice, the naturalness of the voice (prerecorded), or a combination, leading to enhanced common ground between the robot and student.…”

Section: Voicementioning

confidence: 99%

“…Non-verbal cues used in RALL include head nods and happy faces [87] and smiling and thumbs up gesturing [114] corresponding to correct answers or success; head shakes and sad faces [87] and LED color changes [3,61] corresponding to incorrect answers; eye gaze for attention guiding, turntaking, and emotional display [33,80,87,117]; sound effects and music for emotional emphasis [20,59,70,114,117] or to increase energy [81]; color and light changes to show emotion [59,61,87] or voice recognition [76]; and body movement and motion to show animation [70,87,114], express understanding [70], or emphasize spoken material [23,114]. These cues may be executed in response to stimuli or used to create idling motions to make the robot seem more lifelike [81,87].…”

Section: Non-verbal Cuesmentioning

confidence: 99%

See 3 more Smart Citations

A Survey of Robot-Assisted Language Learning (RALL)

Randall

2019

J. Hum.-Robot Interact.

View full text Add to dashboard Cite

Robot-assisted language learning (RALL) is becoming a more commonly studied area of human-robot interaction (HRI). This research draws on theories and methods from many different fields, with researchers utilizing different instructional methods, robots, and populations to evaluate the effectiveness of RALL. This survey details the characteristics of robots used-form, voice, immediacy, non-verbal cues, and personalizationalong with study implementations, discussing research findings. It also analyzes robot effectiveness. While research clearly shows that robots can support native and foreign language acquisition, it has been unclear what benefits robots provide over computer-assisted language learning. This survey examines the results of relevant studies from 2004 (RALL's inception) to 2017. Results suggest that robots may be uniquely suited to aid in language production, with apparent benefits in comparison to other technology. As well, research consistently indicates that robots provide unique advantages in increasing learning motivation and in-task engagement, and decreasing anxiety, though long-term benefits are uncertain. Throughout this survey, future areas of exploration are suggested, with the hope that answers to these questions will allow for more robust design and implementation guidelines in RALL.

show abstract

Section: Voicementioning

confidence: 99%

Section: Voicementioning

confidence: 99%

Section: Voicementioning

confidence: 99%

Section: Non-verbal Cuesmentioning

confidence: 99%

See 2 more Smart Citations

A Survey of Robot-Assisted Language Learning (RALL)

Randall

2019

J. Hum.-Robot Interact.

View full text Add to dashboard Cite

show abstract

“…Bu oyunda, insansı robot bazı Amerikan ve Türk işaret dilinden oluşan ve çocuğunda robotun hareketlerini taklit edebildiği üst vücut hareketlerini uygular (demo videoları için: http://humanoid.ce.itu.edu.tr/) [13,14]. Sonra hareket robot rarafından RGBD kamera kullanılarak tanınır ve robot çocuğu hem sözlü hemde onaylama hareketleriyle harekete geçirir.…”

Section: Introductionunclassified

Gesture recognition for humanoid assisted interactive sign language tutoring

Ertugrul

Gurpinar

Kivrak

et al. 2013

2013 21st Signal Processing and Communications Applications Conference (SIU)

View full text Add to dashboard Cite

Özetçe-Bu çalışma işaret dilini insansı robot destekli taklit bazlı sıralı etkileşim oyunları ile iletişim sorunları yaşayan çocuklara öğretmeyi amaçlayan bir projenin parçasıdır. Bu bildiri etkileşim oyununun otizmli çocukların da yararlanabileceği şekilde geliştirmesine yönelik çalışmaları özetler. Otizm Spektrum Bozukluğu (ASD) kısıtlı sosyal etkileşim, iletişim sorunları ve kısıtlı hayal gücü gibi sorunları kapsar. ASD'li çocuklar çoğunlukla robotlara ilgi gösterir. Bu nedenle Robotlar çocuklar ve öğretmenleri/ebeveynleri arasında sosyla etkileşim kurma konusunda destek olarak kullanılabilir. Bu çalışmada bir Nao H25 Insansı robot öğretmene çocuklara izleme ve taklit yolu ile bazı işaretleri ve basit üst vücud hareketlerini öğretme konusunda yardımcı olmaktadır. İşaret ve hareketleri tanıma konusunda Kinect kamera bazlı bir sistem kullanılmaktadır. Robot bu sistemden gelen tanıma verilerini kullanarak katılımcılara performansları hakkında görsel ve sesli geri bildirimde bulunur. Anahtar Kelimeler -İnsan-Robot etkileşimi; otizm; taklit oyunları; işaret diliAbstract-This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

show abstract

Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children

Ioannou

Andreva

2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

This study suggests an innovative way of using an intelligent robot to support speech therapy for hearing impaired children through play. Although medical technology (e.g., hearing aid, cochlear implant) for children with hearing impairment has advanced significantly, the amplification itself does not provide optimal development of hearing and speaking; it must be combined with specialized therapy. The present study focuses on the use of the humanoid robot NAO in auditory-verbal therapy, an approach to the development of auditory and verbal skills, which does not allow lipreading or other non-verbal cues to facilitate communication. NAO does not have a human mouth and therefore children with hearing impairment cannot do lipreading; this unique characteristic of the technology has been successfully used in the study to create playful and engaging auditory-verbal therapy sessions for six kindergarten hearing impaired children, allowing them to improve their ability to follow instructions using the hearing aid/ cochlear implant rather than visual clues in the environment. Our results, although preliminary, seem to encourage further research in supporting hearing-impaired children via play with intelligent robots.

show abstract

Tale of a robot: Humanoid robot assisted sign language tutoring

Cited by 34 publications

References 12 publications

A Survey of Robot-Assisted Language Learning (RALL)

A Survey of Robot-Assisted Language Learning (RALL)

Gesture recognition for humanoid assisted interactive sign language tutoring

Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children

Contact Info

Product

Resources

About