Evaluation of the Robot Assisted Sign Language Tutoring Using Video-Based Studies

Köse, Hatice; Yorganci, Rabia; Algan, Esra H.; Syrdal, Dag Sverre

doi:10.1007/s12369-012-0142-2

Cited by 33 publications

(17 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Our previous study [17] relied on a web-based survey, which used the videos of a robot, while it was expressing a subset of signs from Turkish Sign Language. The survey was tested with adults, college students and nursery school students without any hearing impairment.…”

Section: Related Workmentioning

confidence: 99%

“…This study aimed to verify the performance of a robot in expressing the signs compared to a human signer. Also usage of a video based study was tested with different age groups [17]. The test results showed that, although the adults had no difficulty in understanding the robot's signs, children (6-10 and 10-16 age groups) had difficulty in recognizing the signs of the robot from the videos, and lost their motivation since the test did not have a game concept [17].…”

Section: Related Workmentioning

confidence: 99%

“…Also usage of a video based study was tested with different age groups [17]. The test results showed that, although the adults had no difficulty in understanding the robot's signs, children (6-10 and 10-16 age groups) had difficulty in recognizing the signs of the robot from the videos, and lost their motivation since the test did not have a game concept [17]. The novelty of the current study is that we recall the children from the same age groups, and more signs using two different robot platforms are asked within a game concept in order to study the effects of gaming in the virtual robot based sign language tutoring.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Robostar: An interaction game with humanoid robots for learning sign language

Ozkul

Köse

Yorganci

et al. 2014

2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014)

Self Cite

View full text Add to dashboard Cite

This paper presents results from interactive robotic games based on a multimodal user interface. This game is intended to be used as part of children's education and therapy, within a project based on human-robot and humancomputer interaction games featuring non-verbal gestures and imitation for the purpose of teaching sign language. The humanoid robot acts as a social peer and assistant in the games to motivate the child, teach non verbal signs, evaluate the child's effort, and give appropriate feedback to improve the learning and recognition rate of children. In the games, videos of the robot are used, and the performance of the children with hearing impairment are assessed in terms of subjective and objective evaluation criteria. We verified that the results of the tests using the robot's video-based games are in accordance with the physical robots performing same word sets and test setups.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Robostar: An interaction game with humanoid robots for learning sign language

Ozkul

Köse

Yorganci

et al. 2014

2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014)

Self Cite

View full text Add to dashboard Cite

show abstract

“…Unlike these robot drummers, child-sized humanoid robot KASPAR's main goal was not drumming, but it used drumming as a tool in interaction games [4] - [8]. KASPAR played the drums autonomously with a human partner, trying to imitate the rhythms produced by the human while using non-verbal gestures to motivate the human.…”

Section: Introductionmentioning

confidence: 99%

“…In [5], [6], the role of turntaking through different computational interaction models is studied, based on an updated version of the KASPAR's interactive drumming game. The approaches were tested with human participants and the experimental results were reported and analyzed in terms of imitation, turn-taking and the impact of non-verbal gestures as social cues [4] - [8].…”

Section: Introductionmentioning

confidence: 99%

Towards a robust drum stroke recognition system for human robot interaction

İnce

Duman

Yorganci

et al. 2015

2015 IEEE/SICE International Symposium on System Integration (SII)

Self Cite

View full text Add to dashboard Cite

This paper presents a system that enables the drum strokes to be automatically detected and recognized using auditory cues. In pursuit of creating an interactive drumming game, in which a human user is able to play drums with a humanoid robot (Robotic Drum Mate) relying on turn-taking and imitation principles, in this work, we specifically focus on creating an online and real-time system to process the audio streams acquired by a microphone. The idea of discriminating sounds of a toy drum set from other sounds in the environment enables the user to have a realistic experience of playing drums and having a more robust/fruitful human-robot interaction at the same time. This is achieved by learning auditory drum stroke templates and improving the noise robustness of the recognition system against the background noise without requiring any prior information. The system is evaluated using criteria such as detection and recognition rates in the online experiments in real world. We verify the applicability of our system in a drum playing game with human test subjects and assess the effects of the training session prior to the game and the feedback mechanism utilized on the robot about the drumming performance of the user.

show abstract