In this study, we developed a simulation game called "Human SUGOROKU" that consists of a full-body interaction system to enable elementary school students to enjoy and learn vegetation succession. The students' sense of immersion is improved by enabling them to play this game using their body movements. We conducted an experiment with the students and investigated the affects of the full-body interaction through interviews. The results showed that the full-body interaction promotes a sense of immersion in the game. This paper describes the structure of this system and the interview results.

No abstract

No abstract

The authors propose a novel application of human sensing technology to inclusive education. We focus on puppet show to aspire the inclusive education for both the normal hearing and the hearing impaired. Thus, we are developing Puppet Theater system to entertain both hearing impaired and normal hearing. This Puppet Theater system consists of two functions. First, the lines are displayed as letters with voice for complementing information of sound. The system enables the hearing impaired to understand the contents of the puppet show. Second function presents branches of the story to audience for encouraging the audience to understand the content of the story. In this paper, we describe that we develope branches of the story as function to select the branches by body movements for the purpose of additional effect of understanding contents of the story. The body movements are measured and detected by Kinect sensor for Xbox. We anticipate additional benefit of understanding contents of the story because this new function enables the audience to participate in the progression of the puppet show. The authors performed the system to elementary school pupils with hearing impairment and found that the pupils enjoyed it. Effects of the function were investigated with questionnaire.

In this study, evaluation experiment was conducted on an interactive puppet theater, a puppetry system designed for deaf children to enhance their enjoyment of performances. An interactive puppet theater has two features: a feature that ensures the transmission of information by textualizing dialogue information and a feature that encourages deaf children to participate in the story by using physical movements. For this study, experiment was conducted to evaluate whether the feature of participation in the story by using physical movements prompts these children to engage with the story setting in a puppet theater viewing experience. The evaluations were also aimed at ascertaining whether this feature could ensure an enjoyable viewing experience. This study targeted deaf children. The results obtained from the experiments revealed that this feature could be an effective way to encourage them to participate in the story setting, and to assist them in having an enjoyable viewing experience.