The Effects of Musical Experience and Hearing Loss on Solving an Audio-Based Gaming Task

Abstract

Abstract:We conducted an experiment using a purposefully designed audio-based game called the Music Puzzle with Japanese university students with different levels of hearing acuity and experience with music in order to determine the effects of these factors on solving such games. A group of hearing-impaired students (n = 12) was compared with two hearing control groups with the additional characteristic of having high (n = 12) or low (n = 12) engagement in musical activities. The game was played with three sound sets or modes; speech, music, and a mix of the two. The results showed that people with hearing loss had longer processing times for sounds when playing the game. Solving the game task in the speech mode was found particularly difficult for the group with hearing loss, and while they found the game difficult in general, they expressed a fondness for the game and a preference for music. Participants with less musical experience showed difficulties in playing the game with musical material. We were able to explain the impacts of hearing acuity and musical experience; furthermore, we can promote this kind of tool as a viable way to train hearing by focused listening to sound, particularly with music.

“Did You Hear That?” Learning to Play Video Games from Audio Cues

“…Including audio as well as visual information within a game can make completing it much more plausible for visually impaired players. Additionally, individuals with hearing difficulties would find it hard to play games that are heavily reliant on sound [18]. Intelligent agents can help to evaluate games for individuals with disabilities: if an agent is able to successfully play a game using only audio or visual input, then this could help validate the game for the corresponding player demographics.…”

Special Issue on “Sound and Music Computing”

“…Hansen and Hiraga [22] introduce and evaluate Music Puzzle, which is an audio-based game. Interestingly, they tested the game with different user groups.…”

Audiojogos educacionais: um Mapeamento Sistemático da Literatura

“…Em grande parte, o som tem função de ambientação e imersão (Balan et al, 2015). Entretanto, alguns estudos analisaram o potencial de audiojogos no contexto educacional (Milne et al, 2014;Rovithis et al, 2014b;Hansen & Hiraga, 2017), e construíram diretrizes para desenvolvimento de audiojogos (Rovithis et al, 2014a;Silva Ribeiro et al, 2019), bem como, aplicaram audiojogos em ambiente escolar e obtiveram aceitação por parte de educadores e estudantes com deficiência visual (Ferreira & Cavaco, 2014;Araújo et al, 2016a;Sobral et al, 2017).…”