Music Puzzle: An Audio-Based Computer Game That Inspires to Train Listening Abilities

Hansen, Kjetil Falkenberg; Hiraga, Rumi; Li, Zheng; Wang, Hua

doi:10.1007/978-3-319-03161-3_48

Cited by 9 publications

(4 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In academia, some researchers have investigated the design of music-based puzzle games, mostly for education purposes. A notable example is the work presented by (Hansen et al 2013), which experimented with a number of designs of sound-based puzzle game to train the listening abilities of visually impair people. A music clip was divided into several fragments and a player had to rearrange them in order to reconstruct the original song.…”

Section: Background and Significancementioning

confidence: 99%

Generating Music Medleys via Playing Music Puzzle Games

Huang

Chou

Yang

2018

AAAI

View full text Add to dashboard Cite

Generating music medleys is about finding an optimal permutation of a given set of music clips. Toward this goal, we propose a self-supervised learning task, called the music puzzle game, to train neural network models to learn the sequential patterns in music. In essence, such a game requires machines to correctly sort a few multisecond music fragments. In the training stage, we learn the model by sampling multiple non-overlapping fragment pairs from the same songs and seeking to predict whether a given pair is consecutive and is in the correct chronological order. For testing, we design a number of puzzle games with different difficulty levels, the most difficult one being music medley, which requiring sorting fragments from different songs. On the basis of state-of-the-art Siamese convolutional network, we propose an improved architecture that learns to embed frame-level similarity scores computed from the input fragment pairs to a common space, where fragment pairs in the correct order can be more easily identified. Our result shows that the resulting model, dubbed as the similarity embedding network (SEN), performs better than competing models across different games, including music jigsaw puzzle, music sequencing, and music medley. Example results can be found at our project website, https://remyhuang.github.io/DJnet.

show abstract

Section: Background and Significancementioning

confidence: 99%

Generating Music Medleys via Playing Music Puzzle Games

Huang

Chou

Yang

2018

AAAI

View full text Add to dashboard Cite

show abstract

“…It is developed for Android devices with touchscreen and uses a Pure data real-time audio engine library [61] (see also [8,9]). Our initial idea was to use music, which means that the purpose of the game is to recompose a musically correct piece of music from fragmented parts of a recording.…”

Section: The Music Puzzlementioning

confidence: 99%

The Effects of Musical Experience and Hearing Loss on Solving an Audio-Based Gaming Task

Hansen

Hiraga

2017

Applied Sciences

Self Cite

View full text Add to dashboard Cite

Abstract:We conducted an experiment using a purposefully designed audio-based game called the Music Puzzle with Japanese university students with different levels of hearing acuity and experience with music in order to determine the effects of these factors on solving such games. A group of hearing-impaired students (n = 12) was compared with two hearing control groups with the additional characteristic of having high (n = 12) or low (n = 12) engagement in musical activities. The game was played with three sound sets or modes; speech, music, and a mix of the two. The results showed that people with hearing loss had longer processing times for sounds when playing the game. Solving the game task in the speech mode was found particularly difficult for the group with hearing loss, and while they found the game difficult in general, they expressed a fondness for the game and a preference for music. Participants with less musical experience showed difficulties in playing the game with musical material. We were able to explain the impacts of hearing acuity and musical experience; furthermore, we can promote this kind of tool as a viable way to train hearing by focused listening to sound, particularly with music.

show abstract

“…What is missing is a puzzle where the music is the source of information used by the solver, and which demands careful listening. To our knowledge, the only predecessor with this feature is the prototype game developed by Hansen, Hiraga, Li, and Wang (2013), who developed a musical analogue of a jigsaw puzzle. A 15-second excerpt of music is divided into pieces and the solver's goal is to arrange the pieces from left to right in order to reconstruct the original excerpt.…”

Section: Musical Puzzles and Gamesmentioning

confidence: 99%

“…We next added two features to make the game more userfriendly. First, following the example of Hansen et al (2013), we added a welcome screen (see 7(b)) where solvers were allowed to listen to each of the eight excerpts separately before solving the puzzle-just like jigsaw puzzle solvers can look at the picture on the box first.…”

Section: Version 4: Improving Usabilitymentioning

confidence: 99%

The CrossSong Puzzle: Developing a Logic Puzzle for Musical Thinking

Smith

Kato

Fukayama

et al. 2017

Journal of New Music Research

View full text Add to dashboard Cite

There is considerable interest in music-based games and apps. However, in existing games, music generally serves as an accompaniment or as a reward for progress. We set out to design a game where paying attention to the music would be essential to making deductions and solving the puzzle. The result is the CrossSong Puzzle, a novel type of music-based logic puzzle that integrates musical and logical reasoning. The game presents a player with a grid of tiles, each representing a mash-up of excerpts from two different songs. The goal is to rearrange the tiles so that each row and column plays a continuous musical excerpt. To create puzzles, we implemented an algorithm to automatically identify a set of song fragments to fill a grid such that each tile contains an acceptable mash-up. We present several optimisations to speed up the search for high-quality grids. We also discuss the iterative design of the game's interface and present the results of a user evaluation of the final design. Finally, we present some insights learned from the experience which we believe are important to developing music-based puzzle games that are entertaining, feasible and that challenge one's ability to think about music.

show abstract

Music Puzzle: An Audio-Based Computer Game That Inspires to Train Listening Abilities

Cited by 9 publications

References 3 publications

Generating Music Medleys via Playing Music Puzzle Games

Generating Music Medleys via Playing Music Puzzle Games

The Effects of Musical Experience and Hearing Loss on Solving an Audio-Based Gaming Task

The CrossSong Puzzle: Developing a Logic Puzzle for Musical Thinking

Contact Info

Product

Resources

About