An Initial Study on Progressive Filtering Based on Dynamic Programming for Query-by-Singing/Humming

Jang, Jyh-Shing Roger; Lee, Hong-Ru

doi:10.1007/11922162_110

Cited by 4 publications

(2 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The studies in QbSH can also be categorized into top-down and bottom-up methods [2][3][4] [5]. The bottom-up approach solves the matching problems in QbSH by locally comparing the humming/singing query data with the reference music data to find the optimal matching result [6][7] [9]. Alternatively, the top-down method uses the global shape of the two waveforms for comparison, and the local information of the waveform for the adjustment of the matching result of global shape matching [2][8] [11].…”

Section: Introductionmentioning

confidence: 99%

“…QbSH systems based on a dynamic time warping (DTW) algorithm are one of the most common approaches. In the QbSH system proposed by Jang et al [9] [12], DTW was used to calculate the distance between the pitch features extracted from the queries and the reference data. An extension of DTW with three dimensions was proposed by Heo et al in order to solve the problem with multiple pitch candidates [13].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Novel Query-by-Singing/Humming Method by Estimating Matching Positions Based on Multi-layered Perceptron

2013

KSII TIIS

View full text Add to dashboard Cite

The increase in the number of music files in smart phone and MP3 player makes it difficult to find the music files which people want. So, Query-by-Singing/Humming (QbSH) systems have been developed to retrieve music from a user's humming or singing without having to know detailed information about the title or singer of song. Most previous researches on QbSH have been conducted using musical instrument digital interface (MIDI) files as reference songs. However, the production of MIDI files is a time-consuming process. In addition, more and more music files are newly published with the development of music market. Consequently, the method of using the more common MPEG-1 audio layer 3 (MP3) files for reference songs is considered as an alternative. However, there is little previous research on QbSH with MP3 files because an MP3 file has a different waveform due to background music and multiple (polyphonic) melodies compared to the humming/singing query. To overcome these problems, we propose a new QbSH method using MP3 files on mobile device. This research is novel in four ways. First, this is the first research on QbSH using MP3 files as reference songs. Second, the start and end positions on the MP3 file to be matched are estimated by using multi-layered perceptron (MLP) prior to performing the matching with humming/singing query file. Third, for more accurate results, four MLPs are used, which produce the start and end positions for dynamic time warping (DTW) matching algorithm, and those for chroma-based DTW algorithm, respectively. Fourth, two matching scores by the DTW and chroma-based DTW algorithms are combined by using PRODUCT rule, through which a higher matching accuracy is obtained. Experimental results with AFA MP3 database show that the accuracy (Top 1 accuracy of 98%, with an MRR of 0.989) of the proposed method is much higher than that of other methods. We also showed the effectiveness of the proposed system on consumer mobile device.

show abstract

Section: Introductionmentioning

confidence: 99%