Show Me the Instruments: Musical Instrument Retrieval From Mixture Audio

Kim, Kyungsu; Park, Minju; Haesun, Joung,; Yunkee, Chae,; Yeongbeom, Hong,; Go, Seonghyeon; Lee, Kyogu

doi:10.1109/icassp49357.2023.10097162

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

A novel deep learning-based multi-instrument recognition method for polyphonic music

Bao

et al. 2023

2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)

View full text Add to dashboard Cite

A novel deep learning-based multi-instrument recognition method for polyphonic music

Bao

et al. 2023

2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS)

View full text Add to dashboard Cite

Virtual Instrument Performances (VIP): A Comprehensive Review

Kyriakou,

de la Campa Crespo,

Panayiotou

et al. 2024

Computer Graphics Forum

View full text Add to dashboard Cite

Driven by recent advancements in Extended Reality (XR), the hype around the Metaverse, and real‐time computer graphics, the transformation of the performing arts, particularly in digitizing and visualizing musical experiences, is an ever‐evolving landscape. This transformation offers significant potential in promoting inclusivity, fostering creativity, and enabling live performances in diverse settings. However, despite its immense potential, the field of Virtual Instrument Performances (VIP) has remained relatively unexplored due to numerous challenges. These challenges arise from the complex and multi‐modal nature of musical instrument performances, the need for high precision motion capture under occlusions including the intricate interactions between a musician's body and fingers with instruments, the precise synchronization and seamless integration of various sensory modalities, accommodating variations in musicians' playing styles, facial expressions, and addressing instrument‐specific nuances. This comprehensive survey delves into the intersection of technology, innovation, and artistic expression in the domain of virtual instrument performances. It explores musical performance multi‐modal databases and investigates a wide range of data acquisition methods, encompassing diverse motion capture techniques, facial expression recording, and various approaches for capturing audio and MIDI data (Musical Instrument Digital Interface). The survey also explores Music Information Retrieval (MIR) tasks, with a particular emphasis on the Musical Performance Analysis (MPA) field, and offers an overview of various works in the realm of Musical Instrument Performance Synthesis (MIPS), encompassing recent advancements in generative models. The ultimate aim of this survey is to unveil the technological limitations, initiate a dialogue about the current challenges, and propose promising avenues for future research at the intersection of technology and the arts.

show abstract

Show Me the Instruments: Musical Instrument Retrieval From Mixture Audio

Cited by 2 publications

References 12 publications

A novel deep learning-based multi-instrument recognition method for polyphonic music

A novel deep learning-based multi-instrument recognition method for polyphonic music

Virtual Instrument Performances (VIP): A Comprehensive Review

Contact Info

Product

Resources

About