Humming-to-Instrument Conversion based on CycleGAN

Lai, Wen-Hsing; Wang, Siou-Lin; Xu, Zhi-Yao

doi:10.1109/ispacs51563.2021.9651076

Search citation statements

Order By: Relevance

Paper Sections

Select...

Proposed Methods1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2022

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For singing/humming to instrument conversion, we present two proposed methods based on CycleGAN-VC and CycleGAN-VC2, namely CycleGAN-IC [31] and CycleGAN-IC2, respectively, and a dual conversion concatenation model consisting of singing to humming and humming to instrument, namely CycleGAN-ICd.…”

Section: Proposed Methodsmentioning

confidence: 99%

CycleGAN-Based Singing/Humming to Instrument Conversion Technique

Lai

Wang²,

2022

Electronics

View full text Add to dashboard Cite

In this research, singing/humming to instrument conversion techniques are proposed. In humming to instrument, two models based on cycle-consistent adversarial networks (CycleGAN) on viola are experimented. From the objective and subjective evaluations conducted, the converted audio is more similar to viola compared to humming, and the quality of the converted sound is fair to listeners. In singing to instrument, to fix the problem of the gap between singing and instrument, a dual conversion model consisting of singing to humming and humming to instrument is proposed. The objective and subjective experimental results show that the dual conversion has better converted audio quality than conversion by singing to instrument directly.

show abstract

Section: Proposed Methodsmentioning

confidence: 99%