Spectral Envelope Transformation in Singing Voice for Advanced Pitch Shifting

Santacruz, Jose L.; Tardón, Lorenzo J.; Barbancho, Isabel; Barbancho, Ana M.

doi:10.3390/app6110368

Cited by 4 publications

(6 citation statements)

References 30 publications

(33 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The length of the median filter in the frequency direction was 500 Hz, which corresponds to 46 bins. In the time direction, the length of the median filter was chosen to be 200 ms, but the number of frames it corresponds to depends on the analysis hop size, which is determined by the TSM factor according to (10). Finally, the transient detection threshold was set to t d = 10 −4 = 0.00010.…”

Section: Discussionmentioning

confidence: 99%

“…Audio time stretching has numerous applications, such as fast browsing of speech recordings [4], music production [5], foreign language and music learning [6], fitting of a piece of music to a prescribed time slot [7], and slowing down the soundtrack for slow-motion video [8]. Additionally, TSM is often used as a processing step in pitch shifting, which aims at changing the frequencies in the signal without changing its duration [2,3,7,9,10].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Audio Time Stretching Using Fuzzy Classification of Spectral Bins

Damskägg

Välimäki

2017

Applied Sciences

View full text Add to dashboard Cite

A novel method for audio time stretching has been developed. In time stretching, the audio signal's duration is expanded, whereas its frequency content remains unchanged. The proposed time stretching method employs the new concept of fuzzy classification of time-frequency points, or bins, in the spectrogram of the signal. Each time-frequency bin is assigned, using a continuous membership function, to three signal classes: tonalness, noisiness, and transientness. The method does not require the signal to be explicitly decomposed into different components, but instead, the computing of phase propagation, which is required for time stretching, is handled differently in each time-frequency point according to the fuzzy membership values. The new method is compared with three previous time-stretching methods by means of a listening test. The test results show that the proposed method yields slightly better sound quality for large stretching factors as compared to a state-of-the-art algorithm, and practically the same quality as a commercial algorithm. The sound quality of all tested methods is dependent on the audio signal type. According to this study, the proposed method performs well on music signals consisting of mixed tonal, noisy, and transient components, such as singing, techno music, and a jazz recording containing vocals. It performs less well on music containing only noisy and transient sounds, such as a drum solo. The proposed method is applicable to the high-quality time stretching of a wide variety of music signals.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Audio Time Stretching Using Fuzzy Classification of Spectral Bins

Damskägg

Välimäki

2017

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…The same approach could also be used for applying other rules, such as proposed in [1] or [29] for tuning formants frequencies to the f0 for more realistic pitch transformations.…”

Section: Discussionmentioning

confidence: 99%

“…Another possible approach that we propose to use here is pole modification, based on an all-pole model of spectral envelope. This possibility is mentioned in [29], but has been discarded for being too complicated. A similar approach was used in [30] and [31] to modify formants, focusing on controlling pole interaction.…”

Section: Proposed Transformation Approachmentioning

confidence: 99%

A Mouth Opening Effect Based on Pole Modification for Expressive Singing Voice Transformation

Ardaillon¹,

Röebel²

2017

Interspeech 2017

View full text Add to dashboard Cite

Improving expressiveness in singing voice synthesis systems requires to perform realistic timbre transformations, e.g. for varying voice intensity. In order to sing louder, singers tend to open their mouth more widely, which changes the vocal tract's shape and resonances. This study shows, by means of signal analysis and simulations, that the main effect of mouth opening is an increase of the 1 st formant's frequency (F1) and a decrease of its bandwidth (BW1). From these observations, we then propose a rule for producing a mouth opening effect, by modifying F1 and BW1, and an approach to apply this effect on real voice sounds. This approach is based on pole modification, by changing the AR coefficients of an estimated all-pole model of the spectral envelope. Finally, listening tests have been conducted to evaluate the effectiveness of the proposed effect.

show abstract

“…Thirdly, the envelope theory (ET) is known as an auxiliary field method [28,29]; therefore, we could use this convenient method for the wave comparison between the simulation and the measurements. The envelope correlation algorithm is applied to compute the maximum correlation coefficient in order to choose the most similar envelope waveforms in a quantitative approach and locate the flaws.…”

Section: Approximation Based On Envelope Comparisonmentioning

confidence: 99%

The Study of Non-Detection Zones in Conventional Long-Distance Ultrasonic Guided Wave Inspection on Square Steel Bars

et al. 2018

View full text Add to dashboard Cite

Abstract:In a low-frequency ultrasonic guided wave dual-probe flaw inspection of a square steel bar with a finite length boundary, the flaw reflected pulse wave cannot be identified using conventional time monitoring when the flaw is located near the reflection terminal; therefore, the conventional ultrasonic echo method is not applicable and results in a non-detection zone. Using analysis and simulations of ultrasonic guided waves for the inspection of a square steel bar, the reasons for the appearance of the non-detection zone and its characteristics were analyzed and the range of the non-detection zone was estimated. Subsequently, by extending the range of the conventional detection time domain, the envelope of the specific reflected pulse signal was extracted by a combination of simulations and related envelope calculations to solve the problem of the non-detection zone in conventional inspection methods. A comparison between the simulation and the experimental results demonstrate that the solution is feasible. This study has certain practical significance for ultrasonic guided wave structural monitoring.

show abstract

Spectral Envelope Transformation in Singing Voice for Advanced Pitch Shifting

Cited by 4 publications

References 30 publications

Audio Time Stretching Using Fuzzy Classification of Spectral Bins

Audio Time Stretching Using Fuzzy Classification of Spectral Bins

A Mouth Opening Effect Based on Pole Modification for Expressive Singing Voice Transformation

The Study of Non-Detection Zones in Conventional Long-Distance Ultrasonic Guided Wave Inspection on Square Steel Bars

Contact Info

Product

Resources

About