Evaluation of objective speech transmission quality measurements in packet-based networks

Slavata, Oldrich; Holub, Jan

doi:10.1016/j.csi.2013.09.003

Cited by 4 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For much of the published work on speech quality in VoIP, PESQ is used as an objective metrics of speech quality, e.g., [23,24]. PESQ was originally designed with narrowband telephony in mind and did not specifically target the most common quality problems encountered in VoIP systems described in 2.1.…”

Section: Subjective and Objective Speech Quality Assessmentmentioning

confidence: 99%

ViSQOL: an objective speech quality model

Hines

Skoglund

Kokaram

et al. 2015

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

This paper presents an objective speech quality model, ViSQOL, the Virtual Speech Quality Objective Listener. It is a signal-based, full-reference, intrusive metric that models human speech quality perception using a spectro-temporal measure of similarity between a reference and a test speech signal. The metric has been particularly designed to be robust for quality issues associated with Voice over IP (VoIP) transmission. This paper describes the algorithm and compares the quality predictions with the ITU-T standard metrics PESQ and POLQA for common problems in VoIP: clock drift, associated time warping, and playout delays. The results indicate that ViSQOL and POLQA significantly outperform PESQ, with ViSQOL competing well with POLQA. An extensive benchmarking against PESQ, POLQA, and simpler distance metrics using three speech corpora (NOIZEUS and E4 and the ITU-T P.Sup. 23 database) is also presented. These experiments benchmark the performance for a wide range of quality impairments, including VoIP degradations, a variety of background noise types, speech enhancement methods, and SNR levels. The results and subsequent analysis show that both ViSQOL and POLQA have some performance weaknesses and under-predict perceived quality in certain VoIP conditions. Both have a wider application and robustness to conditions than PESQ or more trivial distance metrics. ViSQOL is shown to offer a useful alternative to POLQA in predicting speech quality in VoIP scenarios.

show abstract

Section: Subjective and Objective Speech Quality Assessmentmentioning

confidence: 99%

ViSQOL: an objective speech quality model

Hines

Skoglund

Kokaram

et al. 2015

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

show abstract

“…The results can also be affected by Packet Loss Concealment (PLC), implemented by Linphone. Comparing the results of our previous experiment [6,7] with [10], it is obvious that our version of Linphone had no PLC implemented.…”

Section: Figure 2 Test Signalmentioning

confidence: 83%

“…It has not been tested for PCM transmissions affected by packet loss. However, the recommendation itself does not prevent any user from doing this, and it was successfully used in previous experiments [6,7,8,9]. The results can also be affected by Packet Loss Concealment (PLC), implemented by Linphone.…”

Section: Figure 2 Test Signalmentioning

confidence: 99%

Impact of the codec and various QoS methods on the final quality of the transferred voice in an IP network

Slavata

Holub

2015

J. Phys.: Conf. Ser.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Our aim is to investigate if the common practice of adapting the physical layer parameters is beneficial when the goal is to maintain a given MOS rather than a given BER of the encoded audio bit stream. This is motivated by the observation (Slavata & Holub, 2014) that, although larger BER values create more bit errors to the encoded audio stream, by keeping the audio rate constant instead of reducing it, the audio decoder may be able to better conceal the effect of the additional errors on the quality of the audio.…”

Section: Introductionmentioning

confidence: 99%

Towards Layer Adaptation for Audio Transmission

Holub

Slavata

Souček

et al. 2014

International Journal of Interdisciplinary Telecommunications and Networking

Self Cite

View full text Add to dashboard Cite

When audio is transmitted over the wireless channel, the quality of the audio depends on the signal-to-noise ratio (SNR). The purpose of this paper is to investigate if rate adaptation can be avoided, and a system can rely instead on the audio encoder and decoder to alleviate the effect of channel errors. To this end, the paper reports on a set of experiments on various combinations of channel conditions, constellation sizes and audio encoding used and on the final audio quality achieved. The Mean Opinion Score (MOS) is used for performance evaluation. The MOS values are generated using the ITU-T P.862 (PESQ) and P.863 (POLQA) algorithms, and also using tests by experts. The results support the common practice of adapting the physical layer parameters to changing channel conditions. However, in some cases, it is possible to maintain a constant rate without impacting significantly the quality of the audio. This means that the complexity associated with physical layer and audio rate adaptation can be avoided leading to simpler and more robust designs.

show abstract

Evaluation of objective speech transmission quality measurements in packet-based networks

Cited by 4 publications

References 5 publications

ViSQOL: an objective speech quality model

ViSQOL: an objective speech quality model

Impact of the codec and various QoS methods on the final quality of the transferred voice in an IP network

Towards Layer Adaptation for Audio Transmission

Contact Info

Product

Resources

About