On Some Biases Encountered in Modern Audio Quality Listening Tests (Part 2): Selected Graphical Examples and Discussion

Zieliński, Sławomir

doi:10.17743/jaes.2015.0094

Cited by 49 publications

(59 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Blauert and Jekosch (2012) proposed a multi-layer model of sound quality assessment, which takes into account some of these factors. Nevertheless, while the rigorous recommendations aiming at bias reduction exist (Zieliński, 2008), their purpose is often limited to improve the repeatability of the quality assessment methods. They are not concerned with finding genuine values of sound quality; the task which may not be at all possible.…”

Section: Discussionmentioning

confidence: 99%

“…The anchors can play a stabilizing role in quality assessment methods and can also be used as diagnostic tools, allowing an experimenter to detect the presence of systematic errors, provided that their quality characteristics are perceptually similar to the quality distortions exhibited by stimuli under assessment (Zieliński et al, 2008; see also "Requirements for optimum anchor behaviours" in ITU, [2001][2002][2003][2004][2005][2006][2007][2008][2009][2010][2011][2012][2013][2014]. In this study all the stimuli under assessment, including the mandatory and the optional anchors, were obtained by low-pass filtering of the original recording.…”

Section: Discussionmentioning

confidence: 99%

“…Consequently, it is crucial for experimenters to be able to reduce any type of systematic errors pertinent to their experimental procedures. An overview of the typical biases encountered in modern listening tests was presented by Zieliński et al (2008).…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Is a Multi-Slider Interface Layout Responsible for a Stimulus Spacing Bias in the MUSHRA Test?

Zieliński¹

2015

Archives of Acoustics

View full text Add to dashboard Cite

The multi-stimulus test with hidden reference and anchors (MUSHRA) is commonly used for subjective quality assessment of audio systems. Despite its wide acceptance in scientific and industrial sectors, the method is not free from bias. One possible source of bias in the MUSHRA method may be attributed to a graphical design of its user interface. This paper examines the hypothesis that replacement of the standard multi-slider layout with a single-slider version could reduce a stimulus spacing bias observed in the MUSHRA test. Contrary to the expectation, the aforementioned modification did not reduce the bias. This outcome formally supports the validity of using multiple sliders in the MUSHRA graphical interface.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Is a Multi-Slider Interface Layout Responsible for a Stimulus Spacing Bias in the MUSHRA Test?

Zieliński¹

2015

Archives of Acoustics

View full text Add to dashboard Cite

show abstract

“…Among the conditions are the stimuli processed by the systems under test, a hidden reference, and two anchor stimuli. The two anchors, so-called low-quality anchor and midquality anchor, are low-pass-filtered versions of the reference stimulus and were introduced to make the ratings of different assessors and labs more comparable [11,12]. The low-quality anchor has a cut-off frequency of 3.5 kHz and the mid-quality anchor has a cut-off frequency of 7 kHz.…”

Section: Itu-r Bs1534 (Mushra)mentioning

confidence: 99%

webMUSHRA — A Comprehensive Framework for Web-based Listening Tests

Schoeffler¹,

Bartoschek²,

Stöter³

et al. 2018

JORS

150

View full text Add to dashboard Cite

For a long time, many popular listening test methods, such as ITU-R BS.1534 (MUSHRA), could not be carried out as web-based listening tests, since established web standards did not support all required audio processing features. With the standardization of the Web Audio API, the required features became available and, therefore, also the possibility to implement a wide range of established methods as web-based listening tests. In order to simplify the implementation of MUSHRA listening tests, the development of webMUSHRA was started. By utilizing webMUSHRA, experimenters can configure web-based MUSHRA listening tests without the need of web programming expertise. Today, webMUSHRA supports many more listening test methods, such as ITU-R BS.1116 and forced-choice procedures. Moreover, webMUSHRA is highly customizable and has been used in many auditory studies for different purposes.

show abstract

“…For example, when a set of stimuli is presented that has a specific quality range, the usage of the quality rating scale will be different for an individual stimulus than when that stimulus is presented together with a different set of stimuli. Such effects like the range equalization bias (Zielinski et al 2008) may partially be related to the specific focus on individual degradations or the mapping of features to an overall quality judgment.…”

Section: Challenge 2: Assessment and Quantification Of Expectationsmentioning

confidence: 99%

More than I ever wanted or just good enough? User expectations and subjective quality perception in the context of networked multimedia services

2017

View full text Add to dashboard Cite

This article addresses the overall relevance and the influence of user expectations in the context of perceptual quality evaluation of technical systems, and how information about individual expectations can be integrated into research on Quality of Experience (QoE). Based on a literature survey on expectations in the fields of psychology, service quality and consumer satisfaction theory, an existing conceptual QoE perception model is extended by explicitly including desired and adequate expectations in the quality perception process. A direct expectation assessment paradigm is proposed that uses dedicated questionnaires. Further, it is shown how expectation-related knowledge can be used to increase the accuracy of quality prediction models. In addition, experimental setups are presented that enable controlled triggering of expectations in user studies. It is discussed how the role of expectations for QoE can be investigated in future research as well as how to further validate the proposed methods.

show abstract

On Some Biases Encountered in Modern Audio Quality Listening Tests (Part 2): Selected Graphical Examples and Discussion

Cited by 49 publications

References 32 publications

Is a Multi-Slider Interface Layout Responsible for a Stimulus Spacing Bias in the MUSHRA Test?

Is a Multi-Slider Interface Layout Responsible for a Stimulus Spacing Bias in the MUSHRA Test?

webMUSHRA — A Comprehensive Framework for Web-based Listening Tests

More than I ever wanted or just good enough? User expectations and subjective quality perception in the context of networked multimedia services

Contact Info

Product

Resources

About