Panel or jury testing methods in a metrological perspective

Abstract

Panel or jury testing is a widely used technique in the measurement of quantities related to human perception. However, despite both scientific and applied interests, the confidence of potential users of this technique is less than in more familiar physical and engineering measurements. This lack of confidence arises mainly due to the lack of standardization and of internationally recognized metrological references for panel testing.Here we discuss some methodological aspects of panel testing, including the construction of the reference scale, the definition and realization of a measuring system based on a previously established scale, its calibration and related uncertainty evaluation. We provide illustrative examples concerning the measurement of the quality of sound (acceptability) of machinery used for the automatic sorting of post, presenting experimental results from tests performed in our laboratory, which seem encouraging.Finally, we propose some possible actions for standardization and for the promotion of a metrological approach.

An attempt to interpret some problems in measurement science on the basis of Kuhn’s theory of paradigms

“…Moreover if we reconsider the problem of the measurement quantities related to perception [6,23,24], which, as we have already noted, has occurred using the second paradigm from the very beginning, we find problems. Although such measurements are of high potential interest, both for science, industry and society, user's confidence in them is usually less than in other physical or engineering measurements.…”

A probabilistic theory of measurement

“…; A m Þ a finite collection of extensive structures on A. 24 Then a(n) (empirical) probabilistic extensive structure is a probability space…”

“…We have also discussed the concept of the measuring system and how it may also be applied in the measurement of quantities related to human perception, in a couple of recent papers of ours [23,24].…”

“…This perspective is particularly fruitful for the measurement of quantities related to human perception [19,20,23,24].…”

“…Note that since A is finite, the set of all difference structures on A is also finite 24. Note that since A is finite, the set of all extensive structures on A is also finite.…”