Effectiveness of a Product Quality Classifier

RRep: A composite index to assess and test rater precision

“…Different kinds of distance metrics and weighting schemes appropriate for various practical situations have been proposed and discussed in the literature. Typically, these metrics are expressed as nondecreasing functions of | i − j | when assessing the degree of disagreement among the provided evaluations (eg, loss matrix) or, vice versa, as nonincreasing function of | i − j | when assessing the degree of agreement (eg, linear agreeing weights and quadratic agreeing weights). A weighted version of the uniform kappa, , including symmetric weights (ie, w i j = w j i ) a priori assigned to each pair ( i , j ) of ratings, has been proposed by Gwet, and its statistical properties have been studied by Warrens .…”

Counting and quantification: Comparing psychometric and metrological perspectives on visual perceptions of number

“…The 'worst-sorting' case would corresponding to a completely incorrect sorting, essentially a random guesswork classification, as described in Ref. [46][47], with a uniform PMF across the different categories. A number of cost models have been investigated in the present work: Fig.…”

“…2, limited measurement quality leads not only to measurement uncertainty but above all to incorrect classification. Following this approach, a measure of the effectiveness, Eff, of sorting on an ordinal scale has been proposed [46,47] as:…”

Evaluating quality measured on a ternary ordinal scale

“…Though the second method seems to be less accurate (0.690 vs 0.780), due to its underrating tendency, it sometimes may be more effective from the effectiveness point of view, as defined in Bashkansky et al 20 .…”

“…(1) Using the RQP for estimating the accuracy of fruit quality classification 20 : A fruit packing company, involved in sorting (classifying), storing and marketing nectarines, sorts its fruit into one of three levels of quality: high, medium and unacceptable (low). In order to evaluate the classifier's effectiveness, a batch of 1000 nectarines was submitted to a sorting station.…”