A confidence paradigm for classification systems

Abstract

There is no universally accepted methodology to determine how much confidence one should place in the output of a classification system. In this article, we develop a confidence paradigm. This is a theoretical framework that attempts to unite the viewpoints of the classification system developer (or engineer) and the classification system user (or warfighter). The developer designs and tests the classification system at a macro‐level. The user fields the system in an environment often quite different than the environment used to develop the system. The user operates at a micro‐level and is interested in the indications as they are made by the system. The paradigm is based on the assumptions that the system confidence acts like or can be modelled as value, and that indication confidence can be modelled as a function of the posterior probability estimates. The viewpoints of the developer and the user are unified through the fundamental proposition that the expected value of the user's confidence should be approximately equal to the developer's confidence. This paradigm provides a direct link between traditional decision analysis techniques and traditional pattern recognition techniques. This methodology is applied to an automatic target recognition data set, and the results demonstrate the sort of behavior that would be expected from a rational confidence measure. © 2011 Wiley Periodicals, Inc. Naval Research Logistics, 2011

A Proposed Extended Version of the Hadi-Vencheh Model to Improve Multiple-Criteria ABC Inventory Classification

“…The analytic hierarchy process (AHP) is a popular methodology, but it involves subjectivity as well. Methods for solving the ABC inventory classification problem have been systematically and thoroughly reviewed and discussed in the relevant literature [9][10][11][12]. A number of methods were suggested in order to achieve multi-criteria classification of SKUs.…”

A Proposed Extended Version of the Hadi-Vencheh Model to Improve Multiple Criteria ABC Inventory Classification

“…The analytic hierarchy process (AHP) is a popular methodology but it involves subjectivity as well. Methods for solving the ABC inventory classification problem have been systematically and thoroughly reviewed and discussed in relevant literature [9][10][11][12]. A number of methods were suggested in order to achieve the multiple criteria classification of SKUs.…”