This paper proposes further generalization of a multiclass Fisher's criterion. A formula describing the dependence between the generalized multiclass Fisher's criterion F(Theta) and the variance criterion F(v)Theta has been obtained. Using this formula, it has been shown that the feature extraction methods based on the Karhunen-Loeve (K-L) expansions are special cases of the discriminant method. A full evaluation of heuristic methods for feature extraction based on the K-L expansion with regard to discriminant methods has been presented. A new algorithm for sequential feature extraction has been proposed and is illustrated with an example.
This paper presents further discussion and development of the two-parameter Fisher criterion and describes its two modifications (weighted criterion and another multiclass form). The criteria are applied in two algorithms for training linear sequential classifiers. The main idea of the first algorithm is separating the outermost class from the others. The second algorithm, which is a generalization of the first one, is based on the idea of linear division of classes into two subsets. As linear division of classes is not always satisfactory, a piecewise-linear version of the sequential algorithm is proposed as well. The computational complexity of different algorithms is analyzed. All methods are verified on artificial and real-life data sets.
This paper is addressing problems related to the construction of classifiers based on the Similarity Discriminant Function (SDF), in which the traditional vector representation of a pattern is replaced with matrix data. We introduce potential modifications of the matrix data structure and propose new variants of the SDF. The algorithms that we present were tested on images of handwritten digits and on photographs of human faces, taken from the ORL and CMU-PIE databases. The results of experiments show that our modifications significantly improved the performance of the original SDF classifier.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.