Combined classifier based on feature space partitioning

Abstract

This paper presents a significant modification to the AdaSS (Adaptive Splitting and Selection) algorithm, which was developed several years ago. The method is based on the simultaneous partitioning of the feature space and an assignment of a compound classifier to each of the subsets. The original version of the algorithm uses a classifier committee and a majority voting rule to arrive at a decision. The proposed modification replaces the fairly simple fusion method with a combined classifier, which makes a decision based on a weighted combination of the discriminant functions of the individual classifiers selected for the committee. The weights mentioned above are dependent not only on the classifier identifier, but also on the class number. The proposed approach is based on the results of previous works, where it was proven that such a combined classifier method could achieve significantly better results than simple voting systems. The proposed modification was evaluated through computer experiments, carried out on diverse benchmark datasets. The results are very promising in that they show that, for most of the datasets, the proposed method outperforms similar techniques based on the clustering and selection approach.

Pipelined language model construction for Polish speech recognition

“…Experiments in pattern recognition prove that application of classifier combinations can increase recognition accuracy (Woźniak and Krawczyk, 2012). The classifier combination concept can be also applied to ASR.…”

Regularized nonnegative matrix factorization: Geometrical interpretation and application to spectral unmixing

“…Apart from the data spectral analysis, it might find numerous applications in machine learning and artificial intelligence, including supervised classification (e.g., Woźniak and Krawczyk, 2012;Górecki and Łuczak, 2013), clustering (e.g., Kulczycki and Charytanowicz, 2010), and image processing (e.g., Cichocki et al, 2009;Hansen, 1998). Bioucas-Dias, J.M., Plaza, A., Dobigeon, N., Parente, M., Du, Q., Gader, P. and Chanussot, J.…”

A differential evolution approach to dimensionality reduction for classification needs

“…Methods used for classification vary from Bayes classifiers and k-NN algorithms , Artificial Neural Networks (ANNs) (Debska and Guzowska-Swider, 2011;Gocławski et al, 2012) and Support Vector Machines (SVMs) (Hsu and Lin, 2002;Jeleń et al, 2008) to classifier ensembles (Woźniak and Krawczyk, 2012), The classification accuracy depends greatly on the method used, but also on the underlying problem, i.e., the characteristics of the data on which the classification method is applied.…”