Optimized Mahalanobis–Taguchi System for High-Dimensional Small Sample Data Classification

Abstract

The Mahalanobis–Taguchi system (MTS) is a multivariate data diagnosis and prediction technology, which is widely used to optimize large sample data or unbalanced data, but it is rarely used for high-dimensional small sample data. In this paper, the optimized MTS for the classification of high-dimensional small sample data is discussed from two aspects, namely, the inverse matrix instability of the covariance matrix and the instability of feature selection. Firstly, based on regularization and smoothing techniques, this paper proposes a modified Mahalanobis metric to calculate the Mahalanobis distance, which is aimed at reducing the influence of the inverse matrix instability under small sample conditions. Secondly, the minimum redundancy-maximum relevance (mRMR) algorithm is introduced into the MTS for the instability problem of feature selection. By using the mRMR algorithm and signal-to-noise ratio (SNR), a two-stage feature selection method is proposed: the mRMR algorithm is first used to remove noise and redundant variables; the orthogonal table and SNR are then used to screen the combination of variables that make great contribution to classification. Then, the feasibility and simplicity of the optimized MTS are shown in five datasets from the UCI database. The Mahalanobis distance based on regularization and smoothing techniques (RS-MD) is more robust than the traditional Mahalanobis distance. The two-stage feature selection method improves the effectiveness of feature selection for MTS. Finally, the optimized MTS is applied to email classification of the Spambase dataset. The results show that the optimized MTS outperforms the classical MTS and the other 3 machine learning algorithms.

A Molecular Image-Based Novel Quantitative Structure-Activity Relationship Approach, Deepsnap-Deep Learning and Machine Learning

“…Moreover, to confound complex factors that contain numerous explanatory variables and construct nonlinear predictive models, it is often difficult to perform accurate modeling using conventional statistical methods. However, machine learning that can learn large amounts of data and automatically build models to perform classification and regression is suitable (Idakwo et al, 2018;Achary, 2020;Lin, et al, 2020;Muratov et al, 2020;Xiao et al, 2020;Yang et al, 2020).…”

Application of the Mahalanobis-Taguchi System in Renal Profile of the Methadone Flexi Dispensing Program

“…MTS by Genichi Taguchi implements the Taguchi Methods concepts in multivariate applications that help in quantitative decision making by constructing a multivariate scale of measurements using a data-analytical process [9]. MTS is a widely used multisystem pattern recognition tool that has produced successful medical diagnosis, early warning, product identification, fault analysis, market administration, and systematic assessment [10]. The orthogonal arrays (O.A.)…”

Binary Bitwise Artificial Bee Colony as Feature Selection Optimization Approach within Taguchi’s T-Method

“…MTS establishes a multivariate measurement scale that recognizes a normal or healthy observation from an abnormal or an unhealthy observation and integrates it with the concept of signal-to-noise ratio (SNR) and orthogonal array (OA). Beginning with the introduction of the MT-Method as a classification technique that has so far gained much attention among scholars [7][8][9][10][11][12][13][14], Taguchi's T-Method has been established since then, which has utilized the same integration principles. e unit-space concept, the duplicate signal-to-noise ratio (SNR) adaptation as a weighting factor, zero-proportional theory, and OA as the feature selection optimization are the main elements that have been adopted in reinforcing Taguchi's T-Method robustness.…”