A Comprehensive Review of Dimensionality Reduction Techniques for Feature Selection and Feature Extraction

Abstract

<jats:p>Due to sharp increases in data dimensions, working on every data mining or machine learning (ML) task requires more efficient techniques to get the desired results. Therefore, in recent years, researchers have proposed and developed many methods and techniques to reduce the high dimensions of data and to attain the required accuracy. To ameliorate the accuracy of learning features as well as to decrease the training time dimensionality reduction is used as a pre-processing step, which can eliminate irrelevant data, noise, and redundant features. Dimensionality reduction (DR) has been performed based on two main methods, which are feature selection (FS) and feature extraction (FE). FS is considered an important method because data is generated continuously at an ever-increasing rate; some serious dimensionality problems can be reduced with this method, such as decreasing redundancy effectively, eliminating irrelevant data, and ameliorating result comprehensibility. Moreover, FE transacts with the problem of finding the most distinctive, informative, and decreased set of features to ameliorate the efficiency of both the processing and storage of data. This paper offers a comprehensive approach to FS and FE in the scope of DR. Moreover, the details of each paper, such as used algorithms/approaches, datasets, classifiers, and achieved results are comprehensively analyzed and summarized. Besides, a systematic discussion of all of the reviewed methods to highlight authors' trends, determining the method(s) has been done, which significantly reduced computational time, and selecting the most accurate classifiers. As a result, the different types of both methods have been discussed and analyzed the findings. </jats:p>

Skin Lesion Classification Based on Deep Convolutional Neural Networks Architectures

“…In recent years, substantial advancement has been achieved in the computer vision field utilizing larger datasets. Researchers that use deep Learning have extracted a greater extent of features in various layers [44,45].…”

A State of Art: Survey for Concurrent Computation and Clustering of Parallel Computing for Distributed Systems

“…The performance of the method improved by 100% in term of the operational availability and 22% for a sample graph in compared with other methods. Tyagi & Gupta, [16]  Presenting some techniques of the scheduling that have a good impact of improving the performance of processors  The single scheduling task is suffering from overhead running and also the execution time is higher than the multi scheduling task 2.…”

“…It connect several dataflow graph nodes in a cluster considering into account the several machines within the multiple computational machines such as the devices including the multicore unit processes. The algorithms used in this system contain iterative and conditional control as a result of using them within advanced machine learning systems for instance using it in a recurrent neutral network (RNN) [12]- [14] and in long short term memory (LSTM) [15], [16]. More detail has been given in Table II.…”

Cloud Computing Virtualization of Resources Allocation for Distributed Systems

“…Instead of storing and retrieving data from the local computer, cloud computing allows utilizing the services of remote computer [5]- [8]. The clients use the cloud services rather than working on their infrastructure, it means that the users don't need knowledge about the infrastructure of the network [9]- [11]. Virtualized computing resources could be delivered to the clients in three types of services: Infrastructure as a service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) [3], [12].…”