Ensemble feature selection for multi‐label text classification: An intelligent order statistics approach

Abstract

Because of the overgrowth of data, especially in text format, the value and importance of multi‐label text classification have increased. Aside from this, preprocessing and particularly intelligent feature selection (FS) are the most important step in classification. Each FS finds the best features based on its approach, but we try to use a multi‐strategy approach to find more useful features. Evaluating and comparing features’ importance and relevance makes using multiple strategy and methods more suitable than conventional approaches because each feature is measured based on several perspectives. Nevertheless, the ensemble FS merges the final performance results of various methods to take advantage of different methods’ strengths and better classify. In this article, we have proposed an ensemble FS method for multi‐label text data (MLTD) for the first time using the order statistics (EMFS) approach. We have utilized four multi‐label FS (MLFS) algorithms with various particular performances to achieve a good result. In this method, as one of the most important statistics methods, Order Statistics was used to aggregate the ranks of different algorithms, which is robust against noise, redundant and inessential features. In the end, the performance of EMFS, executing six MLTDs, was evaluated according to six performance criteria (ranking‐based and classification‐based). Surprisingly, the proposed method was more accurate than others among all used MLTDs. The proposed method has improved by 1.5% compared to other methods. This value is based on the results obtained based on six evaluation criteria and all tested data sets.

Evolutionary binary feature selection using adaptive ebola optimization search algorithm for high-dimensional datasets

“…Also, for the V-family, which is nested with the S-family, we show in Eqs (15)(16)(17)(18) the definition for the V1(S1), V2(S1), V1(S2), and V2(S2), transfer functions.…”

“…The merit and demerit of the filter method are low computational cost and low performance, respectively. The wrapper-based methods perform feature reduction using a predetermined learning algorithm that evaluates all possible feature subsets to find the optimal one [16]. The wrapper has the advantage of providing higher classification accuracy than the others.…”

A Web Semantic-Based Text Analysis Approach for Enhancing Named Entity Recognition Using PU-Learning and Negative Sampling

“…In recent years, we have witnessed the rapid advancement of deep learning and its successful applications (Sarivougioukas & Vagelatos, 2022;Lv et al, 2022;Zhou et al, 2022b;Jiao et al, 2023). NLP is a pivotal domain within deep learning and encompasses various developmental trajectories and applications (Ismail et al, 2022;Vats et al, 2023), such as text classification (Singh & Sachan, 2021;Miri et al, 2022), text-to-image synthesis (Chopra et al, 2022), and unsupervised information extraction (Sarkissian & Tekli, 2021;Hajjar & Tekli, 2022). Among these domains, knowledge graphs are an indispensable component and have extensive applications in various fields (Zhao et al, 2022;Zhou et al, 2022a;Li et al, 2023), such as health care and cybersecurity (Gou et al, 2017;Sahoo & Gupta, 2019).…”

A Model-Free Feature Selection Technique of Feature Screening and Random Forest-Based Recursive Feature Elimination

“…Literature Review. Tere has been a considerable amount of research on feature selection, which can generally be categorized into three types: embedded, flter, and wrapper methods [11,12]. Embedded approaches involve model learning by selecting variables during the learning process using methods such as objective function optimization, change calculation, and selecting the set of variables with the best solution as the best model.…”