Performance Assessment of Multiple Classifiers Based on Ensemble Feature Selection Scheme for Sentiment Analysis

Abstract

Sentiment classification or sentiment analysis has been acknowledged as an open research domain. In recent years, an enormous research work is being performed in these fields by applying various numbers of methodologies. Feature generation and selection are consequent for text mining as the high-dimensional feature set can affect the performance of sentiment analysis. This paper investigates the inability or incompetency of the widely used feature selection methods (IG, Chi-square, and Gini Index) with unigram and bigram feature set on four machine learning classification algorithms (MNB, SVM, KNN, and ME). The proposed methods are evaluated on the basis of three standard datasets, namely, IMDb movie review and electronics and kitchen product review dataset. Initially, unigram and bigram features are extracted by applying n-gram method. In addition, we generate a composite features vector CompUniBi (unigram + bigram), which is sent to the feature selection methods Information Gain (IG), Gini Index (GI), and Chi-square (CHI) to get an optimal feature subset by assigning a score to each of the features. These methods offer a ranking to the features depending on their score; thus a prominent feature vector (CompIG, CompGI, and CompCHI) can be generated easily for classification. Finally, the machine learning classifiers SVM, MNB, KNN, and ME used prominent feature vector for classifying the review document into either positive or negative. The performance of the algorithm is measured by evaluation methods such as precision, recall, and F-measure. Experimental results show that the composite feature vector achieved a better performance than unigram feature, which is encouraging as well as comparable to the related research. The best results were obtained from the combination of Information Gain with SVM in terms of highest accuracy.

Exploring Brand Positioning and Hotel Persona Trough Wom and Content by Text Analysis

“…The methodology (Figure 2) used the approach for text classification (Ghosh and Sanyal, 2018), it is start from data collection, text preprocessing, exploratory data analysis, and evaluation. After collecting the data, for improving the quality of raw data text in to a clean text dataset, it is necessary to do preprocessing the data (Vijayarani et al 2015) text preprocess activity are removing punctuation, digits, capitalization, extra area -white space, tokenization, and de-pluralization the terms, weed out unnecessarily popular phrases, delete a collection of specific stop words.…”

Sentiment Analysis using various Machine Learning and Deep Learning Techniques

“…Using statistical feature selection methods, Ghosh et al [11] proposed an ensemble feature selection technique to improve the performance of the sentiment analysis process. To find the best feature set, they use information gain, the Gini index, and the Chi-square method.…”

Impact of Data Balancing During Training for Best Predictions

“…The objective of the Easy Ensemble method [9,10,11,26] is to overcome the deficiency of information loss introduced in the traditional RUS method. Easy Ensemble can be considered as an unsupervised learning algorithm that explores the majority class data by using independent random sampling with replacement [8].…”