Manifold-based sparse representation for opinion mining

Abstract

What the consumer thinks about an organization's products, services, and events is a crucial performance indicator for businesses. The brief opinion pieces were quickly published on websites and social media platforms and have been analyzed by machine learning methods. The classical text feature representation methods suffer from high dimensionality, sparsity, noisy, irrelevant and redundant information. This paper focuses on how to enhance feature representation for opinion mining. Some nonlinear feature selection methods based on manifold assumption have been exploited to resolve these problems. The inherent manifold configuration was commonly ascertained through a nearest neighbor graph, whereby the neighbors in the current techniques may exhibit diverse polarities. To alleviate this burden, it is proposed to exploit both manifold assumption and sparse property as prior knowledge for opinion representation to learn intrinsic structure from data. First, the graph representation of user reviews based on the mentioned prior knowledge is learned. Then, the spectral properties of the learned graph are exploited to present data in a new feature space. The proposed algorithm is applied to four various common input features on two benchmark datasets, the Internet Movie Database (IMDB) and the Amazon review dataset. Our experiments reveal that the proposed algorithm yields considerable enhancements in terms of F-measure, accuracy, and other standard performance measures compared to the combination of state-of-the-art features with various classifiers. The highest classification accuracies of 99.15 and 91.97 are obtained in the proposed method on IMDB and Amazon using a linear SVM classifier, respectively. The impact of the parameters of the proposed algorithm is also investigated in this paper. The incorporation of a sparse manifold-based representation has led to noteworthy advancements beyond the baseline, and this success serves to validate the underlying assumptions.