A Corpus Based Approach to Build Arabic Sentiment Lexicon

Abstract

Sentiment analysis is an application of artificial intelligence that determines the sentiment associated sentiment with a piece of text. It provides an easy alternative to a brand or company to receive customers' opinions about its products through user generated contents such as social media posts. Training a machine learning model for sentiment analysis requires the availability of resources such as labeled corpora and sentiment lexicons. While such resources are easily available for English, it is hard to find them for other languages such as Arabic. The aim of this research is to build an Arabic sentiment lexicon using a corpus-based approach. Sentiment scores were propagated from a small, manually labeled, seed list to other terms in a term co-occurrence graph. To achieve this, we proposed a graph propagation algorithm and compared different similarity measures. The lexicon was evaluated using a manually annotated list of terms. The use of similarity measures depends on the fact that the words that are appearing in the same context will have similar polarity. The main contribution of the work comes from the empirical evaluation of different similarity to assign the best sentiment scores to terms in the co-occurrence graph.

Lexicon dataset for the Hausa language

“…In this study, we used Hausa words provided in [1] . Creating a sentiment lexicon manually by annotating words with their respective sentiment is a scalable solution for small corpora [8] . Consequently, an automated approach that employs a corpus or dictionary is a more desirable alternative [8] .…”

Sentiment Analysis on Twitter Data: Comparative Study on Different Approaches

“…The pre-calculated polarity is used to score a document by aggregating the polarity of all the words in the document. The sentiment lexicon is an essential instrument in the field of tweeter classification [14].…”

ADPBC: Arabic Dependency Parsing Based Corpora for Information Extraction

“…Alsolamy et al built manually corpus-based sentiment lexicon for Arabic opinion Mining [7]. Furthermore, Gamal et al constructed a benchmark dataset of Arabic Dialect Tweets [14].…”

“…However, they did not include dependency except the treebank in The Linguistic Data Consortium (LDC) which available at [6] and not free available there has another corpus. However, it does not include dependency and is used for a social subject like sentiment and classification [7]. Wherefore, this paper presents a new corpus includes mainly on the dependency parsing.…”