Evaluation of Naïve Bayes Classification in Arabic Short Text Classification

Abstract

In the last few years, and due to the vast widespread of social media applications, texts have become more important and get more attention. Since texts, in general, are carrying a lot of information that can be extracted and analyzed. Several researchers have done significant works in text classification. Within different scripts such as English and other western languages, several challenges and obstacles have been addressed with such a field of research. Regarding the Arabic language, the process is different from other vital languages since Arabic is considered an orthographic language that depends on the word shape. It is not easy to apply the standard text preprocessing techniques since it affects the word meaning. This paper evaluates Arabic short text classification using three standard Naïve Bayes classifiers. In our method, we classify the thesis and dissertations using their titles to perform the classification process. The collected dataset is collected from different repositories by using standard scrapping techniques. Our method classifies the document based on their titles to be placed in the desired specialization. Several preprocessing techniques have been applied, such as (punctuation removal, stop words removal, and space vectorization). For feature extraction, we adopt the TF-IDF method. We implemented three types of Naïve Bayes classifiers which are (Multinomial Naïve Bayes, Complemented Naïve Bayes, and Gaussian Naïve Bayes). The study results showed that Complemented Naïve Bayes Classifier proposed the best performance with (0.84) of accuracy for the testing phase. The results of the study are promising to be applied with different short text classifications.

Evaluation of Different Stemming Techniques on Arabic Customer Reviews

“…In [11] and [20], a classification of Arabic theses and dissertation titles was evaluated using standard classifiers. The findings showed that the sensitivity and complexity of the Arabic language make it extremely difficult to classify Arabic short texts.…”

Detecting Arabic Misinformation Using an Attention Mechanism-Based Model

“…Eliminating noise from the dataset can significantly improve the performance of a neural network. However, when it comes to Arabic language, which is an orthographic language that relies on the word's form, applying preprocessing techniques becomes challenging without altering the meaning of words [15,16]. In our work, preprocessing starts with cleansing data in datasets by eliminating irrelevant data that are worthless for misinformation detection and that could be considered noisy.…”

Analisis Sentimen Wisatawan Melalui Data Ulasan Candi Borobudur di Tripadvisor Menggunakan Algoritma Naïve Bayes Classifier

“…Adapun, Harliana & Putra menekankan pada akurasi tertinggi yang dihasilkan oleh Naïve Bayes Classifier dalam berbagai pengujian data menggunakan confusion matrix dan 10-fold cross validation, terjadi di fold ke-10 [11]. Selain itu, Ibrahim et al menunjukkan bahwa Naïve Bayes Classifier dapat digunakan dalam klasifikasi teks, dimana tahap pre-processing diperlukan untuk ekstrasi data berdasarkan Term Frequency-Inverse Document Frequency (TF-IDF) agar memperoleh nilai akurasi yang tinggi [12]. Banchhor & Srinivasu menegaskan bahwa tahapan pre-processing data diperlukan untuk mempermudah proses kalkukasi, mempertimbangkan kompleksitas big data yang memungkinkan adanya format data yang terstruktur dan tidak terstruktur [13].…”