The Effect of Preprocessing on Arabic Document Categorization

Abstract

Abstract:Preprocessing is one of the main components in a conventional document categorization (DC) framework. This paper aims to highlight the effect of preprocessing tasks on the efficiency of the Arabic DC system. In this study, three classification techniques are used, namely, naive Bayes (NB), k-nearest neighbor (KNN), and support vector machine (SVM). Experimental analysis on Arabic datasets reveals that preprocessing techniques have a significant impact on the classification accuracy, especially with complicated morphological structure of the Arabic language. Choosing appropriate combinations of preprocessing tasks provides significant improvement on the accuracy of document categorization depending on the feature size and classification techniques. Findings of this study show that the SVM technique has outperformed the KNN and NB techniques. The SVM technique achieved 96.74% micro-F1 value by using the combination of normalization and stemming as preprocessing tasks.

Untitled

“…Moreover, Hmeidi et al [12] studied the influence of raw text, khoja root-based stemmer and light stemming of Arabic text documents based on standard classifiers, such as NB, SVM, KNN, J48 and Decision Table classifiers. The results exhibited that the SVM and NB classifiers with light stemming provides better classification accuracy than other classifiers.The same conclusion was drawn up by Al-Badarneh [13] and Ayedh et al [14] by using various pre-processing methods. Additionally, Al-Molegi et al [15] and Khreisat [16] have proposed an approach to classify Arabic text documents based on the combination of N-grams with some similarity measures, including Manhattan, Euclidean distances and Dice.…”

Arabic Poetry Authorship Attribution using Machine Learning Techniques

“…Different samples of such insignificant words are pronouns, articles, conjunctions ( ‫ه‬ ، ‫ه‬ ، ‫,)ه‬ prepositions ‫ل،(‬ ، ، ، ، ‫ا‬ ، ), demonstratives, ( ‫او‬ ‫ء،‬ ‫ا،ه‬ ‫)ه‬ and interrogatives ( ، ‫. )ا‬ Besides, Arabic-specific nouns stating place and time ‫ق،(‬ ، ) and symbols (@, #, &, %, *) are considered insignificant and can be removed (Ayedh et al, 2016). (2012) was used and updated by preventing the removal of certain stop-words in documents.…”

“…2. Finally, the character that takes the symbol "ّ " can be replaced by two duplicate characters of the same character, as these characters are used to extract the Arabic roots in order to eliminate them for preventing them from affecting the meaning of the words (Ayedh et al, 2016).…”

“…The reliance here implied that the higher estimation of n was more compelling when the span of the corpus was substantial. Word-level n-grams perform better with a massive dataset (Ayedh et al, 2016).…”

Evaluation on knowledge extraction and machine learning in resolving Malay word ambiguity

“…Removing all the stop words, symbols and stemming to the user queries before tokenization process take in place [14]. Tokenization will produces queries catchphrases in view of significance idea words.…”