Improving Arabic Cognitive Distortion Classification in Twitter using BERTopic

Abstract

Social media platforms allow users to share thoughts, experiences, and beliefs. These platforms represent a rich resource for natural language processing techniques to make inferences in the context of cognitive psychology. Some inaccurate and biased thinking patterns are defined as cognitive distortions. Detecting these distortions helps users restructure how to perceive thoughts in a healthier way. This paper proposed a machine learning-based approach to improve cognitive distortions' classification of the Arabic content over Twitter. One of the challenges that face this task is the text shortness, which results in a sparsity of co-occurrence patterns and a lack of context information (semantic features). The proposed approach enriches text representation by defining the latent topics within tweets. Although classification is a supervised learning concept, the enrichment step uses unsupervised learning. The proposed algorithm utilizes a transformer-based topic modeling (BERTopic). It employs two types of document representations and performs averaging and concatenation to produce contextual topic embeddings. A comparative analysis of F1-score, precision, recall, and accuracy is presented. The experimental results demonstrate that our enriched representation outperformed the baseline models by different rates. These encouraging results suggest that using latent topic distribution, obtained from the BERTopic technique, can improve the classifier's ability to distinguish between different CD categories.

Tashaphyne: A Python package for Arabic Light Stemming

“…Shoukry & Rafea, 2012), and tweet classification (E. Abozinadah, 2017;E. A. Abozinadah & Jones Jr, 2016;F. Alhaj et al, 2022;Brahimi et al, 2016;Mourad et al, 2017).…”

Public Response to the Legalization of The Criminal Code Bill with Twitter Data Sentiment Analysis

“…This will help in mitigating the public's adverse reaction. Mitigation of this rejection will be better if there is a grouping of tweets based on topic, as in Research [36]. In this study, we used BERTaopic to classify the tweets.…”

Marketing Insights from Reviews Using Topic Modeling with BERTopic and Deep Clustering Network

“…Study [16] introduced a supervised topic modeling approach, Hierarchical Dirichlet Process-based Inverse Regres-sion (HDP-IR), which is based on LDA and Inverse Regression, to extend to the approach's use in predictive models for variables such as customer sentiment, product quality, and affect. In study [17], BERTopic was used to extract topic probability distributions from topic modeling results from a Twitter dataset. These distributions were then combined with vector representations of the original data for use in a classification model, which demonstrated a better performance than a basic classification model.…”