Detection and moderation of detrimental content on social media platforms: current status and future directions

Abstract

Social Media has become a vital component of every individual's life in society opening a preferred spectrum of virtual communication which provides an individual with a freedom to express their views and thoughts. While virtual communication through social media platforms is highly desirable and has become an inevitable component, the dark side of social media is observed in form of detrimental/objectionable content. The reported detrimental contents are fake news, rumors, hate speech, aggressive, and cyberbullying which raise up as a major concern in the society. Such detrimental content is affecting person’s mental health and also resulted in loss which cannot be always recovered. So, detecting and moderating such content is a prime need of time. All social media platforms including Facebook, Twitter, and YouTube have made huge investments and also framed policies to detect and moderate such detrimental content. It is of paramount importance in the first place to detect such content. After successful detection, it should be moderated. With an overflowing increase in detrimental content on social media platforms, the current manual method to identify such content will never be enough. Manual and semi-automated moderation methods have reported limited success. A fully automated detection and moderation is a need of time to come up with the alarming detrimental content on social media. Artificial Intelligence (AI) has reached across all sectors and provided solutions to almost all problems, social media content detection and moderation is not an exception. So, AI-based methods like Natural Language Processing (NLP) with Machine Learning (ML) algorithms and Deep Neural Networks is rigorously deployed for detection and moderation of detrimental content on social media platforms. While detection of such content has been receiving good attention in the research community, moderation has received less attention. This research study spans into three parts wherein the first part emphasizes on the methods to detect the detrimental components using NLP. The second section describes about methods to moderate such content. The third part summarizes all observations to provide identified research gaps, unreported problems and provide research directions.

Offensive Language Detection on Online Social Networks using Hybrid Deep Learning Architecture

“…This attribute is crucial in deciphering offensive content embedded in conversational threads or sentences reliant on context for interpretation [46]. Next study [47] on using LSTMs for offensive language detection in Twitter data underscores the model's success.…”

The Quality of MitraClip™ Content on YouTube

“…Additionally, due to the commercial interests of YouTube, there are numerous difficulties in ensuring adequate quality content moderation [ 33 ]. Therefore, it is justified to start with what can be controlled.…”

Mapping automatic social media information disorder. The role of bots and AI in spreading misleading information in society

“…205 [254] Rising tides or rising stars? : Dynamics of shared attention on twitter during media events 206 [255] Misleading health-related information promoted through video-based social media: Anorexia on youtube 209 [258] Utilising online eye-tracking to discern the impacts of cultural backgrounds on fake and real news decision-making 210 [259] Top 100 #PCOS influencers: Understanding who, why and how online content for PCOS is influenced 211 [260] Twitter Trends for Celiac Disease and the Gluten-Free Diet: Cross-sectional Descriptive Analysis 214 [263] The influence of fake news on face-trait learning 215 [264] COVID-Related Misinformation Migration to BitChute and Odysee 216 [265] Sending News Back Home: Misinformation Lost in Transnational Social Networks 217 [266] Public Opinion Manipulation on Social Media: Social Network Analysis of Twitter Bots during the COVID-19 Pandemic 218 [267] Organization and evolution of the UK far-right network on Telegram 219 [268] Predictive modeling for suspicious content identification on Twitter 220 [269] Detection and moderation of detrimental content on social media platforms: current status and future directions 221 [270] Cross-platform information spread during the January 6th capitol riots 222 [271] Combating multimodal fake news on social media: methods, datasets, and future perspective 223 [272] In. Tackling fake news in socially mediated public spheres: A comparison of Weibo and WeChat 249 [298] The Networked Context of COVID-19 Misinformation: Informational Homogeneity on YouTube at the Beginning of the Pandemic 250 [299] Twelve tips to make successful medical infographics 251 [300] TClustVID: A novel machine learning classification model to investigate topics and sentiment in COVID-19 tweets 252 [301] Cognitive and affective responses to political disinformation in Facebook 253 [302] Experience: Managing misinformation in social media-insights for policymakers from Twitter analytics 254 [303] Hepatitis E vaccine in China: Public health professional perspectives on vaccine promotion and strategies for control (Continued )…”