Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi

Bhatnagar, Varad; Kumar, Prince; Moghili, Sairam; Bhattacharyya, Pushpak

doi:10.1007/978-3-030-73696-5_23

Cited by 15 publications

(2 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 1 shows basic approaches used for hostile post-detection. Mainly these approaches are divided into two major categories: (i) Machine Learning based (23)(24)(25)(26)(27)(28)(29)(30)(31)(32)(33)(34)(35) and (ii) Deep Learning based (5,6,(27)(28)(29)(34)(35)(36)(37)(38). Machine learning-based approach is categorized into two subparts:(i) Supervised machine learning based and (ii) Unsupervised machine learning based (27,(30)(31)(32)37).…”

Section: Introductionmentioning

confidence: 99%

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Rameshbhai,

Rana

2024

IJE

View full text Add to dashboard Cite

Hostile post on social media is a crucial issue for individuals, governments and organizations. There is a critical need for an automated system that can investigate and identify hostile posts from large-scale data. In India, Gujarati is the sixth most spoken language. In this work, we have constructed a major hostile post dataset in the Gujarati language. The data are collected from Twitter, Instagram and Facebook. Our dataset consists of 1,51,000 distinct comments having 10,000 manually annotated posts. These posts are labeled into the Hostile and Non-Hostile categories. We have used the dataset in two ways: (i) Original Gujarati Text Data and (ii) English data translated from Gujarati text. We have also checked the performance of pre-processing and without pre-processing data by removing extra symbols and substituting emoji descriptions in the text. We have conducted experiments using machine learning models based on supervised learning such as Support Vector Machine, Decision Tree, Random Forest, Gaussian Naive-Bayes, Logistic Regression, K-Nearest Neighbor and unsupervised learning based model such as k-means clustering. We have evaluated performance of these models for Bag-of-Words and TF-IDF feature extraction methods. It is observed that classification using TF-IDF features is efficient. Among these methods Logistic regression outperforms with an Accuracy of 0.68 and F1-score of 0.67. The purpose of this research is to create a benchmark dataset and provide baseline results for detecting hostile posts in Gujarati Language.

show abstract

Section: Introductionmentioning

confidence: 99%

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Rameshbhai,

Rana

2024

IJE

View full text Add to dashboard Cite

show abstract

“…According to the survey, there is an increase in the content of Indian language hostile posts on social media. The hostile post are identified in Indian languages like Hindi [2,3,[7][8][9][10], Marathi [8] [11][12][13], Bengali [9], Punjabi, Gujarati in addition to the English language [10]. Very less research work has been done in the low-resource Indian languages [6].…”

Section: Introductionmentioning

confidence: 99%

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Boda

2023

Preprint

View full text Add to dashboard Cite

Hostile post on social media is a crucial issue for individual, government, and organizations. There is a critical need for an automated system that can investigate and identify hostile posts from large-scale data. In India, Gujarati is the sixth most spoken language. In this work, we have constructed a major hostile post dataset in the Gujarati language. The data are collected from Twitter, Instagram, and Facebook. Our dataset consists of 1,51,000 distinct tweets having 10,000 manually annotated posts. These posts are labeled into the Hostile and Non-Hostile categories. We have used the dataset in two ways: (i) Original Gujarati Text Data and (ii) Gujarati Data translated into English. We have also checked the performance of pre-processing and without pre-processing data by removing extra symbols and substituting emoji descriptions in the text. Finally, we have conducted experiments using machine learning models based on supervised learning such as Support Vector Machine, Decision Tree, Random Forest, Gaussian Naive-Bayes, Logistic Regression, K-Nearest Neighbor and unsupervised learning based model such as k-means clustering. We have evaluated performance of these models for Bag-of-Words and TF-IDF feature extraction methods. It is observed that classification using TF-IDF features is efficient. Among these methods Logistic regression outperforms with an Accuracy of 0.68 and F1-score of 0.67.

show abstract

Overview of CONSTRAINT 2021 Shared Tasks: Detecting English COVID-19 Fake News and Hindi Hostile Posts

Patwa

Bhardwaj

Guptha

et al. 2021

Communications in Computer and Information Science

View full text Add to dashboard Cite

Fake news, hostility, defamation are some of the biggest problems faced in social media. We present the findings of the shared tasks (https://constraint-shared-task-2021.github.io/) conducted at the CONSTRAINT Workshop at AAAI 2021. The shared tasks are 'COVID19 Fake News Detection in English' and 'Hostile Post Detection in Hindi'. The tasks attracted 166 and 44 team submissions respectively. The most successful models were BERT or its variations.

show abstract

Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi

Cited by 15 publications

References 17 publications

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Investigating Hostile Post Detection in Gujarati: A Machine Learning Approach

Overview of CONSTRAINT 2021 Shared Tasks: Detecting English COVID-19 Fake News and Hindi Hostile Posts

Contact Info

Product

Resources

About