CNN-BERT for measuring agreement between argument in online discussion

Abstract

Purpose With the rise of online discussion and argument mining, methods that are able to analyze arguments become increasingly important. A recent study proposed the usage of agreement between arguments to represent both stance polarity and intensity, two important aspects in analyzing arguments. However, this study primarily focused on finetuning bidirectional encoder representations from transformer (BERT) model. The purpose of this paper is to propose convolutional neural network (CNN)-BERT architecture to improve the previous method. Design/methodology/approach The used CNN-BERT architecture in this paper directly uses the generated hidden representation from BERT. This allows for better use of the pretrained BERT model and makes finetuning the pretrained BERT model optional. The authors then compared the CNN-BERT architecture with the method proposed in the previous study (BERT and Siamese-BERT). Findings Experiment results demonstrate that the proposed CNN-BERT is able to achieve a 71.87% accuracy in measuring agreement between arguments. Compared to the previous study that achieve an accuracy of 68.58%, the CNN-BERT architecture was able to increase the accuracy by 3.29%. The CNN-BERT architecture is also able to achieve a similar result even without further pretraining the BERT model. Originality/value The principal originality of this paper is the proposition of using CNN-BERT to better use the pretrained BERT model for measuring agreement between arguments. The proposed method is able to improve performance and also able to achieve a similar result without further training the BERT model. This allows separation of the BERT model from the CNN classifier, which significantly reduces the model size and allows the usage of the same pretrained BERT model for other problems that also did not need to finetune their BERT model.

Mask-guided BERT for Few Shot Text Classification

“…CPFT is a contrastive framework including contrastive pre-trained and contrastive fine-tuning. • CNN-BERT [61] applies CNN to classify text based on features outputted from the BERT model. • SN-FT [50].…”

Guest editorial: Special issue on “current topics of knowledge graphs and semantic web”

“…The selected papers are on many different topics, such as process mining application on patient waiting time (Dogan, 2022); maintenance of RDB2RDF in enterprise knowledge graphs (Vidal et al , 2022); deep neural network-based approach for fake news detection (Katariya et al , 2022); ranking community detection algorithms for complex social networks (Rani and Kumar, 2022); agglomerative clustering enhanced GA for optimal seed selection (Mehta, 2022); CNN-BERT for measuring agreement (Harly and Girsang, 2022); hotel room personalization via ontology and rule-based reasoning (Ojino et al , 2022); fake news detection on Twitter [1]; semiautomated process for generating knowledge graphs (Keshan et al , 2022); From ontology to knowledge graph with agile methods (DeBellis and Dutta, 2022); keyword-based faceted search interface for Knowledge Graph construction and exploration (Sellami and Zarour, 2022); and finally, applied personal profile ontology for personnel appraisals (Usip et al , 2022).…”