Exploiting Contextual Word Embedding of Authorship and Title of Articles for Discovering Citation Intent Classification

Abstract

The number of scientific publications is growing exponentially. Research articles cite other work for various reasons and, therefore, have been studied extensively to associate documents. It is argued that not all references carry the same level of importance. It is essential to understand the reason for citation, called citation intent or function. Text information can contribute well if new natural language processing techniques are applied to capture the context of text data. In this paper, we have used contextualized word embedding to find the numerical representation of text features. We further investigated the performance of various machine-learning techniques on the numerical representation of text. The performance of each of the classifiers was evaluated on two state-of-the-art datasets containing the text features. In the case of the unbalanced dataset, we observed that the linear Support Vector Machine (SVM) achieved 86% accuracy for the “background” class, where the training was extensive. For the rest of the classes, including “motivation,” “extension,” and “future,” the machine was trained on less than 100 records; therefore, the accuracy was only 57 to 64%. In the case of a balanced dataset, each of the classes has the same accuracy as trained on the same size of training data. Overall, SVM performed best on both of the datasets, followed by the stochastic gradient descent classifier; therefore, SVM can produce good results as text classification on top of contextual word embedding.

Intelligent Data Analytics for Diagnosing Melanoma Skin Lesions via Deep Learning in IoT System

“…Despite melanoma causes a majority of deaths related to skin cancer, the survival rates are promising if it can be diagnosed and treated correctly at the earliest stage [12][13][14][15][16][17]. Otherwise, the estimated 5-year survival rate of a patient will be greatly reduced [18][19][20][21][22][23][24][25]. As melanoma is visible on the skin at its initial phase, early detection of melanoma is a crucial issue to reduce mortality and morbidity.…”

Impact analysis of keyword extraction using contextual word embedding

“…The contextual attributes of words in sentences are extracted by applying context word embedding using BERT (Bidirectional Encoder Representations from Transformers) ( Devlin et al, 2018 ). For example, the context word embedding models ( Roman et al, 2021 ; Aljuaid et al, 2021 ) suggest a word in context or a context-dependent word vector. The BERT has shown promising results in other areas such as Sentiment classification ( Aljuaid et al, 2021 ) and Named Entity Recognition (NER) ( Gao et al, 2019 ; Haider et al, 2021 ).…”

Exploring the effectiveness of word embedding based deep learning model for improving email classification

“…Some of the applications of deep learning and word embedding are soluble N-ethylmaleimide-sensitive factor activating protein receptors identification (Quoc et al , 2019), radionics model for classifying transcriptome subtypes in glioblastoma patients (Le et al , 2021), identification of the origin of DNA replication (Do and Le, 2020), identification of word dependencies in the text (Chaturvedi et al , 2016), how to cite sources in a research paper (Roman et al , 2021b), multilabel text categorization and question answering systems (Zhao et al , 2020), multilabel text classification job in finance Maia et al (2021).…”