Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification

Zhao, Pinlong; Hou, Linlin; Wu, Ou

doi:10.1016/j.knosys.2019.105443

Cited by 147 publications

(59 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are also some works that have successfully applied GCNs in sentiment classification [15,31]. In [32], Zhao et al propose a novel aspect-level sentiment classification model which can effectively capture the sentiment dependencies between multiple aspects in one sentence. They consider the sentiment dependencies between aspects in one sentence for the first time.…”

Section: Application Of Graph Convolution Network In Nlpmentioning

confidence: 99%

Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks

Xiao

Chen

et al. 2020

Applied Sciences

View full text Add to dashboard Cite

Targeted sentiment classification aims to predict the emotional trend of a specific goal. Currently, most methods (e.g., recurrent neural networks and convolutional neural networks combined with an attention mechanism) are not able to fully capture the semantic information of the context and they also lack a mechanism to explain the relevant syntactical constraints and long-range word dependencies. Therefore, syntactically irrelevant context words may mistakenly be recognized as clues to predict the target sentiment. To tackle these problems, this paper considers that the semantic information, syntactic information, and their interaction information are very crucial to targeted sentiment analysis, and propose an attentional-encoding-based graph convolutional network (AEGCN) model. Our proposed model is mainly composed of multi-head attention and an improved graph convolutional network built over the dependency tree of a sentence. Pre-trained BERT is applied to this task, and new state-of-art performance is achieved. Experiments on five datasets show the effectiveness of the model proposed in this paper compared with a series of the latest models.

show abstract

Section: Application Of Graph Convolution Network In Nlpmentioning

confidence: 99%

Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks

Xiao

Chen

et al. 2020

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Sun et al [52] propagated both contextual and dependency information from opinion words to aspect words, offering discriminative properties for ALSC. Zhao et al [53] attempted to learn the sentiment de- The collection of context and target hidden words.…”

Section: A Aspect-level Sentiment Classificationmentioning

confidence: 99%

Syntactic Edge-Enhanced Graph Convolutional Networks for Aspect-Level Sentiment Classification With Interactive Attention

Xiao

Zhou

2020

IEEE Access

View full text Add to dashboard Cite

Aspect-level sentiment classification is a hot research topic in natural language processing (NLP). One of the key challenges is that how to develop effective algorithms to model the relationships between aspects and opinion words appeared in a sentence. Among the various methods proposed in the literature, the graph convolutional networks (GCNs) achieve the promising results due to their good ability to capture the long distance between the aspects and the opinion words. However, the existing methods cannot effectively leverage the edge information of dependency parsing tree, resulting in the sub-optimal results. In this article, we propose a syntactic edge-enhanced graph convolutional network (ASEGCN) for aspect-level sentiment classification with interactive attention. Our proposed method can effectively learn better representations of aspects and the opinion words by considering the different types of neighborhoods with the edge constraint. To evaluate the effectiveness of our proposed method, we conduct the experiments on five standard sentiment classification results. Our results demonstrate that our proposed method obtains the better performance than the state-of-the-art models on four datasets, and achieves a comparative performance on Rest16.

show abstract

“…• SDGCN-BERT [44]. A model that uses GCN to capture the sentiment dependencies between multi-aspects in one sentence and also use BERT as feature representations.…”

Section: E Experiments 5: Comparisons With Related Workmentioning

confidence: 99%

Enhancing Aspect-Based Sentiment Analysis With Capsule Network

Luo

2020

IEEE Access

View full text Add to dashboard Cite

Existing feature-based neural approaches for aspect-based sentiment analysis (ABSA) try to improve their performance with pre-trained word embeddings and by modeling the relations between the text sequence and the aspect (or category), thus heavily depending on the quality of word embeddings and task-specific architectures. Although the recently pre-trained language models, i.e., BERT and XLNet, have achieved state-of-the-art performance in a variety of natural language processing (NLP) tasks, they still subject to the aspect-specific, local feature-aware and task-agnostic challenges. To address these challenges, this paper proposes a XLNet and capsule network based model XLNetCN for ABSA. XLNetCN firstly constructs auxiliary sentence to model the sequence-aspect relation and generate global aspect-specific representations, which enables to enhance aspect-awareness and ensure the full pre-training of XLNet for improving task-agnostic capability. After that, XLNetCN also employs a capsule network with the dynamic routing algorithm to extract the local and spatial hierarchical relations of the text sequence, and yield its local feature representations, which are then merged with the global aspect-related representations for downstream classification via a softmax classifier. Experimental results show that XLNetCN outperforms significantly than the classical BERT, XLNet and traditional feature-based approaches on the two benchmark datasets of SemEval 2014, Laptop and Restaurant, and achieves new state-of-the-art results. INDEX TERMS Aspect-based sentiment analysis, natural language processing, text analysis, deep learning, neural network.

show abstract

Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification

Cited by 147 publications

References 36 publications

Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks

Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks

Syntactic Edge-Enhanced Graph Convolutional Networks for Aspect-Level Sentiment Classification With Interactive Attention

Enhancing Aspect-Based Sentiment Analysis With Capsule Network

Contact Info

Product

Resources

About