Entity Relationship Extraction Based on a Multi-Neural Network Cooperation Model

Abstract

Entity relation extraction mainly extracts relations from text, which is one of the important tasks of natural language processing. At present, some special fields have insufficient data; for example, agriculture, the metallurgical industry, etc. There is a lack of an effective model for entity relationship recognition under the condition of insufficient data. Inspired by this, we constructed a suitable small balanced data set and proposed a multi-neural network collaborative model (RBF, Roberta–Bidirectional Gated Recurrent Unit–Fully Connected). In addition, we also optimized the proposed model. This model uses the Roberta model as the coding layer, which is used to extract the word-level features of the text. This model uses BiGRU (Bidirectional Gated Recurrent Unit)–FC (Fully Connected) as the decoding layer, which is used to obtain the optimal relationship of the text. To further improve the effect, the input layer is optimized by feature fusion, and the learning rate is optimized by the cosine annealing algorithm. The experimental results show that, using the small balanced data set, the F1 value of the RBF model proposed in the paper is 25.9% higher than the traditional Word2vec–BiGRU–FC model. It is 18.6% higher than the recent Bert–BiLSTM (Bidirectional Long Short Term Memory)–FC model. The experimental results show that our model is effective.

Knowledge Base Question Answering via Semantic Analysis

“…This paper uses NLPCC2016-KBQA to carry out experimental verification on the two key models of the question entity recognition model and attribute similarity judgment model in the method model. In question entity recognition, the public data set NLPCC2016-KBQA was used to compare the traditional BiLSTM-CRF entity recognition model with the proposed BERT-BiLSTM-CRF question entity recognition model and its variants, including introducing a variant of the BERT model, Roberta [43], into the baseline model for comparison [44]. The experimental results are shown in Table 5.…”