Relation Extraction From Biomedical and Clinical Text: Unified Multitask Learning Framework

Abstract

To minimize the accelerating amount of time invested on the biomedical literature search, numerous approaches for automated knowledge extraction have been proposed. Relation extraction is one such task where semantic relations between the entities are identified from the free text. In the biomedical domain, extraction of regulatory pathways, metabolic processes, adverse drug reaction or disease models necessitates knowledge from the individual relations, for example, physical or regulatory interactions between genes, proteins, drugs, chemical, disease or phenotype. Results: In this paper, we study the relation extraction task from three major biomedical and clinical tasks, namely drug-drug interaction, protein-protein interaction, and medical concept relation extraction. Towards this, we model the relation extraction problem in a multi-task learning (MTL) framework, and introduce for the first time the concept of structured self-attentive network complemented with the adversarial learning approach for the prediction of relationships from the biomedical and clinical text. The fundamental notion of MTL is to simultaneously learn multiple problems together by utilizing the concepts of the shared representation. Additionally, we also generate the highly efficient single task model which exploits the shortest dependency path embedding learned over the attentive gated recurrent unit to compare our proposed MTL models. The framework we propose significantly improves over all the baselines (deep learning techniques) and single-task models for predicting the relationships, without compromising on the performance of all the tasks.

Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Framework

“…Our proposed approach to identify the depressive symptoms, is assisted by the Bidirectional Representation from Transformers (BERT) and multi-task learning (Yadav et al, 2020a) with soft-parameter sharing. This section describes the proposed methodology for identifying the depression symptoms from user tweets.…”

Multilevel Entity-Informed Business Relation Extraction

“…The second configuration is designed to deal with data imbalance (cf. Table 1), following recent studies that show that jointly learning common characteristics shared across multiple tasks can have a strong impact on RE performances [34,29]. To this end, we jointly train two classifiers using multitask objectives.…”

Medical Knowledge-enriched Textual Entailment Framework

“…Majority of the systems developed for the TE task adopts the multi-task learning (MTL) framework (Zhu et al, 2019;Bhaskar et al, 2019;Kumar et al, 2019;Xu et al, 2019), ensemble method (Sharma and Roychowdhury, 2019), and transfer learning (Bhaskar et al, 2019) for achieving better accuracy. Xu et al (2019) employed the MTL approach Yadav et al, 2018;Yadav et al, 2019;Yadav et al, 2020) in TE task to learn from the auxiliary tasks of question answering (QA) and NLI. The best performing system at MedQA 2019-RQE shared task (Zhu et al, 2019) utilized the MTL approach to learn from intermediate NLI task.…”