Enhancing Lexical-Based Approach With External Knowledge for Vietnamese Multiple-Choice Machine Reading Comprehension

Abstract

Although Vietnamese is the 17 th most popular native-speaker language a in the world, there are not many research studies on Vietnamese machine reading comprehension (MRC), the task of understanding a text and answering questions about it. One of the reasons is because of the lack of high-quality benchmark datasets for this task. In this work, we construct a dataset which consists of 2,783 pairs of multiple-choice questions and answers based on 417 Vietnamese texts which are commonly used for teaching reading comprehension for elementary school pupils. In addition, we propose a lexicalbased MRC method that utilizes semantic similarity measures and external knowledge sources to analyze questions and extract answers from the given text. We compare the performance of the proposed model with several baseline lexical-based and neural network-based models. Our proposed method achieves 61.81% by accuracy, which is 5.51% higher than the best baseline model. We also measure human performance on our dataset and find that there is a big gap between machine-model and human performances. This indicates that significant progress can be made on this task. The dataset is freely available on our website b for research purposes.

Zero-Shot Estimation of Base Models' Weights in Ensemble of Machine Reading Comprehension Systems for Robust Generalization

“…The MRC task is a popular natural language processing task with several studies in recent years [1], [10]- [12]. Among these, some studies focus on generalization capability and transfer learning using supervised or unsupervised learning approaches across question answering (QA) or MRC models.…”

Conversational Machine Reading Comprehension for Vietnamese Healthcare Texts

“…For the Vietnamese language, the UIT-ViQuAD [10] (Wikipedia domain) and ViNewQA [15] (Health news domain) are two extractive MRC corpora for machine reading comprehension. Besides, the ViMMRC [9] is the multiple-choice reading comprehension corpus on the Vietnamese students' textbook for primary schools domain.…”

EXAMS: A Multi-subject High School Examinations Dataset for Cross-lingual and Multilingual Question Answering

“…Jing et al (2019) crowdsourced parallel paragraphs from novels in Chinese and English. A few datasets investigated multiple-choice school QA (Hardalov et al, 2019;Van Nguyena et al, 2020), albeit in a limited domain, and for lower school grades (1st-5th). Other efforts focused on building bi-lingual datasets that are similar in spirit to SQuAD (Rajpurkar et al, 2016) -extractive reading comprehension over open-domain articles.…”