PerAnSel:  A  Novel Deep Neural Network-Based System for Persian Question Answering

Abstract

Question answering (QA) systems have attracted considerable attention in recent years. They receive the user’s questions in natural language and respond to them with precise answers. Most of the works on QA were initially proposed for the English language, but some research studies have recently been performed on non-English languages. Answer selection (AS) is a critical component in QA systems. To the best of our knowledge, there is no research on AS for the Persian language. Persian is a (1) free word order, (2) right-to-left, (3) morphologically rich, and (4) low-resource language. Deep learning (DL) techniques have shown promising accuracy in AS. Although DL performs very well on QA, it requires a considerable amount of annotated data for training. Many annotated datasets have been built for the AS task; most of them are exclusively in English. In order to address the need for a high-quality AS dataset in the Persian language, we present PASD; the first large-scale native AS dataset for the Persian language. To show the quality of PASD, we employed it to train state-of-the-art QA systems. We also present PerAnSel: a novel deep neural network-based system for Persian question answering. Since the Persian language is a free word-order language, in PerAnSel, we parallelize a sequential method and a transformer-based method to handle various orders in the Persian language. We then evaluate PerAnSel on three datasets: PASD, PerCQA, and WikiFA. The experimental results indicate strong performance on the Persian datasets beating state-of-the-art answer selection methods by 10.66 % on PASD, 8.42 % on PerCQA, and 3.08 % on WikiFA datasets in terms of MRR.

Design and Research of Artificial Intelligence in Multimedia Intelligent Question-Answering System and Self-Test System

“…Later, under the leadership of Wang Dazhong of Tsinghua University, Tsin-ghua University took the lead in launching online postgraduate refresher courses. In the same year, Hunan University also cooperated with China Telecom to establish online University (Mozafari et al) [13]. In September 1998, the Ministry of Education officially approved Tsinghua University, Beijing University of Posts and Telecommunications, Zhejiang University, and Hunan University as the first batch of national modern distance education pilot colleges.…”