Automatic question generation based on sentence structure analysis using machine learning approach

Abstract

Automatic question generation is one of the most challenging tasks of Natural Language Processing. It requires “bidirectional” language processing: first, the system has to understand the input text (Natural Language Understanding), and it then has to generate questions also in the form of text (Natural Language Generation). In this article, we introduce our framework for generating the factual questions from unstructured text in the English language. It uses a combination of traditional linguistic approaches based on sentence patterns with several machine learning methods. We first obtain lexical, syntactic and semantic information from an input text, and we then construct a hierarchical set of patterns for each sentence. The set of features is extracted from the patterns, and it is then used for automated learning of new transformation rules. Our learning process is totally data-driven because the transformation rules are obtained from a set of initial sentence–question pairs. The advantages of this approach lie in a simple expansion of new transformation rules which allows us to generate various types of questions and also in the continuous improvement of the system by reinforcement learning. The framework also includes a question evaluation module which estimates the quality of generated questions. It serves as a filter for selecting the best questions and eliminating incorrect ones or duplicates. We have performed several experiments to evaluate the correctness of generated questions, and we have also compared our system with several state-of-the-art systems. Our results indicate that the quality of generated questions outperforms the state-of-the-art systems and our questions are also comparable to questions created by humans. We have also created and published an interface with all created data sets and evaluated questions, so it is possible to follow up on our work.

Automatic generation of short-answer questions in reading comprehension using NLP and KNN

“…Figure 6 shows the flow of the computational model for extraction of simple Fig. 4 Remove characters and symbols sentences which is divided into four arrays, including NP or noun phrase, VP or verb phrase, word depth in the sentence, and also the word order in the sentence.…”

Language transfer in L2 academic writings: a dependency grammar approach

“…This calculation was performed in Python, utilizing the Stanford CoreNLP package version 4.5.5. This package was selected due to its strong performance and established reliability as an NLP tool, as evidenced by various studies ( Manning et al, 2014 ; Blšták and Rozinajová, 2022 ; Hashemi-Namin et al, 2023 ; He and Ang, 2023 ).…”

Using Syntax and Shallow Semantic Analysis for Vietnamese Question Generation

“…In 2021, Bistak et al [19] combined the traditional semantic and syntactic approaches with machine learning methods. First, the authors analyzed vocabulary, syntax, and semantic entities from the input, then proceeded to build a set of hierarchical rules for sentences.…”