Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education

Lee, Unggi; Jung, Haewon; Jeon, Younghoon; Sohn, Younghoon; Hwang, Wonhee; Moon, Jewoong; Kim, Hyeoncheol

doi:10.1007/s10639-023-12249-8

Cited by 20 publications

(8 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Students also responded that they would like to see the proposed method implemented in more classes, which advocates for the effectiveness of the proposed solution. The finding that the introduction of the AI tool was well received by students is again in line with the exploratory experiments from the background section that also reported the good acceptance of novelty approaches in the classroom [25,49,50].…”

Section: Student's Engagement With Ai-tutorssupporting

confidence: 75%

“…The first is automatic question generation (AQG), where the LLM is prompted to generate meaningful problems for students to solve. AQG has become a necessity in large-scale courses, and while the long-term effectiveness of LLM-generated questions remains unclear, exploratory experiments on the teaching of English [25], mathematics [49], and data science [50] have been positively received by educators and human experts. The second category is automating the correction of free-format answers.…”

Section: The Use-cases Of Generative Ai In Educationmentioning

confidence: 99%

“…The launch of OpenAI's ChatGPT in late 2022 marked a significant milestone in the field of artificial intelligence, as its ability to generate coherent, human-like text across a wide range of topics set the stage for discussion among educators and researchers of how generative AI can be integrated into educational settings [23,24]. In particular, researchers have argued that the integration of large language models (LLMs) can contribute to a plethora of pedagogical applications ranging from automatic question generation (AGQ) [25] to the creation of more personalized learning readings and materials [26], with a possible end goal being the creation of fully personalized learning experiences taught by an avatar of a real or fictional character [16]. This aligns with Bill Gates' assessment that the future of education will rely on a personalized approach.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Generative AI for Customizable Learning Experiences

Pesovski,

Santos,

Henriques

et al. 2024

Sustainability

View full text Add to dashboard Cite

The introduction of accessible generative artificial intelligence opens promising opportunities for the implementation of personalized learning methods in any educational environment. Personalized learning has been conceptualized for a long time, but it has only recently become realistic and truly achievable. In this paper, we propose an affordable and sustainable approach toward personalizing learning materials as part of the complete educational process. We have created a tool within a pre-existing learning management system at a software engineering college that automatically generates learning materials based on the learning outcomes provided by the professor for a particular class. The learning materials were composed in three distinct styles, the initial one being the traditional professor style and the other two variations adopting a pop-culture influence, namely Batman and Wednesday Addams. Each lesson, besides being delivered in three different formats, contained automatically generated multiple-choice questions that students could use to check their progress. This paper contains complete instructions for developing such a tool with the help of large language models using OpenAI’s API and an analysis of the preliminary experiment of its usage performed with the help of 20 college students studying software engineering at a European university. Participation in the study was optional and on voluntary basis. Each student’s tool usage was quantified, and two questionnaires were conducted: one immediately after subject completion and another 6 months later to assess both immediate and long-term effects, perceptions, and preferences. The results indicate that students found the multiple variants of the learning materials really engaging. While predominantly utilizing the traditional variant of the learning materials, they found this approach inspiring, would recommend it to other students, and would like to see it more in classes. The most popular feature were the automatically generated quiz-style tests that they used to assess their understanding. Preliminary evidence suggests that the use of various versions of learning materials leads to an increase in students’ study time, especially for students who have not mastered the topic otherwise. The study’s small sample size of 20 students restricts its ability to generalize its findings, but its results provide useful early insights and lay the groundwork for future research on AI-supported educational strategies.

show abstract

Section: Student's Engagement With Ai-tutorssupporting

confidence: 75%

Section: The Use-cases Of Generative Ai In Educationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Generative AI for Customizable Learning Experiences

Pesovski,

Santos,

Henriques

et al. 2024

Sustainability

View full text Add to dashboard Cite

show abstract

“…The art of prompt engineering lies in its ability to Walter Int J Educ Technol High Educ (2024) 21:15 transform AI from a mere repository of information into an interactive tool that stimulates deeper learning and understanding (cf. Lee et al, 2023). The relevance of prompt engineering in education cannot be overstated.…”

Section: Prompt Engineering As a Pedagogical Toolmentioning

confidence: 99%

Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education

Walter

2024

Int J Educ Technol High Educ

View full text Add to dashboard Cite

The present discussion examines the transformative impact of Artificial Intelligence (AI) in educational settings, focusing on the necessity for AI literacy, prompt engineering proficiency, and enhanced critical thinking skills. The introduction of AI into education marks a significant departure from conventional teaching methods, offering personalized learning and support for diverse educational requirements, including students with special needs. However, this integration presents challenges, including the need for comprehensive educator training and curriculum adaptation to align with societal structures. AI literacy is identified as crucial, encompassing an understanding of AI technologies and their broader societal impacts. Prompt engineering is highlighted as a key skill for eliciting specific responses from AI systems, thereby enriching educational experiences and promoting critical thinking. There is detailed analysis of strategies for embedding these skills within educational curricula and pedagogical practices. This is discussed through a case-study based on a Swiss university and a narrative literature review, followed by practical suggestions of how to implement AI in the classroom.

show abstract

“…Building on previous research (Lee et al, 2023a), we utilize GPT-4's advanced capabilities for our evaluation purposes. GPT-4 receives inputs comprising the fragmented evaluations of the video.…”

Section: Application Architecturementioning

confidence: 99%

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

Lee¹

2022

Korea Assoc Edu Consulting Coaching

View full text Add to dashboard Cite

The purpose of this study was to suggest implications for the curriculum of the graduate school of department of education consulting and education consulting major in South Korea through the analysis of the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea. In this study, in order to investigate the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea, the keywords were limited to ‘education consulting’, and data were collected in the order of Daehakalrimi(https://www.academyinfo.go.kr), Naver and Google keyword search, and each university and graduate school’s website. As a result of the analysis of the collected data, it was confirmed that three master’s and doctoral programs in general graduate schools in South Korea, and nine master’s programs in graduate schools of education in South Korea were in operation, and the curriculum of the graduate school of department of education consulting and education consulting major in South Korea were organized based on the faculty members’s major and expertise according to new department and major or name changed department and major. This study is the first study to analysis the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea and is meaningful as a basic study of the development of education consulting as disciplines.

show abstract

Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education

Cited by 20 publications

References 33 publications

Generative AI for Customizable Learning Experiences

Generative AI for Customizable Learning Experiences

Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

Contact Info

Product

Resources

About