On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?

Abstract

In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded expectations in its abilities, leading to extensive considerations of its potential applications and misuse. In this work, we evaluate the influence of ChatGPT on university education, with a primary focus on computer security-oriented specialization. We gather data regarding the effectiveness and usability of this tool for completing exams, programming assignments, and term papers. We evaluate multiple levels of tool misuse, ranging from utilizing it as a consultant to simply copying its outputs. While we demonstrate how easily Chat-GPT can be used to cheat, we also discuss the potentially significant benefits to the educational system. For instance, it might be used as an aid (assistant) to discuss problems encountered while solving an assignment or to speed up the learning process. Ultimately, we discuss how computer science higher education should adapt to tools like ChatGPT.

The Content Analysis of the Lesson Plans Created by ChatGPT and Google Gemini

“…However, portfolios or other constructive assessment types were not created for the lesson plans. As it was described before, ChatGPT was found successful in most quiz-based exams (Choi et al, 2023;Kung et al, 2023;Malinka et al, 2023). Thus, suggesting a quiz can be a dilemma for chatbot-based learning environments, and, therefore, assessments need to be changed (Rudolph et al, 2023).…”

“…There have been various studies conducted in the field. Some studies assess the competence of ChatGPT in law school exams (Choi et al, 2023), medical exams (Kung et al, 2023), management (Korzynski et al, 2023), and even in coding assignments (Malinka et al, 2023). Even though some studies found that students' views on ChatGPT were innovative, compatible, and user-friendly (Castillo-González, 2023;Cotton et al, 2023;Raman et al, 2023), some studies found the weaknesses of these systems (Pavlik, 2023).…”

Comparative Study on AI-Based ChatGPT and Library Systems in Higher Education for Information Collection

“…ChatGPT can be a powerful tool for information collection, as it has the ability to gather and process vast amounts of data from a wide range of sources [16][17][18][19][20][21][22][23][24][25] . Here are some ways that ChatGPT can be used for information collection:…”

What ChatGPT means for universities: Perceptions of scholars and students

“…For example, Kasneci et al (2023) examined the potential benefits and risks of ChatGPT for education, while Willems (2023) discussed the wider ethical implications of using such models in universities. Malinka et al (2023) explored the educational impact of ChatGPT and questioned whether artificial intelligence is ready to obtain a university degree. Rudolph et al (2023) critically looked at ChatGPT and its potential impact on traditional assessments in higher education.…”