Educational feedback has been widely acknowledged as an effective approach to improving student learning. However, scaling effective practices can be laborious and costly, which motivated researchers to work on automated feedback systems (AFS). Inspired by the recent advancements in the pre-trained language models (e.g., ChatGPT), we posit that such models might advance the existing knowledge of textual feedback generation in AFS because of their capability to offer natural-sounding and detailed responses. Therefore, we aimed to investigate the feasibility of using ChatGPT to provide students with feedback to help them learn better. Specifically, we first examined the readability of ChatGPT-generated feedback. Then, we measured the agreement between ChatGPT and the instructor when assessing students' assignments according to the marking rubric. Finally, we used a well-known theoretical feedback framework to further investigate the effectiveness of the feedback generated by ChatGPT. Our results show that i) ChatGPT is capable of generating more detailed feedback that fluently and coherently summarizes students' performance than human instructors; ii) ChatGPT achieved high agreement with the instructor when assessing the topic of students' assignments; and iii) ChatGPT could provide feedback on the process of students completing the task, which benefits students developing learning skills.
Feedback plays a crucial role in learning. Yet, higher education continues to face challenges regarding facilitating effective feedback processes. One of the challenges is the difficulty to track how students interact with feedback and the impact of feedback on learning outcomes. Learning analytics (LA) has opened up opportunities to enhance feedback practice with a wide array of data. However, most research seeks to deliver data-driven feedback rather than understanding how students make use of feedback and how educators can use learning analytics to support students in this process. As a first step to address this gap, our study investigated educators’ views of challenges and elements of effective feedback processes in addition to their perceptions of data-driven feedback. The study found that feedback design (e.g., feedback purpose, content, and structure), educator-related factors (e.g., time constraints and resource limitations), and student-related factors (e.g., disposition, self-regulation, and sense-making) can have positive or negative impacts on the feedback process. It also highlights the need for the development of student feedback literacy. Based on the findings, we proposed ideas for an LA-based feedback tool that can be used to facilitate a dialogic feedback process and address challenges with feedback.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.