Conversation-Based Assessments: Real-Time Assessment and Feedback

Abstract

In recent years, substantial progress has been made in the application of technology for learning environments to support interaction and learning. However, current digital assessments still need to be modified to measure student learning in more engaging and effective ways. Conversation-based assessment (CBA) advances the conventional digital assessments by creating a conversational environment between test-takers and agents where each test-taker receives feedback for their correct responses and hints or follow-up questions for their incorrect responses through a natural conversation. This work provides a summary of CBAs by discussing their advantages and differences from conventional digital assessments.

Artificial intelligence on the advance to enhance educational assessment: Scientific clickbait or genuine gamechanger?

“…Contemporary assessments, however, put us in a different position. By enabling us to create large or even open spaces for test takers to navigate through and interact with stimulus and learning materials, they allow for more immersive presentation modes and authentic settings; for example, with conversation‐based assessment (Yildirim Erbasli, 2022). Moreover, they can incorporate technologies that support the automatic processing of constructed responses (Smith et al, 2021) and enable capturing of log data on test takers' interactions (Goldhammer et al, 2021).…”

Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

“…Four elements must be considered to design, develop, and deploy a conversational agent that aims to promote student learning: (1) the type of conversational agent; (2) the subject being assessed; (3) the learner's knowledge level; and (4) dialogue strategy sophistication (Yildirim-Erbasli, 2022; Yildirim-Erbasli & Bulut, 2021). The first element, the type of conversational agent, refers to the technologies used to create the conversational agent, such as chatbots or animated agents.…”