2d. Beitragsmodell (arXiv)

Tobschall, Esther; Söllner, Konstanze; Mittermaier, Bernhard

doi:10.1515/9783110494068-012

Cited by 2 publications

(3 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Rasa NLU and Core are fully decoupled, allowing learned dialogue models to be reused across languages and Rasa NLU and Core to be used independently of one another (Bocklisch et al, 2017). Rasa processed student responses in a series of phases, as shown in Figure 2.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

Yildirim-Erbasli

Bulut

Epp

et al. 2023

Journal of Educational Technology Systems

View full text Add to dashboard Cite

Conversational agents have been widely used in education to support student learning. There have been recent attempts to design and use conversational agents to conduct assessments (i.e., conversation-based assessments: CBA). In this study, we developed CBA with constructed and selected-response tests using Rasa—an artificial intelligence-based tool. CBA was deployed via Google Chat to support formative assessment. We evaluated (1) its performance in answering students’ responses and (2) its usability with cognitive walkthroughs conducted by external evaluators. CBA with constructed-response tests consistently matched student responses to the appropriate conversation paths in most cases. In comparison, CBA with selected-response tests demonstrated perfect accuracy between system design and implementation. A cognitive walkthrough of CBA showed its usability as well as several potential issues that could be improved. Participating students did not experience these issues, however, we reported them to help researchers, designers, and practitioners improve the assessment experience for students using CBA.

show abstract

Section: Methodsmentioning

confidence: 99%

“…Note . Adapted from “Rasa: Open source language understanding and dialogue management,” by Bocklisch et al (2017), arXiv preprint , p. 3.…”

Section: Methodsmentioning

confidence: 99%

Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

Yildirim-Erbasli

Bulut

Epp

et al. 2023

Journal of Educational Technology Systems

View full text Add to dashboard Cite

show abstract

“…The technical implementation of the conversational agent utilised the Rasa toolkit ( 41 ). Rasa provides a complete architecture where conversational agent creators can quickly roll out a text-based conversational agent: a chatbot.…”

Section: Methodsmentioning

confidence: 99%

Reducing social diabetes distress with a conversational agent support system: a three-week technology feasibility evaluation

Bruijnes,

Kesteloo,

Brinkman

2023

Front. Digit. Health

View full text Add to dashboard Cite

BackgroundPeople with diabetes mellitus not only have to deal with physical health problems, but also with the psycho-social challenges their chronic disease brings. Currently, technological tools that support the psycho-social context of a patient have received little attention.ObjectiveThe objective of this work is to determine the feasibility and preliminary efficacy of an automated conversational agent to deliver, to people with diabetes, personalised psycho-education on dealing with (psycho-)social distress related to their chronic illness.MethodsIn a double-blinded between-subject study, 156 crowd-workers with diabetes received a social help program intervention in three sessions over three weeks. They were randomly assigned to receive support from either an interactive conversational support agent (n=79) or a self-help text from the book “Diabetes burnout” as a control condition (n=77). Participants completed the Diabetes Distress Scale (DDS) before and after the intervention, and after the intervention, the Client Satisfaction Questionnaire (CSQ-8), Feeling of Being Heard (FBH), and System Usability Scale (SUS).ResultsResults indicate that people using the conversational agent have a larger reduction in diabetes distress (M=−0.305, SD=0.865) than the control group (M=0.002, SD=0.743) and this difference is statistically significant (t(154)=2.377, p=0.019). A hypothesised mediation effect of “attitude to the social help program” was not observed.ConclusionsAn automated conversational agent can deliver personalised psycho-education on dealing with (psycho-)social distress to people with diabetes and reduce diabetes distress more than a self-help book.Ethics, Study Registration and Open ScienceThis study has been preregistered with the Open Science Foundation (osf.io/yb6vg) and has been accepted by the Human Research Ethics Committee - Delft University of Technology under application number 1130. The data and analysis script are available: https://surfdrive.surf.nl/files/index.php/s/4xSEHCrAu0HsJ4P.

show abstract

2d. Beitragsmodell (arXiv)

Cited by 2 publications

References 0 publications

Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability Testing

Reducing social diabetes distress with a conversational agent support system: a three-week technology feasibility evaluation

Contact Info

Product

Resources

About