The Effects of Expressing Empathy/Autonomy Support Using a COVID-19 Vaccination Chatbot: Experimental Study in a Sample of Belgian Adults

Abstract

Background Chatbots are increasingly used to support COVID-19 vaccination programs. Their persuasiveness may depend on the conversation-related context. Objective This study aims to investigate the moderating role of the conversation quality and chatbot expertise cues in the effects of expressing empathy/autonomy support using COVID-19 vaccination chatbots. Methods This experiment with 196 Dutch-speaking adults living in Belgium, who engaged in a conversation with a chatbot providing vaccination information, used a 2 (empathy/autonomy support expression: present vs absent) × 2 (chatbot expertise cues: expert endorser vs layperson endorser) between-subject design. Chatbot conversation quality was assessed through actual conversation logs. Perceived user autonomy (PUA), chatbot patronage intention (CPI), and vaccination intention shift (VIS) were measured after the conversation, coded from 1 to 5 (PUA, CPI) and from –5 to 5 (VIS). Results There was a negative interaction effect of chatbot empathy/autonomy support expression and conversation fallback (CF; the percentage of chatbot answers “I do not understand” in a conversation) on PUA (PROCESS macro, model 1, B=–3.358, SE 1.235, t186=2.718, P=.007). Specifically, empathy/autonomy support expression had a more negative effect on PUA when the CF was higher (conditional effect of empathy/autonomy support expression at the CF level of +1SD: B=–.405, SE 0.158, t186=2.564, P=.011; conditional effects nonsignificant for the mean level: B=–0.103, SE 0.113, t186=0.914, P=.36; conditional effects nonsignificant for the –1SD level: B=0.031, SE=0.123, t186=0.252, P=.80). Moreover, an indirect effect of empathy/autonomy support expression on CPI via PUA was more negative when CF was higher (PROCESS macro, model 7, 5000 bootstrap samples, moderated mediation index=–3.676, BootSE 1.614, 95% CI –6.697 to –0.102; conditional indirect effect at the CF level of +1SD: B=–0.443, BootSE 0.202, 95% CI –0.809 to –0.005; conditional indirect effects nonsignificant for the mean level: B=–0.113, BootSE 0.124, 95% CI –0.346 to 0.137; conditional indirect effects nonsignificant for the –1SD level: B=0.034, BootSE 0.132, 95% CI –0.224 to 0.305). Indirect effects of empathy/autonomy support expression on VIS via PUA were marginally more negative when CF was higher. No effects of chatbot expertise cues were found. Conclusions The findings suggest that expressing empathy/autonomy support using a chatbot may harm its evaluation and persuasiveness when the chatbot fails to answer its users’ questions. The paper adds to the literature on vaccination chatbots by exploring the conditional effects of chatbot empathy/autonomy support expression. The results will guide policy makers and chatbot developers dealing with vaccination promotion in designing the way chatbots express their empathy and support for user autonomy.

Artificial Empathy: User Experiences with Emotionally Intelligent Chatbots

“…The significance of empathy in fostering trust and rapport with users, as discussed by Warren-Smith (2023), Trzebiński et al (2023), andLtifi (2023), resonates with our observations (Ltifi, 2023;Trzebiński et al, 2023;Warren-Smith, 2023). The empathetic responses delivered by chatbots are pivotal in enhancing user engagement and satisfaction, a finding further supported by the role of empathy in service recovery contexts, as outlined by Fan (2023) (Fan, 2023).…”

“…Empathy, as a cornerstone of effective communication and rapport-building, has been extensively documented for its critical role in enhancing user engagement and trust in AI interfaces (Ltifi, 2023;Trzebiński et al, 2023;Warren-Smith, 2023). The deliberate incorporation of empathetic responses by chatbots not only elevates the user experience but also fosters a sense of connection and personalization, factors increasingly recognized as vital for user retention in competitive industries such as tourism (Fan, 2023).…”

Chatbots and COVID-19: Taking Stock of the Lessons Learned

“…While this theme issue in the Journal of Medical Internet Research titled "Chatbots and COVID-19" [12] focuses on chatbots related to COVID-19, the span of topics covered by these chatbots is broad. They range from vaccine hesitancy and equity in access to relevant information [13][14][15] to pandemic-related mental health [16][17][18][19]. A number of topics focus on health promotion interventions, such as smoking cessation [20], as well as encouraging physical activity [21] and tooth-brushing [22].…”

The Protective Effects of Empathic Concern and Optimism on Emotional Exhaustion

“…It is a key predictor of prosocial behavior and social bonding. Research indicates that empathic concern can influence emotional and psychological well-being in significant ways (Tarlow & Greca, 2020;Trzebiński et al, 2023;Tullett & Plaks, 2016;Yadav & Iqbal, 2009;Zhai & Wibowo, 2022). For instance, Berry et al (2018) found that mindfulness increases prosocial responses toward ostracized strangers through heightened empathic concern, highlighting its importance in social contexts (Berry et al, 2018).…”