Submitting surveys via a conversational interface: An evaluation of user acceptance and approach effectiveness

Abstract

Conversational interfaces are currently on the rise: more and more applications rely on a chat-like interaction pattern to increase their acceptability and to improve user experience. Also in the area of questionnaire design and administration, interaction design is increasingly looked at as an important ingredient of a digital solution. For those reasons, we designed and developed a conversational survey tool to administer questionnaires with a colloquial form through a chat-like Web interface.In this paper, we present the evaluation results of our approach, taking into account both the user point of view -by assessing user acceptance and preferences in terms of survey compilation experience -and the survey design perspective -by investigating the effectiveness of a conversational survey in comparison to a traditional questionnaire. We show that users clearly appreciate the conversational form and prefer it over a traditional approach and that, from a data collection point of view, the conversational method shows the same reliability and a higher response quality with respect to a traditional questionnaire.

Gender, education, and digital generations as determinants of attitudes toward health information for health workers in West Java, Indonesia

“…The literature has demonstrated no significant effect of gender differences on the score of health information attitude ( Celino and Re Calegari, 2020 ) and no significant relationships between the demographic variables of gender and intentions ( Knabe, 2012 ) and that gender was not predictive of behavioral aspects ( Khan and Idris, 2019 ). More so when the context of a study is related to technology, studies have demonstrated no significant differences between females and males in using mobile social network applications ( Abdelraheem and Ahmed, 2018 ), and gender differences were not significant for attitudes, perceptions, and uses of computers ( Bain and Rice, 2006 ).…”

Designing Asynchronous Remote Support for Behavioral Activation in Teenagers With Depression: Formative Study

“…This is a promising approach. Research in other settings has shown that such people may prefer chatbots to questionnaires and that they may lead to greater engagement and more reliable and higher quality responses than questionnaires [ 32 ]. Conversational agents can also support reflection and self-learning in the workplace [ 33 ] or around physical activity goals [ 34 ].…”

Recognition of cooking activities through air quality sensor data for supporting food journaling

“…Furthermore, NLP technologies have been recently employed for the design of virtual assistants, whose adoption has enabled several changes in today's life. Google Assistant, 5 Apple's Siri, 6 Microsoft's Cortana, 7 Amazon's Alexa, 8 Wit.ai 9 and Snips.ai, 10 an open source and privacy oriented solution, are all well-known examples of digital voice assistants available on the market today. Such technologies can be used to access apps, services, and software, reading out the daily news, setting timers, or tapping into music playlists, and control IoT products and sensors.…”

“…6 https ://www.apple .com/siri/. 7 https ://www.micro soft.com/en-in/windo ws/corta na. 8 https ://devel oper.amazo n.com/alexa .…”

“…In particular, in this paper we concentrate on the technical solutions and evaluation of the modules for recognizing cooking activities. Advanced solutions for conversational interfaces [7], human-computer interaction [27], usability [34], and diet analysis [17], including calorie count [29] and adaptive interfaces for supporting behavior change [25], will be addressed in future work.…”