Getting the Point Across: Exploring the Effects of Dynamic Virtual Humans in an Interactive Museum Exhibit on User Perceptions

Abstract

We have created “You, M.D.”, an interactive museum exhibit in which users learn about topics in public health literacy while interacting with virtual humans. You, M.D. is equipped with a weight sensor, a height sensor and a Microsoft Kinect that gather basic user information. Conceptually, You, M.D. could use this user information to dynamically select the appearance of the virtual humans in the interaction attempting to improve learning outcomes and user perception for each particular user. For this concept to be possible, a better understanding of how different elements of the visual appearance of a virtual human affects user perceptions is required. In this paper, we present the results of an initial user study with a large sample size (n =333) ran using You, M.D. The study measured users’ reactions based on the user’s gender and body-mass index (BMI) when facing virtual humans with BMI either concordant or discordant from the user’s BMI. The results of the study indicate that concordance between the users’ BMI and the virtual human’s BMI affects male and female users differently. The results also show that female users rate virtual humans as more knowledgeable than male users rate the same virtual humans.

Virtual Humans in Museums and Cultural Heritage Sites

“…It is notable that the above applications [49,50] and that presented in Rivera-Gutierrez et al [13] are 3D VR installations belonging to technology and science museums. To an extent, they are expositions of advanced technology in themselves, and therefore both enhance the interest in technology and foreground the institutions' pertinence with advancements in ICT and science in general.…”

“…A characteristic example is described by Breuss-Schneeweis [11], i a digital human agent in the form of an ancient Celt explains the exhibit smartphone app users scan specific targets at the Salzburg Museum of Celtic H While in these instances users prompt VH narrations by choosing topics, there is sibility for direct communication given the resources such functionality would especially considering the limitations hand-held devices pose in terms of pr power. Users may provide non-verbal input to DHs so that they can provide t apposite narration or information in different ways, apart from gesture comm choosing options from a menu; in Rivera-Gutierrez et al [13], virtual humans as doctors provide lessons on a series of health issues interactively within an instal a Science Museum that provides advice to visitors on issues such as weight loss paper, the surveyed research appears to investigate the potential uses of diffe proaches methodologies and technologies. As outlined in the following Conclus tion, there is scope for future research to aim at combining the strengths of exist often diverging) approaches.…”

“…While in these instances users prompt VH narrations by choosing topics, there is no possibility for direct communication given the resources such functionality would require, especially considering the limitations hand-held devices pose in terms of processing power. Users may provide non-verbal input to DHs so that they can provide the most apposite narration or information in different ways, apart from gesture commands or choosing options from a menu; in Rivera-Gutierrez et al [13], virtual humans as medical doctors provide lessons on a series of health issues interactively within an installation at a Science Museum that provides advice to visitors on issues such as weight loss. In this paper, the surveyed research appears to investigate the potential uses of differing approaches methodologies and technologies.…”

“…Ten (10) out of thirteen (13) publications in the last four years characteristically refer to digital agents (mediators), while another one regards both mediator and user avatars. This shift indicates increased interest and investment in the capabilities such digital agents can offer.…”

“…Furthermore, recent publications (e.g., Rivera-Gutierrez et al, 2014 [13]; Sylaiou et al, 2020 [14]; Stylianidis et al, 2022 [15]) that investigate the ability of virtual agents who present exhibits to users in VR settings (e.g., museum guides or companions) to engage visitors do so in experiments. This allows for more focused research on a set of variables (avatars' clothing, appearance and, most importantly, modes of address, i.e., the style and register of verbal communications with users; these can range from impersonal, authoritative, and almost didactic to informal and convivial, resembling a peer-to-peer interaction).…”