Virtual Stage: Interactive Puppeteering in Mixed Reality

Husinsky, Matthias; Bruckner, Franziska

doi:10.1109/anivae.2018.8587270

Cited by 6 publications

(2 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…One approach to closing the loop may be to use acted conversations (e.g., Beechey et al 2019 , 2020 ) in combination with virtual interactive animated characters in the virtual reality lab. This could be done via embodied conversational agents ( Llorach et al 2019 ), which are animated characters in the virtual reality that are controlled by a virtual conversational agent (e.g., Llorach & Blat 2017 ) or an actor (interactive puppeteering, e.g., Husinsky & Bruckner 2018 ). Another potential way to close the loop is to combine virtual-reality glasses with an omnidirectional treadmill, which may increase the interactivity and involvement of the subject while they perform hearing-related tasks.…”

Section: General Discussion and Conclusionmentioning

confidence: 99%

The Virtual Reality Lab: Realization and Application of Virtual Sound Environments

et al. 2020

View full text Add to dashboard Cite

To assess perception with and performance of modern and future hearing devices with advanced adaptive signal processing capabilities, novel evaluation methods are required that go beyond already established methods. These novel methods will simulate to a certain extent the complexity and variability of acoustic conditions and acoustic communication styles in real life. This article discusses the current state and the perspectives of virtual reality technology use in the lab for designing complex audiovisual communication environments for hearing assessment and hearing device design and evaluation. In an effort to increase the ecological validity of lab experiments, that is, to increase the degree to which lab data reflect real-life hearing-related function, and to support the development of improved hearing-related procedures and interventions, this virtual reality lab marks a transition from conventional (audio-only) lab experiments to the field. The first part of the article introduces and discusses the notion of the communication loop as a theoretical basis for understanding the factors that are relevant for acoustic communication in real life. From this, requirements are derived that allow an assessment of the extent to which a virtual reality lab reflects these factors, and which may be used as a proxy for ecological validity. The most important factor of real-life communication identified is a closed communication loop among the actively behaving participants. The second part of the article gives an overview of the current developments towards a virtual reality lab at Oldenburg University that aims at interactive and reproducible testing of subjects with and without hearing devices in challenging communication conditions. The extent to which the virtual reality lab in its current state meets the requirements defined in the first part is discussed, along with its limitations and potential further developments. Finally, data are presented from a qualitative study that compared subject behavior and performance in two audiovisual environments presented in the virtual reality lab—a street and a cafeteria—with the corresponding field environments. The results show similarities and differences in subject behavior and performance between the lab and the field, indicating that the virtual reality lab in its current state marks a step towards more ecological validity in lab-based hearing and hearing device research, but requires further development towards higher levels of ecological validity.

show abstract

Section: General Discussion and Conclusionmentioning

confidence: 99%

The Virtual Reality Lab: Realization and Application of Virtual Sound Environments

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Which in context of a CMRE, as Dow et al point out, also means that the design tools for the wizard interface should preferably be integrated directly into the design environment [15]. More recent developments and discourse offer helpful insights into applying these techniques in prototyping and presenting MR experiences [7,20]. For example, Lee combines bodystorming and WoZ techniques in MR environments through a method called Embodied Design Improvisation to "reveal and evaluate appropriate interactions for designers" [29:8].…”

Section: Embodied Design Methods In Hcimentioning

confidence: 99%

Performative prototyping in collaborative mixed reality environments: an embodied design method for ideation and development in virtual reality.

Weijdom

2022

Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

View full text Add to dashboard Cite

Collaborative Mixed Reality Environments (CMREs) enable designing Performative Mixed Reality Experiences (PMREs) to engage participants' physical bodies, mixed reality environments, and technologies utilized. However, the physical body is rarely purposefully incorporated throughout such design processes, leaving designers seated behind their desks, relying on their previous know-how and assumptions. In contrast, embodied design techniques from HCI and performing arts afford direct corporeal feedback to verify and adapt experiential aesthetics within the design process. This paper proposes a performative prototyping method, which combines bodystorming methods with Wizard of Oz techniques with a puppeteering approach, using inside-out somaesthetic-and outside-in dramaturgical perspectives. In addition, it suggests an interdisciplinary vocabulary to share and evaluate PMRE experiences during and after its design collaboration. This method is exemplified and investigated by comparing two case studies of PMRE design projects in higher-art education using the existing Social VR platform NEOS VR adapted as a CMRE. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI); Interaction paradigms; Mixed / augmented reality; Interaction design; Interaction design theory, concepts and paradigms; Collaborative and social computing; Collaborative and social computing design and evaluation methods; Ethnographic studies.

show abstract