Talking without a Voice: Virtual Co-Speakership in an Educational Webinar

Erofeeva, Maria A.; Klowait, Nils Oliver; Kimstach, Uliana

doi:10.22394/2074-0492-2021-4-198-216

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Indeed, Meta's heavy involvement in the VR market hints at a plan to facilitate tele-copresent social interaction between physically distant users [34]. Moreover, with the recent relevance of telemediated education [35,36], mixed reality social situations are likely to become more ubiquitous [37,38], with substantive consequences for learning [39].…”

Section: Introductionmentioning

confidence: 99%

On the Multimodal Resolution of a Search Sequence in Virtual Reality

Klowait

2023

Human Behavior and Emerging Technologies

View full text Add to dashboard Cite

In virtual reality (VR), participants may not always have hands, bodies, eyes, or even voices—using VR helmets and two controllers, participants control an avatar through virtual worlds that do not necessarily obey familiar laws of physics; moreover, the avatar’s bodily characteristics may not neatly match our bodies in the physical world. Despite these limitations and specificities, humans get things done through collaboration and the creative use of the environment. While multiuser interactive VR is attracting greater numbers of participants, there are currently few attempts to analyze the in situ interaction systematically. This paper proposes a video-analytic detail-oriented methodological framework for studying virtual reality interaction. Using multimodal conversation analysis, the paper investigates a nonverbal, embodied, two-person interaction: two players in a survival game strive to gesturally resolve a misunderstanding regarding an in-game mechanic—however, both of their microphones are turned off for the duration of play. The players’ inability to resort to complex language to resolve this issue results in a dense sequence of back-and-forth activity involving gestures, object manipulation, gaze, and body work. Most crucially, timing and modified repetitions of previously produced actions turn out to be the key to overcome both technical and communicative challenges. The paper analyzes these action sequences, demonstrates how they generate intended outcomes, and proposes a vocabulary to speak about these types of interaction more generally. The findings demonstrate the viability of multimodal analysis of VR interaction, shed light on unique challenges of analyzing interaction in virtual reality, and generate broader methodological insights about the study of nonverbal action.

show abstract

Section: Introductionmentioning

confidence: 99%

On the Multimodal Resolution of a Search Sequence in Virtual Reality

Klowait

2023

Human Behavior and Emerging Technologies

View full text Add to dashboard Cite

show abstract

Talking without a Voice: Virtual Co-Speakership in an Educational Webinar

Cited by 1 publication

References 0 publications

On the Multimodal Resolution of a Search Sequence in Virtual Reality

On the Multimodal Resolution of a Search Sequence in Virtual Reality

Contact Info

Product

Resources

About