Interactionism in the age of ubiquitous telecommunication

Klowait, Nils Oliver

doi:10.1080/1369118x.2019.1566487

Cited by 7 publications

(2 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, new resources may become available: emojis, chats, whiteboards, etc. In short, not all analytical conventions can be imported from the physical world [8,9], and considerable adaptation is required to render new forms of action visible [10,11].…”

Section: Introductionmentioning

confidence: 99%

On the Multimodal Resolution of a Search Sequence in Virtual Reality

Klowait

2023

Human Behavior and Emerging Technologies

Self Cite

View full text Add to dashboard Cite

In virtual reality (VR), participants may not always have hands, bodies, eyes, or even voices—using VR helmets and two controllers, participants control an avatar through virtual worlds that do not necessarily obey familiar laws of physics; moreover, the avatar’s bodily characteristics may not neatly match our bodies in the physical world. Despite these limitations and specificities, humans get things done through collaboration and the creative use of the environment. While multiuser interactive VR is attracting greater numbers of participants, there are currently few attempts to analyze the in situ interaction systematically. This paper proposes a video-analytic detail-oriented methodological framework for studying virtual reality interaction. Using multimodal conversation analysis, the paper investigates a nonverbal, embodied, two-person interaction: two players in a survival game strive to gesturally resolve a misunderstanding regarding an in-game mechanic—however, both of their microphones are turned off for the duration of play. The players’ inability to resort to complex language to resolve this issue results in a dense sequence of back-and-forth activity involving gestures, object manipulation, gaze, and body work. Most crucially, timing and modified repetitions of previously produced actions turn out to be the key to overcome both technical and communicative challenges. The paper analyzes these action sequences, demonstrates how they generate intended outcomes, and proposes a vocabulary to speak about these types of interaction more generally. The findings demonstrate the viability of multimodal analysis of VR interaction, shed light on unique challenges of analyzing interaction in virtual reality, and generate broader methodological insights about the study of nonverbal action.

show abstract

Section: Introductionmentioning

confidence: 99%

On the Multimodal Resolution of a Search Sequence in Virtual Reality

Klowait

2023

Human Behavior and Emerging Technologies

Self Cite

View full text Add to dashboard Cite

show abstract

“…User Experience (UX) design is a design paradigm that focuses on improving the user's experience with a product throughout its entire life cycle.5 Another theoretical shift in conversation-analytic approaches to technologies occupies the high-ontology segment of the conceptualization of artefacts: objects as sets of affordances or autonomous interactants. For a discussion of the conceptual and methodological implications of this shift, see[Erofeeva, 2019;Klowait, 2019].…”

mentioning

confidence: 99%

The Rise of Interactional Multimodality in Human-Computer Interaction

Klowait

Erofeeva

2021

MONITORING OF PUBLIC OPINION

Self Cite

View full text Add to dashboard Cite

The field of human-computer interaction (HCI) investigates the intersection between the design of devices and users. From an early focus on interaction modeling based on psychological experiments, the field has since experienced a shift towards the study of how actual humans interact with autonomous devices. The field became conductive to ethnographic, observational and videographic studies of human-device interaction. Conversation-analytic HCI became possible. That said, this new wave of researchers was never truly able to dethrone the psychological common sense of the field. With recent developments in both the technical-sensorial capabilities and outward actuational range of embodied virtual agents, the field of HCI has once again returned to the question of the sequential unfolding of the interaction between users and intelligent agents, and the multimodal interactional repertoire that is deployed throughout. This review will highlight the situational orientation of high-impact research in the field, and relate it to the cotemporaneous development of ethnomethodological and conversation analytic frameworks. Acknowledgments. The article was prepared in the framework of a research grant funded by the Ministry of Science and Higher Education of the Russian Federation (grant ID: 075-15-2020-908). The article was prepared in cooperation with the Sber (ex. – Sberbank’s) Gamification Lab.

show abstract

Agency and the Posthuman Shape of Law

Kalpokas

2019

Algorithmic Governance

View full text Add to dashboard Cite

Interactionism in the age of ubiquitous telecommunication

Cited by 7 publications

References 42 publications

On the Multimodal Resolution of a Search Sequence in Virtual Reality

On the Multimodal Resolution of a Search Sequence in Virtual Reality

The Rise of Interactional Multimodality in Human-Computer Interaction

Agency and the Posthuman Shape of Law

Contact Info

Product

Resources

About