Enhancing In-game Immersion Using BCI-controlled Mechanics

Woźniak, Mikołaj P.; Sikorski, P.; Wróbel-Lachowska, Magdalena; Bartłomiejczyk, Natalia; Dominiak, Julia; Grudzień, Krzysztof; Romanowski, Andrzej

doi:10.1145/3489849.3489862

Cited by 6 publications

(10 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In [7], the authors investigated the impact of engaging braincomputer interface (BCI)-driven mechanics on player's ingame immersion, and provided qualitative insights on psycho-cognitive effects of using BCIs. An HTC Vive Pro was connected to a VR-dedicated PC.…”

Section: Related Workmentioning

confidence: 99%

“…We will show that the experiments in this study can be easily implemented in CATtalk. In [7], the EEG data are used for analysis only. In CATtalk, the EEG data can serve as real-time feedback to control the VR game.…”

Section: Related Workmentioning

confidence: 99%

“…In CATtalk, the EEG data can serve as real-time feedback to control the VR game. This research direction has not been explored in [7].…”

Section: Related Workmentioning

confidence: 99%

“…The heart of the server is the IoTtalk engine (Figure 2 (5)), an IoT management mechanism responsible for creation and interaction of the art devices [6]. The IoTtalk engine interacts with the DA of an art device through An artist manipulates CATtalk through the Graphical User Interface (GUI; Figure 2 (6)) when an interactive artwork is created in CATtalk as a project called "X-Talk" (Figure 2 (7)). Based on the concept of "device model", X-Talk implements the interaction of the art devices.…”

Section: The Cattalk Architecturementioning

confidence: 99%

“…The BCI-driven mechanics in [7] can be straightforwardly implemented in CATtalk. We replace the gloves in Figure 8 by the HTC Vive Pro and Emotiv Insight 5-channel headset.…”

Section: X-talk Creation and Managementmentioning

confidence: 99%

See 4 more Smart Citations

CATtalk: An IoT-Based Interactive Art Development Platform

2022

View full text Add to dashboard Cite

Interactive art has been significant advanced by the Internet of Things (IoT) and cyber physical interaction technologies, which enables the participants to engage with the art devices. Several tools and platforms have been proposed to create the art devices. However, the interactive artworks are typically developed with these art devices in ad hoc approaches, and the artists need to spend significant programming efforts to integrate the art devices. This paper proposes CATtalk, a platform to create and maintain interactive artworks. The novel idea is to treat all art devices in an interactive artwork as IoT devices that can be transparently reused by reconfiguration in CATtalk. Therefore, the artworks developed independently by individual artists can be quickly integrated to create new interactive applications. Through CATtalk's no-code and low-code mechanisms, the artists can manipulate CATtalk with little or no programing efforts. CATtalk offers a built-in mechanism so that any person in the audience can play with an interactive artwork with his/her smartphone. We also conduct analytic analysis, simulation and measurements to ensure that the interactive art performance in cross-country remote stages are not affected by the communications delays. In our measurements, the average local and remote communication delays are about 0.01 and 0.05 seconds, respectively. If the art performance is designed such that the average delay between two actions of a local (remote) performer is longer than 0.1 seconds, then the probability of out-of-sequence actions is less than 0.01%. That is, the local dancer should perform slower than the remote dancer. Such delay analysis for remote interactive art performance has not been conducted in the literature.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

“…In CATtalk, the EEG data can serve as real-time feedback to control the VR game. This research direction has not been explored in [7].…”

Section: Related Workmentioning

confidence: 99%

Section: The Cattalk Architecturementioning

confidence: 99%

“…The BCI-driven mechanics in [7] can be straightforwardly implemented in CATtalk. We replace the gloves in Figure 8 by the HTC Vive Pro and Emotiv Insight 5-channel headset.…”

Section: X-talk Creation and Managementmentioning

confidence: 99%

See 3 more Smart Citations

CATtalk: An IoT-Based Interactive Art Development Platform

2022

View full text Add to dashboard Cite

show abstract

The CoDIS Taxonomy for Brain-Computer Interface Games Controlled by Electroencephalography

Vasiljevic

2023

International Journal of Human–Computer Interaction

View full text Add to dashboard Cite

A Human-Centric Metaverse Enabled by Brain-Computer Interface: A Survey

Zhu,

Hieu,

Hoang

et al. 2024

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

The growing interest in the Metaverse has generated momentum for members of academia and industry to innovate toward realizing the Metaverse world. The Metaverse is a unique, continuous, and shared virtual world where humans embody a digital form within an online platform. Through a digital avatar, Metaverse users should have a perceptual presence within the environment and can interact and control the virtual world around them. Thus, a human-centric design is a crucial element of the Metaverse. The human users are not only the central entity but also the source of multi-sensory data that can be used to enrich the Metaverse ecosystem. In this survey, we study the potential applications of Brain-Computer Interface (BCI) technologies that can enhance the experience of Metaverse users. By directly communicating with the human brain, the most complex organ in the human body, BCI technologies hold the potential for the most intuitive human-machine system operating at the speed of thought. BCI technologies can enable various innovative applications for the Metaverse through this neural pathway, such as user cognitive state monitoring, digital avatar control, virtual interactions, and imagined speech communications. This survey first outlines the fundamental background of the Metaverse and BCI technologies. We then discuss the current challenges of the Metaverse that can potentially be addressed by BCI, such as motion sickness when users experience virtual environments or the negative emotional states of users in immersive virtual applications. After that, we propose and discuss a new research direction called Human Digital Twin, in which digital twins can create an intelligent and interactable avatar from the user's brain signals. We also present the challenges and potential solutions in synchronizing and communicating between virtual and physical entities in the Metaverse. Finally, we highlight the challenges, open issues, and future research directions for BCI-enabled Metaverse systems.

show abstract

Enhancing In-game Immersion Using BCI-controlled Mechanics

Cited by 6 publications

References 37 publications

CATtalk: An IoT-Based Interactive Art Development Platform

CATtalk: An IoT-Based Interactive Art Development Platform

The CoDIS Taxonomy for Brain-Computer Interface Games Controlled by Electroencephalography

A Human-Centric Metaverse Enabled by Brain-Computer Interface: A Survey

Contact Info

Product

Resources

About