Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation

Lopes, Pedro; You, Sijing; Ion, Alexandra; Baudisch, Patrick

doi:10.1145/3173574.3174020

Cited by 102 publications

(47 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We utilized a medically-compliant battery powered muscle stimulator (Rehastim from Hasomed), which provides a maximum of 100mA and is controllable via USB. We chose this device since it had been successfully used by researchers as a means to generate force feedback in both VR [22] and AR [23]. The EMS was pre-calibrated per participant to ensure a pain-free stimulation and robust actuation.…”

Section: Apparatusmentioning

confidence: 99%

Detecting Visuo-Haptic Mismatches in Virtual Reality using the Prediction Error Negativity of Event-Related Brain Potentials

Gehrke

Akman

Lopes

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

Designing immersion is the key challenge in virtual reality; this challenge has driven advancements in displays, rendering and recently, haptics. To increase our sense of physical immersion, for instance, vibrotactile gloves render the sense of touching, while electrical muscle stimulation (EMS) renders forces. Unfortunately, the established metric to assess the effectiveness of haptic devices relies on the user's subjective interpretation of unspecific, yet standardized, questions. Here, we explore a new approach to detect a conflict in visuohaptic integration (e.g., inadequate haptic feedback based on poorly configured collision detection) using electroencephalography (EEG). We propose analyzing event-related potentials (ERPs) during interaction with virtual objects. In our study, participants touched virtual objects in three conditions and received either no haptic feedback, vibration, or vibration and EMS feedback. To provoke a brain response in unrealistic VR interaction, we also presented the feedback prematurely in 25% of the trials. We found that the early negativity component of the ERP (so called prediction error) was more pronounced in the mismatch trials, indicating we successfully detected haptic conflicts using our technique. The results can be understood as a first step towards ERPs as a potential metric of haptic immersion in VR. CCS CONCEPTS • Human-centered computing → Haptic devices; Virtual reality;

show abstract

Section: Apparatusmentioning

confidence: 99%

Detecting Visuo-Haptic Mismatches in Virtual Reality using the Prediction Error Negativity of Event-Related Brain Potentials

Gehrke

Akman

Lopes

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…Exoskeleton glove-based interfaces take advantage of this feedback [193]. Electrical muscle stimulation (EMS) is another type of interface that is based on kinesthetic feedback that has been explored to make mixed reality experience more realistic [194]- [196].…”

Section: ) Haptic Interactionsmentioning

confidence: 99%

Augmented Reality, Cyber-Physical Systems, and Feedback Control for Additive Manufacturing: A Review

2019

View full text Add to dashboard Cite

show abstract

“…Impacto [37] is an example of repulsion design, where EMS renders haptic sensation of being hit (e.g., punched) in VR games. More recently, Lopes et al introduced a mobile system that enhances mixed reality experiences using EMS, by actuating the user's muscles while the user is interacting with physical objects [38]. Mainly, the user is actively involved in those interactions with the VR scenes and receives EMS responses based on that.…”

Section: Ems For Haptic Feedback In Vrmentioning

confidence: 99%

“…This means that our approach flips typical gaming mechanics where players control their avatar's movements, and instead reflects the movements of the virtual avatar onto the player's body. This sets this work apart from previous work in EMS-based haptic feedback in VR [37,38,40], since we look into reflecting the avatar's movements on the player's body in non-interactive scenarios, i.e., users are passive during cutscenes and receive the system's output rather than providing input themselves.…”

Section: Introductionmentioning

confidence: 99%

ElectroCutscenes: Realistic Haptic Feedback in Cutscenes of Virtual Reality Games Using Electric Muscle Stimulation

Khamis

Schuster

George

et al. 2019

25th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

Cutscenes in Virtual Reality (VR) games enhance story telling by delivering output in the form of visual, auditory, or haptic feedback (e.g., using vibrating handheld controllers). Since they lack interaction in the form of user input, cutscenes would significantly benefit from improved feedback. We introduce the concept and implementation of ElectroCutscenes, where Electric Muscle Stimulation (EMS) is leveraged to elicit physical user movements to different body parts to correspond to those of personal avatars in cutscenes of VR games while the user stays passive. Through a user study (N=22) in which users passively received kinesthetic feedback resulting in involuntarily movements, we show that Elec-troCutscenes significantly increases perceived presence and realism compared to controller-based vibrotactile and no haptic feedback.

show abstract

Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation

Cited by 102 publications

References 43 publications

Detecting Visuo-Haptic Mismatches in Virtual Reality using the Prediction Error Negativity of Event-Related Brain Potentials

Detecting Visuo-Haptic Mismatches in Virtual Reality using the Prediction Error Negativity of Event-Related Brain Potentials

Augmented Reality, Cyber-Physical Systems, and Feedback Control for Additive Manufacturing: A Review

ElectroCutscenes: Realistic Haptic Feedback in Cutscenes of Virtual Reality Games Using Electric Muscle Stimulation

Contact Info

Product

Resources

About