Multi-modal Virtual Scenario Enhances Neurofeedback Learning

Abstract

In the past decade neurofeedback (NF) has become the focus of a growing body of research. With real-time functional magnetic resonance imaging (fMRI) enabling online monitoring of emotion-related areas, such as the amygdala, many have begun testing its therapeutic benefits. However, most existing NF procedures still use monotonic unimodal interfaces, thus possibly limiting user engagement and weakening learning efficiency. The current study tested a novel multi-sensory NF animated scenario (AS) aimed at enhancing user experience and improving learning. We examined whether relative to a simple uni-modal 2D interface, learning via an interface of complex multi-modal 3D scenario will result in improved NF learning. As a neural-probe, we used the recently developed fMRI-inspired EEG model of amygdala activity ("amygdala-EEG finger print"; amygdala-EFP), enabling low-cost and mobile limbic NF training. Amygdala-EFP was reflected in the AS by the unrest level of a hospital waiting room in which virtual characters become impatient, approach the admission desk and complain loudly. Successful downregulation was reflected as an ease in the room unrest level. We tested whether relative to a standard uni-modal 2D graphic thermometer (TM) interface, this AS could facilitate more effective learning and improve the training experience. Thirty participants underwent two separated NF sessions (1 week apart) practicing downregulation of the amygdala-EFP signal. In the first session, half trained via the AS and half via a TM interface. Learning efficiency was tested by three parameters: (a) effect size of the change in amygdala-EFP following training, (b) sustainability of the learned downregulation in the absence of online feedback, and (c) transferability to an unfamiliar context. Comparing amygdala-EFP signal amplitude between the last and the first NF trials revealed that the AS produced a higher effect size. In addition, NF via the AS showed better sustainability, as indicated by a no-feedback trial conducted in session 2 and better transferability to a new unfamiliar interface. Lastly, participants reported that the AS was more engaging and more motivating than the TM. Together, these results demonstrate the promising potential of integrating realistic virtual environments in NF to enhance learning and improve user's experience.

Electrical fingerprint of the amygdala guides neurofeedback training for stress resilience

“…NF Training: NF was guided by the animated scenario interface previously developed by Cavazza et al 48 and validated by Cohen et al 26 . The paradigm across the 6 sessions followed a similar block design, composed also underwent a no-feedback trial 26,30 . The no-feedback trial was introduced upon completion of the five NF cycles via the animated scenario, from session 4 onward.…”

“…Supplementary Video 26 ) that has been shown to induce higher engagement and a more sustainable learning effect as compared to abstract visual feedback 26 . To test for learning sustainability, participants underwent a no-feedback trial following training sessions 4-6 with the animated scenario.…”

“…(B) EEG-NF session. Success in down regulating the targeted signal (Amyg-EFP or Control) is reflected by audiovisual changes in the unrest level of a virtual 3D scenario (a typical hospital waiting room), manifested as the ratio between characters sitting down and those loudly protesting at the counter 26,48 . The NF paradigm consists of 3 consecutive conditions each repeating 5 times: Watch (60 sec.…”

The potential of functional near-infrared spectroscopy-based neurofeedback – a systematic review and recommendations for best practice

“…Some researchers are opposed to complex feedback, arguing that neurofeedback should lead to knowledge of results and that gaming environments which are too complex may distract participants (Hinterberger et al, 2004;Sherlin et al, 2011). However, comparative studies provide evidence that the more engaging complex feedback embedded in a virtual environment may facilitate learning and is better received by users (Cohen et al, 2016;Gruzelier et al, 2010).…”

Playing a P300-based BCI VR game leads to changes in cognitive functions of healthy adults

“…In the area of gaming recent research (Borhani et al, 2018;McMahon and Schukat, 2018;Cohen et al, 2016;Kerous and Liarokapis, 2016;Yan et al, 2016;Vourvopoulos and i Badia, 2016;Ferreira et al, 2014) as well as some past studies considered the possibilities of interaction of BCIs with virtual environments (Groenegress et al, 2010;Lécuyer et al, 2008;Lotte and Guan, 2010;Pfurtscheller et al, 2011).Most of these studies were again focused on applications for users with physical disabilities, whereas BCI-based interaction with virtual reality could also be an interesting experience for the user from the general public.…”