Sensorimotor learning with stereo auditory feedback for a brain–computer interface

Abstract

Motor imagery can be used to modulate sensorimotor rhythms (SMR) enabling detection of voltage fluctuations on the surface of the scalp using electroencephalographic electrodes. Feedback is essential in learning to modulate SMR for non-muscular communication using a brain-computer interface (BCI). A BCI not reliant upon the visual modality not only releases the visual channel for other uses but also offers an attractive means of communication for the physically impaired who are also blind or vision impaired. This study demonstrates the feasibility of replacing the traditional visual feedback modality with stereo auditory feedback. Results from a pilot study were used to select the most appropriate sounds for auditory feedback based on three options: broadband noise and two anechoic instrument samples. Subsequently, an SMR BCI was used to examine the effect on sensorimotor learning with broadband noise utilising a modified stereophonic presentation method. Twenty participants split into equal groups took part in ten sessions. The visual group performed best initially but did not improve over time whilst the auditory group improved as the study progressed. The results demonstrate the feasibility of using stereophonic auditory feedback with broadband noise as opposed to other auditory feedback presentation methods and sounds which are less intuitive.

Neurofeedback training with a motor imagery-based BCI: neurocognitive improvements and EEG changes in the elderly

“…Regarding beta frequency band (13)(14)(15)(16)(17)(18)(19)(20)(21)(22)(23)(24)(25)(26)(27)(28)(29)(30), different studies reported correlation between this frequency range and cognitive functions, such as language and memory [4,26,42].…”

“…They develop a BCI tool with a visual feedback where five participants learned to control mu rhythms by means of videogames. In fact, motor imagery has shown to be useful to control sensorimotor rhythms, often with a visual feedback and sometimes with audio feedback [30]. However, to the best of our knowledge, this is the first study that used MI-BCI to evaluate neurological changes due to NFT in elderly people.…”

“…These endogenous BCI systems depend on the user's ability to control the amplitude in a specific frequency band of the EEG recorded over a particular cortical area [45]. MI-BCI is based on the generation of event-related desynchronization (ERD) and event-related synchronization (ERS) in alpha (8)(9)(10)(11)(12)(13) and beta (13)(14)(15)(16)(17)(18)(19)(20)(21)(22)(23)(24)(25)(26)(27)(28)(29)(30) frequency bands of the EEG [20,33]. These events are related to sensorimotor rhythms (SMR).…”

Development of a hybrid mental spelling system combining SSVEP-based brain–computer interface and webcam-based eye tracking

“…Brain-computer interfaces (BCIs) are non-muscular communication and interaction technologies that allow these disabled individuals to communicate with the outside world using their brain signals [1]. To date, a variety of neural signals have been used with the aim of implementing practical BCI applications, such as electroencephalography (EEG) [1][2][3][4][5][6][7][8][9][10][11][12][13], magnetoencephalography (MEG) [14,15], electrocorticography [16,17], near-infrared spectroscopy [18][19][20], functional magnetic resonance imaging [21,22], and transcranial Doppler ultrasound [23,24]. In particular, the number of EEG-based BCI applications has increased markedly during the past five years [5].…”

Is Sensorimotor BCI Performance Influenced Differently by Mono, Stereo, or 3-D Auditory Feedback?

“…Some BCIs rely on audio simply to provide instruction [13], but there are fewer which rely on audio for feedback of the spontaneous alteration of brain activity, i.e., audio endogenous BCI [14].…”