Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state

Abstract

This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials (ERP) elicited in different modalities for use in brain-computer interface (BCI) systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g., partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.

Interfacing brain with computer to improve communication and rehabilitation after brain damage

“…In addition to the assessment of the system effectiveness, the types of stimulation exploited to elicit the P3 (Kaufmann et al, 2013;Townsend et al, 2010), the user's motivation (Nijboer et al, 2010), and selective attention were shown to influence the BCI performance of people with neurodegenerative diseases.…”

Multi–command Chest Tactile Brain Computer Interface for Small Vehicle Robot Navigation

“…The results in [20] indicated that the experiments achieved information transfer rates of 7.8 bit/min on average and 27 bit/min for the best subject. A very recent report [7] additionally confirmed superiority of the tactile BCI (tBCI) in comparison with visual and auditory modalities tested with a locked-in syndrome (LIS) subject [14].…”

Control interfaces to actively support the arm function of men with Duchenn Muscular Dystrophy

“…While there is a large variety of control interfaces, a small number of studies have focused on their formal performance evaluation and comparison [205,206,207,208,209,210,211,212]. The performance of control interfaces is rarely evaluated consistently, which prevents an objective evaluation and comparison.…”