Optimising non-invasive brain-computer interface systems for free communication between naïve human participants

Abstract

Free communication is one of the cornerstones of modern civilisation. While manual keyboards currently allow us to interface with computers and manifest our thoughts, a next frontier is communication without manual input. Brain-computer interface (BCI) spellers often achieve this by decoding patterns of neural activity as users attend to flickering keyboard displays. To date, the highest performing spellers report typing rates of ~10.00 words/minute. While impressive, these rates are typically calculated for experienced users repetitively typing single phrases. It is therefore not clear whether naïve users are able to achieve such high rates with the added cognitive load of genuine free communication, which involves continuously generating and spelling novel words and phrases. In two experiments, we developed an open-source, high-performance, non-invasive BCI speller and examined its feasibility for free communication. The BCI speller required users to focus their visual attention on a flickering keyboard display, thereby producing unique cortical activity patterns for each key, which were decoded using filter-bank canonical correlation analysis. In Experiment 1, we tested whether seventeen naïve users could maintain rapid typing during prompted free word association. We found that information transfer rates were indeed slower during this free communication task than during typing of a cued character sequence. In Experiment 2, we further evaluated the speller’s efficacy for free communication by developing a messaging interface, allowing users to engage in free conversation. The results showed that free communication was possible, but that information transfer was reduced by voluntary textual corrections and turn-taking during conversation. We evaluated a number of factors affecting the suitability of BCI spellers for free communication, and make specific recommendations for improving classification accuracy and usability. Overall, we found that developing a BCI speller for free communication requires a focus on usability over reduced character selection time, and as such, future performance appraisals should be based on genuine free communication scenarios.

Joint control of visually guided actions involves concordant increases in behavioural and neural coupling

“…Recent technological advances have made simultaneous EEG recordings in interacting subjects, termed “hyperscanning” 29 , 30 , 42 , 44 , 51 – 53 , 67 , 68 , tractable for scientific investigation. Broadly speaking, there have been two key hyperscanning approaches.…”

Brain Computer Interfaces for Improving the Quality of Life of Older Adults and Elderly Patients

“…Some of the elderly face difficulty in communicating their needs. Hence, the free communication can be a tool for them to support the conversation ( Renton et al, 2019 ). As age is the most significant risk factor in stroke, rehabilitation can help for restoring the ability for the motor functions.…”

Spinning Icons: Introducing a Novel SSVEP-BCI Paradigm Based on Rotation

“…Compared to e.g. motor-imagery [5] or beta rhythms [2], they do not require training [7] and provide robust and fast classification even for speller applications with up to 40 possible character inputs at a time [4,14]. One major disadvantage however is the visual presentation of the stimuli itself with a constant flickering, which can be often stressful and tiring to look at for the human eye, especially over a longer period of time [9].…”