Humans need communication. The desire to communicate remains one of the
primary issues for people with locked-in syndrome (LIS). While many assistive
and augmentative communication systems that use various physiological signals
are available commercially, the need is not satisfactorily met. Brain
interfaces, in particular, those that utilize event related potentials (ERP) in
electroencephalography (EEG) to detect the intent of a person noninvasively, are
emerging as a promising communication interface to meet this need where existing
options are insufficient. Existing brain interfaces for typing use many
repetitions of the visual stimuli in order to increase accuracy at the cost of
speed. However, speed is also crucial and is an integral portion of peer-to-peer
communication; a message that is not delivered timely often looses its
importance. Consequently, we utilize rapid serial visual presentation (RSVP) in
conjunction with language models in order to assist letter selection during the
brain-typing process with the final goal of developing a system that achieves
high accuracy and speed simultaneously. This paper presents initial results from
the RSVP Keyboard system that is under development. These initial results on
healthy and locked-in subjects show that single-trial or few-trial accurate
letter selection may be possible with the RSVP Keyboard paradigm.
AAC should be standard practice for adults with neurodegenerative disease. Patients can maintain effective, functional communication with AAC supports. Individualized communication systems can be implemented ensuring patients remain active participants in daily activities.
Research in brain-computer interfaces has achieved impressive progress towards implementing assistive technologies for restoration or substitution of lost motor capabilities, as well as supporting technologies for able-bodied subjects. Notwithstanding this progress, effective translation of these interfaces from proof-of concept prototypes into reliable applications remains elusive. As a matter of fact, most of the current BCI systems cannot be used independently for long periods of time by their intended end-users. Multiple factors that impair achieving this goal have already been identified. However, it is not clear how do they affect the overall BCI performance or how they should be tackled. This is worsened by the publication bias where only positive results are disseminated, preventing the research community from learning from its errors. This paper is the result of a workshop held at the 6th International BCI meeting in Asilomar. We summarize here the discussion on concrete research avenues and guidelines that may help overcoming common pitfalls and make BCIs become a useful alternative communication device.
Background
Some non-invasive brain computer interface (BCI) systems are currently available for locked-in syndrome (LIS) but none have incorporated a statistical language model during text generation.
Objective
To begin to address the communication needs of individuals with LIS using a non-invasive BCI that involves Rapid Serial Visual Presentation (RSVP) of symbols and a unique classifier with EEG and language model fusion.
Methods
The RSVP Keyboard™ was developed with several unique features. Individual letters are presented at 2.5 per sec. Computer classification of letters as targets or non-targets based on EEG is performed using machine learning that incorporates a language model for letter prediction via Bayesian fusion enabling targets to be presented only 1–4 times. Nine participants with LIS and nine healthy controls were enrolled. After screening, subjects first calibrated the system, and then completed a series of balanced word generation mastery tasks that were designed with five incremental levels of difficulty, that increased by selecting phrases for which the utility of the language model decreased naturally.
Results
Six participants with LIS and nine controls completed the experiment. All LIS participants successfully mastered spelling at level one and one subject achieved level five. Six of nine control participants achieved level five.
Conclusions
Individuals who have incomplete LIS may benefit from an EEG-based BCI system, which relies on EEG classification and a statistical language model. Steps to further improve the system are discussed.
Brain-computer interfaces (BCIs) promise to provide a novel access channel for assistive technologies, including augmentative and alternative communication (AAC) systems, to people with severe speech and physical impairments (SSPI). Research on the subject has been accelerating significantly in the last decade and the research community took great strides toward making BCI-AAC a practical reality to individuals with SSPI. Nevertheless, the end goal has still not been reached and there is much work to be done to produce real-world-worthy systems that can be comfortably, conveniently, and reliably used by individuals with SSPI with help from their families and care givers who will need to maintain, setup, and debug the systems at home. This paper reviews reports in the BCI field that aim at AAC as the application domain with a consideration on both technical and clinical aspects.
Individuals who rely on augmentative and alternative communication (AAC) devices to support their communication often have physical movement challenges that require alternative methods of access. Technology that supports access, particularly for those with the most severe movement deficits, have expanded substantially over the years. The purposes of this article are to review the state of the science of access technologies that interface with augmentative and alternative communication devices and to propose a future research and development agenda that will enhance access options for people with limited movement capability due to developmental and acquired conditions.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.