Artifacts in EEG-based BCI therapies: friend or foe?

Abstract

EEG-based brain-computer interfaces (BCI) have promising therapeutic potential beyond traditional neurofeedback training, such as enabling personalized and optimized virtual reality (VR) neurorehabilitation paradigms where the timing and parameters of the visual experience is synchronized with specific brain-states. While BCI algorithms are often designed to focus on whichever portion of a signal is most informative, in these brain-state-synchronized applications, it is of critical importance that the resulting decoder is sensitive to physiological brain activity representative of various mental states, and not to artifacts, such as those arising from naturalistic movements. In this study, we compare the relative classification accuracy with which different motor tasks can be decoded from both extracted brain activity and artifacts contained in the EEG signal. EEG data was collected from 17 chronic stroke patients while performing six different head, hand, and arm movements in a realistic VR-based neurorehabilitation paradigm. Results show that the artifactual component of the EEG signal is significantly more informative than brain activity with respect to classification accuracy. This finding is consistent across different feature extraction methods and classification pipelines. While informative brain signals can be recovered with suitable cleaning procedures, we recommend that features should not be designed solely to maximize classification accuracy, as this could select for remaining artifactual components. We also propose the use of machine learning approaches that are interpretable to verify that classification is driven by physiological brain-states. In summary, whereas informative artifacts are a helpful friend in BCI-based communication applications, they can be a problematic foe in the estimation of physiological brain states.

Integrating Biofeedback and Artificial Intelligence into eXtended Reality Training Scenarios: A Systematic Literature Review

“…A brief description of each of the ML/AI technologies considered is provided in Table 11. ( Abdurrahman et al, 2021), (Bhalla et al, 2021), (De Bruyne et al, 2021), (Delvigne et al, 2022), (Delvigne et al, 2020), (Georgiou & Demiris, 2017), (Jones et al, 2020), (Liebers et al, 2021), (Leiker et al, 2016), (Migovich et al, 2021), (Noghabaei et al, 2021), (Porssut et al, 2022), (Shi et al, 2020), (Tsai et al, 2021), (Wilson et al, 2021), (Zhang et al, 2017) From (Porssut et (Granato et al, 2020), (Ihmig et al, 2020), (Islam et al, 2019), (Kim et al, 2019), (Luong et al, 2020), (Martin et al, 2020), (Migovich et al, 2021), (Sakib et al, 2020), (Sayis et al, 2022), (Tabbaa et al, 2022), (Tsai et al, 2021), (Wilson et al, 2021), (Zhang et al, 2017) From (Martin et al, 2020) (continued) (Bauer et al, 2019), (Bin Suhaimi et al, 2020), (Delvigne et al, 2022), (Delvigne et al, 2020), (Jones et al, 2020), (Kaur et al, 2019), (Kim et al, 2020), (McDermott et al, 2022), …”

“…The Unity game engine was used in several studies (including De Bruyne et al, 2021;Delvigne et al, 2022;Dwivedi et al, 2020;Marín-Morales et al, 2021; (Abdurrahman et al, 2021), (Abujelala et al, 2021), (Bhalla et al, 2021), (Bui et al, 2019), (De Bruyne et al, 2021), (Granato et al, 2020), (Kim et al, 2019), (Martin et al, 2020), (Marín-Morales et al, 2021), (Noghabaei et al, 2021), (Oh & Kim, 2021), (Recenti et al, 2021), (Rodrigues et al, 2021), (Stranick & Lopez, 2022), (Suhaimi et al, 2017), (Suhaimi et al, 2020), (Suhaimi, et al, 2022), (Tabbaa et al, 2022), (Zhang et al, 2017) + From "The Appen Artificial Intelligence Glossary", https://appen. Porssut et al, 2022;Rodrigues et al, 2021;Stranick & Lopez, 2022;Tsai et al, 2021) and the Unreal Engine 4 was used in only one study from the 48 studies included (McDermott et al, 2022). Hardware and software integration is important for system development and Unity is currently dominating the "lock-in", where platforms are made dependent on and interoperable with each other to assure market viability (Foxman, 2019).…”