Fast Optical Signals for Real-Time Retinotopy and Brain Computer Interface

Abstract

A brain–computer interface (BCI) allows users to control external devices through brain activity. Portable neuroimaging techniques, such as near-infrared (NIR) imaging, are suitable for this goal. NIR imaging has been used to measure rapid changes in brain optical properties associated with neuronal activation, namely fast optical signals (FOS) with good spatiotemporal resolution. However, FOS have a low signal-to-noise ratio, limiting their BCI application. Here FOS were acquired with a frequency-domain optical system from the visual cortex during visual stimulation consisting of a rotating checkerboard wedge, flickering at 5 Hz. We used measures of photon count (Direct Current, DC light intensity) and time of flight (phase) at two NIR wavelengths (690 nm and 830 nm) combined with a machine learning approach for fast estimation of visual-field quadrant stimulation. The input features of a cross-validated support vector machine classifier were computed as the average modulus of the wavelet coherence between each channel and the average response among all channels in 512 ms time windows. An above chance performance was obtained when differentiating visual stimulation quadrants (left vs. right or top vs. bottom) with the best classification accuracy of ~63% (information transfer rate of ~6 bits/min) when classifying the superior and inferior stimulation quadrants using DC at 830 nm. The method is the first attempt to provide generalizable retinotopy classification relying on FOS, paving the way for the use of FOS in real-time BCI.

Functional Near-Infrared Spectrometry as a Useful Diagnostic Tool for Understanding the Visual System: A Review

“…In a recent study, Takagi et al successfully used latent diffusion models—initially developed by Rombach et al [ 44 ]—to reconstruct high-resolution images of 512 × 512 pixels from human brain activity, all without the need for fine-tuning their deep generative networks [ 45 ] ( Figure 5 ). Similarly, Perpetuini et al developed a model for a generalizable retinotopy classification using acquired optical brain signals from the visual cortex during visual stimulation consisting of a rotating checkerboard wedge, flickering at 5 Hz [ 46 ]. Their results could encourage the use of optical fNIRS signals in real-time BCI applications.…”