Decoding unconstrained arm movements in primates using high-density electrocorticography signals for brain-machine interface use

Hu, Kejia; Jamali, Mohsen; Moses, Ziev B.; Ortega, Carlos A.; Friedman, Gabriel N.; Xu, Wendong; Williams, Ziv

doi:10.1038/s41598-018-28940-7

Cited by 16 publications

(11 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…ECoGs have previously been used for decoding movements (Hu et al, 2018), speech (Mugler et al, 2014), object categories (Liu et al, 2009;Majima et al, 2014), and stimulus location and images (Lewis et al, 2016). We add to this literature by performing a direct comparison across simultaneously recorded scales, and showing that not only is ECoG efficient, but it outperforms other signals, at least in our recording conditions.…”

Section: Relationship With Previous Studiesmentioning

confidence: 76%

Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Kanth

Ray

2020

J. Neurosci.

View full text Add to dashboard Cite

Neural signals recorded at different scales contain information about environment and behavior and have been used to control Brain Machine Interfaces with varying degrees of success. However, a direct comparison of their efficacy has not been possible due to different recording setups, tasks, species, etc. To address this, we implanted customized arrays having both microelectrodes and electrocorticogram (ECoG) electrodes in the primary visual cortex of 2 female macaque monkeys, and also recorded electroencephalogram (EEG), while they viewed a variety of naturalistic images and parametric gratings. Surprisingly, ECoG had higher information and decodability than all other signals. Combining a few ECoG electrodes allowed more accurate decoding than combining a much larger number of microelectrodes. Control analyses showed that higher decoding accuracy of ECoG compared with local field potential was not because of differences in low-level visual features captured by them but instead because of larger spatial summation of the ECoG. Information was high in the 30-80 Hz range and at lower frequencies. Information in different frequencies and scales was nonredundant. These results have strong implications for Brain Machine Interface applications and for study of population representation of visual stimuli.

show abstract

Section: Relationship With Previous Studiesmentioning

confidence: 76%

Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Kanth

Ray

2020

J. Neurosci.

View full text Add to dashboard Cite

show abstract

“…The importance of vertical reach angle makes sense because upward reaches require more effort and activate different muscles than downward reaches. In addition, population neural activity has been shown to robustly encode reach direction [106, 107]. We did not include a reach angle feature sensitive to horizontal movements because reach angle distributions were skewed towards vertical angles at ±90°, as seen in Fig.…”

Section: Discussionmentioning

confidence: 99%

Behavioral and Neural Variability of Naturalistic Arm Movements

Peterson

Singh

Wang

et al. 2020

Preprint

View full text Add to dashboard Cite

Motor behaviors are central to many functions and dysfunctions of the brain, and understanding their neural basis has consequently been a major focus in neuroscience. However, most studies of motor behaviors have been restricted to artificial, repetitive paradigms, far removed from natural movements performed "in the wild." Here, we leveraged recent advances in machine learning and computer vision to analyze intracranial recordings from 12 human subjects during thousands of spontaneous arm reach movements, observed over several days for each subject. These naturalistic movements elicited cortical spectral power patterns consistent with findings from controlled paradigms, but with an important difference: there was considerable neural variability across subjects and events. We modeled inter-event variability using ten behavioral and environmental features; the most important features explaining this variability were reach angle and recording day. Our work is among the first studies connecting behavioral and neural variability across cortex in humans during spontaneous movements and contributes to our understanding of long-term naturalistic behavior.

show abstract

“…A more significant factor determining the specificity of EFP/ECoG signals, therefore, might be given by the size and density of the recording electrodes. Only few studies have compared signal quality and decoding performance for the different types of subdural and intracortical arrays used in clinical and basic neuroscience studies (Kellis et al, 2016;Flint et al, 2017;Wang et al, 2017), yet it appears that many of the results indicating high signal specificity were obtained with high-density arrays and rather small electrodes (Kaiju et al, 2017;Branco et al, 2017;Hu et al, 2018;Ramsey et al, 2018). The findings of the present study that EFPs possess high spatial selectivity is clearly in line with this: With the small electrodes of our array we estimated mean ERF sizes of about 2.7 and 2.8 deg diameter (re-calculated from ERF areas assuming circular ERFs) in monkeys M1 and M3, respectively, and 4.0 deg in M2, which is around a factor of 1.6 to 2.3 of the receptive field size of intracortical LFPs, measured with the same mapping paradigm (Drebitz et al, 2019).…”

Section: Discussionmentioning

confidence: 99%

Visual epidural field potentials possess high functional specificity in single trials

Fischer

Schander

Kreiter

et al. 2019

Preprint

View full text Add to dashboard Cite

Recordings of epidural field potentials (EFPs) allow to acquire neuronal activity over a large region of cortical tissue with minimal invasiveness. Because electrodes are placed on top of the dura and do not enter the neuronal tissue, EFPs offer intriguing options for both clinical and basic science research. On the other hand, EFPs represent the integrated activity of larger neuronal populations, possess a higher trial-by-trial variability, and a reduced signal-to-noise ratio due the additional barrier of the dura. It is thus unclear whether and to what extent EFPs have sufficient spatial selectivity to allow for conclusions about the underlying functional cortical architecture, and whether single EFP trials provide enough information on the short time scales relevant for many clinical and basic neuroscience purposes. We here use the high spatial resolution of primary visual cortex to address these issues and investigate the extent to which very short EFP traces SignificanceEpidural field potential (EFP) recordings provide a minimally invasive approach to investigate large-scale neural networks and offer intriguing options for basic research and clinical applications. In contrast to subdural recordings, however, the additional barrier of the dura potentially enlarges the neuronal population over which activity is integrated, and decreases both signal-to-noise ratio and spatial resolution. Here we show that despite these constrains singletrial EFPs constitute a highly reliable, selective, and clearly localized source of information. By making use of the spatial selectivity of primary visual cortex, we show that single trial information can be decoded with close-to-perfect performance, even without using advanced classifiers and based on very few data. This labels EFPs as a highly attractive and widely usable signal.

show abstract

Decoding unconstrained arm movements in primates using high-density electrocorticography signals for brain-machine interface use

Cited by 16 publications

References 67 publications

Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Behavioral and Neural Variability of Naturalistic Arm Movements

Visual epidural field potentials possess high functional specificity in single trials

Contact Info

Product

Resources

About