Objective At the balanced intersection of human and machine adaptation is found the optimally functioning brain-computer interface (BCI). In this study, we report a novel experiment of BCI controlling a robotic quadcopter in three-dimensional physical space using noninvasive scalp EEG in human subjects. We then quantify the performance of this system using metrics suitable for asynchronous BCI. Lastly, we examine the impact that operation of a real world device has on subjects’ control with comparison to a two-dimensional virtual cursor task. Approach Five human subjects were trained to modulate their sensorimotor rhythms to control an AR Drone navigating a three-dimensional physical space. Visual feedback was provided via a forward facing camera on the hull of the drone. Individual subjects were able to accurately acquire up to 90.5% of all valid targets presented while travelling at an average straight-line speed of 0.69 m/s. Significance Freely exploring and interacting with the world around us is a crucial element of autonomy that is lost in the context of neurodegenerative disease. Brain-computer interfaces are systems that aim to restore or enhance a user’s ability to interact with the environment via a computer and through the use of only thought. We demonstrate for the first time the ability to control a flying robot in the three-dimensional physical space using noninvasive scalp recorded EEG in humans. Our work indicates the potential of noninvasive EEG based BCI systems to accomplish complex control in three-dimensional physical space. The present study may serve as a framework for the investigation of multidimensional non-invasive brain-computer interface control in a physical environment using telepresence robotics.

Films like Firefox, Surrogates, and Avatar have explored the possibilities of using brain-computer interfaces (BCIs) to control machines and replacement bodies with only thought. Real world BCIs have made great progress toward that end. Invasive BCIs have enabled monkeys to fully explore 3-dimensional (3D) space using neuroprosthetics. However, non-invasive BCIs have not been able to demonstrate such mastery of 3D space. Here, we report our work, which demonstrates that human subjects can use a non-invasive BCI to fly a virtual helicopter to any point in a 3D world. Through use of intelligent control strategies, we have facilitated the realization of controlled flight in 3D space. We accomplished this through a reductionist approach that assigns subject-specific control signals to the crucial components of 3D flight. Subject control of the helicopter was comparable when using either the BCI or a keyboard. By using intelligent control strategies, the strengths of both the user and the BCI system were leveraged and accentuated. Intelligent control strategies in BCI systems such as those presented here may prove to be the foundation for complex BCIs capable of doing more than we ever imagined.

Brain-computer interfaces (BCIs) allow a user to interact with a computer system using thought. However, only recently have devices capable of providing sophisticated multi-dimensional control been achieved non-invasively. A major goal for non-invasive BCI systems has been to provide continuous, intuitive, and accurate control, while retaining a high level of user autonomy. By employing electroencephalography (EEG) to record and decode sensorimotor rhythms (SMRs) induced from motor imaginations, a consistent, user-specific control signal may be characterized. Utilizing a novel method of interactive and continuous control, we trained three normal subjects to modulate their SMRs to achieve three-dimensional movement of a virtual helicopter that is fast, accurate, and continuous. In this system, the virtual helicopter's forward-backward translation and elevation controls were actuated through the modulation of sensorimotor rhythms that were converted to forces applied to the virtual helicopter at every simulation time step, and the helicopter's angle of left or right rotation was linearly mapped, with higher resolution, from sensorimotor rhythms associated with other motor imaginations. These different resolutions of control allow for interplay between general intent actuation and fine control as is seen in the gross and fine movements of the arm and hand. Subjects controlled the helicopter with the goal of flying through rings (targets) randomly positioned and oriented in a three-dimensional space. The subjects flew through rings continuously, acquiring as many as 11 consecutive rings within a five-minute period. In total, the study group successfully acquired over 85% of presented targets. These results affirm the effective, three-dimensional control of our motor imagery based BCI system, and suggest its potential applications in biological navigation, neuroprosthetics, and other applications.

Understanding the neural mechanisms responsible for human social interactions is difficult, since the brain activities of two or more individuals have to be examined simultaneously and correlated with the observed social patterns. We introduce the concept of hyper-brain network, a connectivity pattern representing at once the information flow among the cortical regions of a single brain as well as the relations among the areas of two distinct brains. Graph analysis of hyper-brain networks constructed from the EEG scanning of 26 couples of individuals playing the Iterated Prisoner's Dilemma reveals the possibility to predict non-cooperative interactions during the decision-making phase. The hyper-brain networks of two-defector couples have significantly less inter-brain links and overall higher modularity—i.e., the tendency to form two separate subgraphs—than couples playing cooperative or tit-for-tat strategies. The decision to defect can be “read” in advance by evaluating the changes of connectivity pattern in the hyper-brain network.

It is of wide interest to study the brain activity that correlates to the control of Brain-Computer Interface (BCI). In the present study, we have developed an approach to image the cortical rhythmic modulation associated with motor imagery using minimum-norm estimates in the frequency domain (MNEFD). The distribution of cortical sources of mu activity during online control of BCI was obtained with the MNEFD. Contralateral decrease (event-related desynchronization, ERD) and ipsilateral increase (event-related synchronization, ERS) are localized in the sensorimotor cortex during online control of BCI in a group of human subjects. Statistical source analysis revealed that maximum correlation with movement imagination is localized in sensorimotor cortex.

When combined, the results highlight the feasibility and efficacy of combined rTMS  +  BCI for motor recovery, demonstrated by increased ipsilesional motor activity and improvements in behavioral function for the real rTMS  +  BCI condition in particular. Our findings also demonstrate the utility of BCI training alone, as shown by behavioral improvements for the sham rTMS  +  BCI condition. This study is the first to evaluate combined rTMS and BCI training for motor rehabilitation and provides a foundation for continued work to evaluate the potential of both rTMS and virtual reality BCI training for motor recovery after stroke.

Brain-computer interface (BCI) systems allow users to interact with their environment by bypassing muscular control to tap directly into the users’ thoughts. In the present study, we investigate the role of prior experience with yoga and meditation, examples of formalized mind-body awareness training (MBAT), in learning to use a one-dimensional sensorimotor rhythm based BCI. Thirty-six human subjects volunteered to participate in two different cohorts based on past experience with MBAT — experienced MBAT practitioners and controls. All subjects participated in three BCI experiments to achieve competency in controlling the BCI system. The MBAT cohort achieved BCI competency significantly faster than the control cohort. In addition, the MBAT cohort demonstrated enhanced ability to control the system on various measures of BCI performance and improved significantly more over time when compared to control. Our work provides insight into valuable strategies for reducing barriers to BCI fluency that limit the more widespread use of these systems.

In this study we measured simultaneously by EEG hyperscannings the neuroelectric activity in 6 couples of subjects during the performance of the "Chicken's game", derived from game theory. The simultaneous recording of the EEG in couples of interacting subjects allows to observe and model directly the neural signature of human interactions in order to understand the cerebral processes generating and generated by social cooperation or competition. Results suggested that the one of the most consistently activated structure in this particular social interaction paradigm is the left orbitofrontal cortex. Connectivity results also showed a significant involvement of the orbitofrontal regions of both hemispheres across the observed population. Taken together, results confirms that the study of the brain activities in humans during social interactions can take benefit from the simultaneous acquisition of brain activity during such interaction.