The Current Research of Spatial Cognitive Evaluation and Training With Brain–Computer Interface and Virtual Reality

Zhou, Yanhong; Dong, Wen; Lu, Hangjun; Wang, Yao; Liu, Yijun; Qian, Weiwei; Yuan, Jingpeng

doi:10.3389/fnins.2019.01439

Cited by 13 publications

(5 citation statements)

References 58 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, feasibility studies exist and strong correlations have already been found between real world and virtual navigational deficits (Cushman et al, 2008;Byagowi and Moussavi, 2012). The use of VR in spatial cognition has been growing rapidly, mainly because of its potential applications in the training and diagnosis of mild cognitive impairment (Allison et al, 2016;Cogné et al, 2017;Diersch and Wolbers, 2019;Ijaz et al, 2019;Kim et al, 2019;Zhou et al, 2020). This makes VR an interesting and promising tool to study, assess and train spatial cognition.…”

Section: Introductionmentioning

confidence: 99%

Presence Promotes Performance on a Virtual Spatial Cognition Task: Impact of Human Factors on Virtual Reality Assessment

Maneuvrier

Decker

Ceyte

et al. 2020

Front. Virtual Real.

View full text Add to dashboard Cite

The use of virtual reality in spatial cognition evaluation has been growing rapidly, mainly because of its potential applications in the training and diagnosis of cognitive impairment and its ability to blend experimental control and ecological validity. However, there are still many gray areas on virtual reality, notably on the sense of presence and its complex relationship to task performance. Performance in VR is often suggested to be influenced by other human factors including, amongst others, cybersickness, gender, video game experience, and field dependence. Would an individual experiencing more presence systematically show better performance? This study aimed to be part of a framework of virtual reality as this question is fundamental for rigorous assessment and diagnostics, and particularly in the spatial cognition field. Forty-eight healthy young subjects were recruited to take part in a virtual spatial cognition evaluation. Spatial cognition performance, along with their level of presence, cybersickness, video game experience, gender and field dependence, were measured. Matrix correlations were used, along with linear regressions and mediation analysis. Results show that presence promoted performance on the spatial cognition evaluation, while cybersickness symptoms hindered it, notably among women. The presence-performance relationship was not mediated by other human factors. Video game experience significantly predicted both sense of presence and cybersickness, the latter two being negatively correlated. Even if women experienced more negative symptoms than men, gender appears less informative than cybersickness and video game experience. Field dependence was not associated with any other variable. Results are discussed by confronting two theories of cognition (representational vs. ecological), highlighting that virtual reality is not a simple transposition of reality but truly a new paradigm with its own biases favoring some individuals more than others, and that some human factors have to be controlled for rigorous uses of virtual environments, particularly for spatial cognition evaluation.

show abstract

Section: Introductionmentioning

confidence: 99%

Presence Promotes Performance on a Virtual Spatial Cognition Task: Impact of Human Factors on Virtual Reality Assessment

Maneuvrier

Decker

Ceyte

et al. 2020

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…The measurement device can be integrated into our comprehensive assessment system as prior research also combined it with a VR headset (Ashiri et al, 2021 ). Similarly, incorporating an electroencephalogram (EEG) device could clarify the changes of activities in the parietal cortex in real time, which is directly related to the spatial cognitive function (Sack, 2009 ; Zhou et al, 2020 ). Adding these measures to our novel assessment system of posture and eye movements would lead us to understand the vestibular and spatial cognitive functions precisely in each VR environment.…”

Section: Discussionmentioning

confidence: 99%

Linking cognitive functioning and postural balance control through virtual reality environmental manipulations

Imaoka

Hauri

Flury

et al. 2022

Front. Aging Neurosci.

View full text Add to dashboard Cite

BackgroundDementia is becoming a relevant problem worldwide. A simple screening at an early stage will be important to detect the risk of developing dementia. Vestibular dysfunction is likely to be associated with cognitive impairment. Since head-mounted display (HMD) virtual reality (VR) technology has the potential to activate the vestibular function, assessing postural sway with visual stimulation using HMD VR technology could be potentially useful for dementia screening.ObjectiveThe purpose of this study is to evaluate the effect of HMD-based VR visual stimuli on posture in older adults and the relationship between the stimulated body sway behaviors and cognitive performance.MethodUsing a cross-sectional study design, we investigated the effect of an optokinetic design-based room with stripes (OKR) VR environment oscillating forwards and backwards at 23/60Hz. Center of pressure (COP) displacement was measured in older adults aged 65 years and over in the OKR VR environment. The frequency response of COP was compared to the cognitive performance of the Montreal Cognitive Assessment (MoCA).Results20 healthy older adults (70.4 ± 4.9 years; 27.2 ± 1.6 MoCA score) and 3 people with mild cognitive impairment (74.7 ± 4.0 years; 20.3 ± 2.1 MoCA score) were assessed. The results reveal that the oscillating OKR VR environment induced different postural sway in the anterior-posterior direction in the real world. Correlation analysis shows that the cognitive test score was associated with the frequency response of stimulated postural sway in the anterior-posterior direction (frequency Band 1 of 0−0.5Hz related to the visual and vestibular systems: rs = 0.45, P = 0.03).ConclusionOutcomes would suggest that a potential link may emerge between cognition and posture when the HMD-based VR visual stimuli are applied. The simple screening of stimulated postural sway could explain cognitive functioning. Further studies are warranted to clarify the vestibular system and spatial cognitive function more specifically in the proposed assessment system.

show abstract

“…So more relevant EEG signals can be collected to verify the universality of the method proposed in this paper. In addition, it is also a good practice to effectively evaluate spatial cognition in virtual environments [52][53][54][55]. At the same time, our proposed model aims to verify the effectiveness of cognitive training and can be applied to clinical medicine.…”

Section: The Clinical Application Value Of the Mhcnnmentioning

confidence: 99%

Task-State EEG Signal Classification for Spatial Cognitive Evaluation Based on Multiscale High-Density Convolutional Neural Network

Dong

Tang

et al. 2022

IEEE Trans. Neural Syst. Rehabil. Eng.

View full text Add to dashboard Cite

In this study, a multi-scale high-density convolutional neural network (MHCNN) classification method for spatial cognitive ability assessment was proposed, aiming at achieving the binary classification of task-state EEG signals before and after spatial cognitive training. Besides, the multi-dimensional conditional mutual information method was used to extract the frequency band features of the EEG data. And the coupling features under the combination of multi-frequency bands were transformed into multi-spectral images. At the same time, the idea of Densenet was introduced to improve the multi-scale convolutional neural network. Firstly, according to the discreteness of multispectral EEG image features, two-scale convolution kernels were used to calculate and learn useful channel and frequency band feature information in multispectral image data. Secondly, to enhance feature propagation and reduce the number of parameters, the dense network was connected after the multi-scale convolutional network, and the learning rate change function of the stochastic gradient descent algorithm was optimized to objectively evaluate the training effect. The experimental results showed that compared with the classical convolution neural network (CNN) and multi-scale convolution neural network, the proposed MHCNN had better classification Manuscript received November 12, 2021.

show abstract

The Current Research of Spatial Cognitive Evaluation and Training With Brain–Computer Interface and Virtual Reality

Cited by 13 publications

References 58 publications

Presence Promotes Performance on a Virtual Spatial Cognition Task: Impact of Human Factors on Virtual Reality Assessment

Presence Promotes Performance on a Virtual Spatial Cognition Task: Impact of Human Factors on Virtual Reality Assessment

Linking cognitive functioning and postural balance control through virtual reality environmental manipulations

Task-State EEG Signal Classification for Spatial Cognitive Evaluation Based on Multiscale High-Density Convolutional Neural Network

Contact Info

Product

Resources

About