The aim of this paper is to explore a new multimodal Computer Aided Design (CAD) platform based on brain-computer interfaces and touch based systems. The paper describes experiments and algorithms for manipulating geometrical objects in CAD systems using touch-based gestures and movement imagery detected though brain waves. Gestures associated with touch based systems are subjected to ambiguity since they are two dimensional in nature. Brain signals are considered here as the main source to resolve these ambiguities. The brainwaves are recorded in terms of electroencephalogram (EEG) signals. Users wear a neuroheadset and try to move and rotate a target object on a touch screen. As they perform these actions, the EEG headset collects brain activity from 14 locations on the scalp. The data is analyzed in the time-frequency domain to detect the desynchronizations of certain frequency bands (3–7Hz, 8–13 Hz, 14–20Hz 21–29Hz and 30–50Hz) in the temporal cortex as an indication of motor imagery.
Simple line drawings and 2D sketches are commonly used by humans to convey their ideas about a particular shape or shapes in an image. These approximations of shapes are effective means for visual communication and artistic practices. The idea of shape abstraction can be derived from such approximations of shapes, which considers their most important and salient features. The key idea behind shape abstraction is to extract a simplified version of a shape that preserves the salient characteristics of the input shape. In this paper, we introduce and analyze a slightly different and novel facet of abstraction, which we call “partial to full shape recognition” of two dimensional shapes (line drawing and sketches). The key idea is recognizing partial 2D shapes that leads to recognition of full shape utilizing the theory of recognition-by-components (RBC) and geons (human shape perception). We segment the 2D shapes according to the non-accidental relations provided by RBC and analyze the electroencephalogram (EEG) brain activity of subjects using a brain computer interface (BCI) to gain knowledge of human understanding of such relations pertaining to specific partial to full shape correspondence.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.