Combining Electroencephalograph and Functional Near Infrared Spectroscopy to Explore Users’ Mental Workload

Hirshfield, Leanne M.; Chauncey, Krysta; Gulotta, Rebecca; Girouard, Audrey; Solovey, Erin Treacy; Jacob, Robert J. K.; Sassaroli, Angelo; Fantini, Sergio

doi:10.1007/978-3-642-02812-0_28

Cited by 50 publications

(41 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…As it was told before this requires further study because this can be text size specific. 12 Correlation with constant functions cannot be mathematically determined. …”

Section: Methodsmentioning

confidence: 99%

Practical Neurophysiological Analysis of Readability as a Usability Dimension

Oliveira

Guimarães

2013

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. This paper discusses opportunities and feasibility of integrating neurophysiologic analysis methods, based on electroencephalography (EEG), in the current landscape of usability evaluation methods. The rapid evolution and growing availability of low-cost, easier to use devices and the accumulated knowledge in feature extraction and processing algorithms allow us to foresee the practicality of this integration. The work presented in this paper is focused on reading and readability, identified as a key element of usability heuristics, and observable in the neurophysiologic signals' space. The experiments are primarily designed to address the discrimination of the reading activity (silent, attentive and continuous) and the verification of decreasing readability, associated with the user's mental workload analysis. The results obtained in the series of experiments demonstrate the validity of the approach for each individual user, and raise the problem of intersubject variability and the need for designing appropriate calibration procedures for different users. Keywords. Usability analysis, neurophysiologic signals, EEG IntroductionThe current usability evaluation methods range from interpretative to predictive, the former based on the observation and study of the actual use of an artifact during its development cycle, and the latter exploring external analyses performed by experts equipped with standards, heuristics and modeling techniques [1]. The methods capture either the behavior and perceptions of users or the interactive attributes of the artifact, and converge to evaluation conclusions based on the qualitative or quantitative analysis of empirically collected data. Alternative, or complementary, methods based in the measurement of physical and physiological signals of the human user (e.g. eye-movements, heart rate (HR) and heart rate variation (HRV), skin conductance (SC), or electroencephalography (EEG)) have been used more frequently in contexts with critical requirements for human performance [2], and tested in dedicated labs, as opposed to the use of the former empirical methods, typically adopted by usability labs participating in the design and development of interactive artifacts for the general user or consumer.The evolution of the technological landscape leads us reassess the opportunities for expanding and improving the set of tools for usability evaluation. First, capture devices are cheaper, more reliable, less intrusive, and usable with increasing autonomy. Examples of this evolution are HR or SC measurement devices, which have become portable and wireless and even EEG systems have left the controlled conditions of clinical settings (see for example, the design of dry electrode devices [3]. Second, the capacity to process these signals evolved dramatically, both in computing power and in the understanding of the algorithms that extract meaning from the human data.As a result of this evolution, we can envision a feasible integration of human physical and physiological information in comm...

show abstract

“…As it was told before this requires further study because this can be text size specific. 12 Correlation with constant functions cannot be mathematically determined. …”

Section: Methodsmentioning

confidence: 99%

Practical Neurophysiological Analysis of Readability as a Usability Dimension

Oliveira

Guimarães

2013

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

“…In other laboratories, a range of studies measuring cognitive load in the brain with functional near infrared spectroscopy have recently been completed [5,7,8,9,13,14]. Two of these studies are particularly relevant to decision-making and the building and maintaining of situation awareness in a contested information environment and are described in the following paragraphs.…”

Section: Malware and Working Memorymentioning

confidence: 99%

Decision-making and emotions in the contested information environment

Haas¹,

Hirshfield²,

Ponangi³

et al. 2013

ICST Transactions on Security and Safety

View full text Add to dashboard Cite

Future conflicts will necessitate the ability to conduct effective military operations in a contested information environment. The building and maintaining of robust situational awareness, protection of decision-making effectiveness of individuals and teams, fighting through information attacks from both in, and through, the cyberspace domain, will be essential. Increasing the knowledge of the mechanisms involved in degrading task performance and decision-making during cyber attacks will enable the development of advanced human-centered defensive techniques that aid fight-through capability. In this position paper, the development and evaluation of software that simulates realtime and persistent manipulation of the information environment is discussed. Results of the evaluation indicated that the task performance of a team of decision-makers performing collaborative tasks could be degraded through real-time manipulation of cyberspace content and operation. The paper concludes with a discussion of focus and direction for future research and development. It is suggested that the building of a deeper understanding of the perceptual and cognitive factors that are significant in the relationship between information environment manipulation and reduction in task performance is required. This understanding will aid in the defence of cyberspace attacks, will aid in fight through and mission assurance, and will aid the Information Operations community.

show abstract

“…Recently, two studies of concurrent assessment of vascular based imaging and electrophysiological responses of neonatal seizure (Cooper et al, 2011) and infant language acquisition (Telkemeyer et al, 2011) have been carried out with combined EEG and fNIR. Other studies of the simultaneous inegrated use of the two methodologies include the measurement of workload states (Hirshfield et al, 2009), mental stress (Ishii et al, 2008), during epileptic discharges (Machado et al, 2011), in auditory sensory gating (Ehlis et al, 2009). …”

Section: Simultaneous Eeg-fnirmentioning

confidence: 99%

Functional Brain Imaging Using Non-Invasive Non-Ionizing Methods: Towards Multimodal and Multiscale Imaging

Karanasiou¹

2012

Neuroimaging - Methods

View full text Add to dashboard Cite

Combining Electroencephalograph and Functional Near Infrared Spectroscopy to Explore Users’ Mental Workload

Cited by 50 publications

References 10 publications

Practical Neurophysiological Analysis of Readability as a Usability Dimension

Practical Neurophysiological Analysis of Readability as a Usability Dimension

Decision-making and emotions in the contested information environment

Functional Brain Imaging Using Non-Invasive Non-Ionizing Methods: Towards Multimodal and Multiscale Imaging

Contact Info

Product

Resources

About