Objective To investigate speech features, human–machine alarms, and operator–system interaction for the estimation of cognitive workload in full-scale realistic simulated scenarios. Background Theories and models of cognitive workload are critical for the design and evaluation of human–machine systems. Unfortunately, there are very few nonintrusive cognitive workload measures available for realistic dynamic human–machine interaction. Method The study was conducted in a full-scope control room research simulator of an advanced nuclear reactor. Six crews, each consisting of three operators, participated in 12 scenarios. The operators rated their workload every second minute. Machine learning algorithms were trained to estimate operators’ workload based on crew communication, operator–system interaction, and system alarms. Results Random Forest (RF) utilizing speech and system features achieved an accuracy of 67% on test data. Utilizing speech features only, the accuracy achieved was 63%. The most important speech features were pitch, amplitude, and articulation rate. A 61% accuracy was achieved when alarms and operator–system interaction features were used. The most important features were the number of alarms and amount of operator–system interaction. Accuracy for algorithms trained for each operator ranged from 39% to 98%, with an average of 72%. For a majority of analyses performed, RF and extreme gradient boosting (XGB) outperformed other algorithms. Conclusion The results demonstrate that the features investigated and machine learning models developed provide a potential for the dynamic nonintrusive measurement of cognitive workload. Application The approach presented can be developed for nonintrusive workload measurement in real-world human–machine applications, simulator-based training, and research.
No abstract
Data reconciliation is technique for reducing measurement uncertainty by adjusting measured data to comply with a first-principles process model, most importantly with mass and energy balances. It also provides estimates for modelled unmeasurable process variables and estimates for the uncertainties of the computed values. For computing these estimates the process model has to include estimates of measurement uncertainties defined a priori. A priori consideration of all potential sources of uncertainty is far from trivial. This paper discusses a data-driven approach of uncertainty evaluation, based on identifying and subtracting variability modes affecting multiple measurements. Possible bias in the measurements is not considered. The approach is applied to evaluate the uncertainties of estimates computed with a data reconciliation model of a turbine section of a nuclear power plant.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.