This study examined the sensitivity of heart rate, skin conductance, and respiration rate as measures of mental workload in a simulated driving environment. Workload was systematically manipulated by using increasingly difficult levels of a secondary cognitive task. In a sample of 121 young adults, heart rate increased incrementally with increasing task demand. Significant elevations in skin conductance and respiration rate were also observed. At the lower levels of added workload, secondary task performance was nearly perfect and changes in indices of driving performance were negligible. At the highest level of workload, all three physiological measures appeared to plateau, and a subtle drop in simulated driving performance became detectable. Taken together, the pattern of results indicates that physiological measures can be sensitive to changes in workload before the appearance of clear decrements in driving performance. These findings further highlight a role for physiological monitoring as a means to measure mental workload in product design and functionality research. They also support work exploring the potential for incorporating physiological measures of driver workload and attentional state in future safety systems.

These findings increase the confidence with which these measures may be applied to assess relative differences in mental workload when developing and optimizing human machine interface (HMI) designs and in exploring their potential role in advanced workload detection and augmented cognition systems.

Today, and possibly for a long time to come, the full driving task is too complex an activity to be fully formalized as a sensing-acting robotics system that can be explicitly solved through model-based and learning-based approaches in order to achieve full unconstrained vehicle autonomy. Localization, mapping, scene perception, vehicle control, trajectory optimization, and higher-level planning decisions associated with autonomous vehicle development remain full of open challenges. This is especially true for unconstrained, real-world operation where the margin of allowable error is extremely small and the number of edge-cases is extremely large. Until these problems are solved, human beings will remain an integral part of the driving task, monitoring the AI system as it performs anywhere from just over 0% to just under 100% of the driving. The governing objectives of the MIT Advanced Vehicle Technology (MIT-AVT) study are to (1) undertake large-scale real-world driving data collection that includes high-definition video to fuel the development of deep learning based internal and external perception systems, (2) gain a holistic understanding of how human beings interact with vehicle automation technology by integrating video data with vehicle state data, driver characteristics, mental models, and self-reported experiences with technology, and (3) identify how technology and other factors related to automation adoption and use can be improved in ways that save lives. In pursuing these objectives, we have instrumented 23 Tesla Model S and Model X vehicles, 2 Volvo S90 vehicles, 2 Range Rover Evoque, and 2 Cadillac CT6 vehicles for both long-term (over a year per driver) and medium term (one month per driver) naturalistic driving data collection. Furthermore, we are continually developing new methods for analysis of the massive-scale dataset collected from the instrumented vehicle fleet. The recorded data streams include IMU, GPS, CAN messages, and high-definition video streams of the driver face, the driver cabin, the forward roadway, and the instrument cluster (on select vehicles). The study is on-going and growing. To date, we have 122 participants, 15,610 days of participation, 511,638 miles, and 7.1 billion video frames. This paper presents the design of the study, the data collection hardware, the processing of the data, and the computer vision algorithms currently being used to extract actionable knowledge from the data. 01 231 4523 67 89 8 %& 'ÿ )*+ ,-,.,*/ÿ 0123 45 1 '142-,5 ,67ÿ 8+ *97 :; <=>ÿ @AB; CDÿ ; AE =F; GH ÿIJ KFL; M NM OFB; ÿ =F>DH ÿPQR SPT ULM VGLDH ÿPWW XGCM NY GDH ÿWZ [M Y GDÿ =LM VGBH ÿQPPR SI\ XM =GAÿ ] LF@GDH ÿJPPÿa b b a cd :; <=>ÿ =F; Fÿ NAY Y GN; M ABÿ M Dÿ ABeAM Bef ÿ :; F; M D; M NDÿ

Data from on-road and simulation studies were compared to assess the validity of measures generated in the simulator. In the on-road study, driver interaction with three manual address entry methods (keypad, touch screen and rotational controller) was assessed in an instrumented vehicle to evaluate relative usability and safety implications. A separate group of participants drove a similar protocol in a medium fidelity, fixed-base driving simulator to assess the extent to which simulator measures mirrored those obtained in the field. Visual attention and task measures mapped very closely between the two environments. In general, however, driving performance measures did not differentiate among devices at the level of demand employed in this study. The findings obtained for visual attention and task engagement suggest that medium fidelity simulation provides a safe and effective means to evaluate the effects of in-vehicle information systems (IVIS) designs on these categories of driver behaviour. STATEMENT OF RELEVANCE: Realistic evaluation of the user interface of IVIS has significant implications for both user acceptance and safety. This study addresses the validity of driving simulation for accurately modelling differences between interface methodologies by comparing results from the field with those from a medium fidelity, fixed-base simulator.