Multimodal Displays for Take-over in Level 3 Automated Vehicles while Playing a Game

Jeon, Myounghoon

doi:10.1145/3290607.3313056

Cited by 19 publications

(4 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Trust scores in the driving simulator study did not significantly differ among display conditions, although audiovisual conditions (non-speech with visual, speech with visual) led to numerically higher rating scores than visual alert only. Additionally, SA scores further suggest that both the nonspeech with visual and the speech with visual display conditions led to better user awareness of the driving environment, which is in line with previous studies about multimodal displays (Jeon, 2019;Liu, 2001;Petermeijer et al, 2017). Differences in score between the increase and decrease in automation events can be explained by a learning effect due to the order of the two events, as the decrease in automation event occurred after the increase in level for simulated runs.…”

Section: Discussionsupporting

confidence: 88%

“…Highly automated vehicles, defined by SAE International as level 4 vehicles (SAE Committee, 2014), are expected to reduce driver stress and increase productivity (Litman, 2020). Challenges exist in the adoption and acceptance of higher levels of autonomy in vehicles, revolving around safety concerns with the vehicles, and can be addressed through novel interactive displays for safe transitions in automation (Jeon, 2019), such as robot agents (Lee, Ko, Sanghavi, & Jeon, 2019) or augmented reality displays (von Sawitzky, Wintersberger, Riener, & Gabbard, 2019). Furthermore, researchers have suggested the use of adaptive auditory alerts (Šabić, Henning, & MacDonald, 2019), spatial sound (Petermeijer, Bazilinskyy, Bengler, & de Winter, 2017), or other auditory displays as ways to quickly provide feedback for drivers to takeover or respond to different vehicle states.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience

Nadri

Diggs

et al. 2021

Proceedings of the Human Factors and Ergonomics Society Annual

Self Cite

View full text Add to dashboard Cite

Highly automated driving systems are expected to require the design of new user-vehicle interactions. Sonification can be used to provide contextualized alarms and cues that can increase situation awareness and user experience. In this study, we examined user perceptions of potential use cases for level 4 automated vehicles in online focus group interviews (N=12). Also, in a driving simulator study, we evaluated (1) visual-only display; (2) non-speech with visual display; and (3) speech with visual display with 20 young drivers. Results indicated participants’ interest in the use cases and insight on desired functions in highly automated vehicles. Both audiovisual display conditions resulted in higher situation awareness for drivers than the visual-only condition. Some differences were found between the non-speech and speech conditions suggesting benefits of sonification for both driving and non-driving related auditory use cases. This study will provide guidance on sonification design for highly automated vehicles.

show abstract

Section: Discussionsupporting

confidence: 88%

Section: Introductionmentioning

confidence: 99%

Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience

Nadri

Diggs

et al. 2021

Proceedings of the Human Factors and Ergonomics Society Annual

Self Cite

View full text Add to dashboard Cite

show abstract

“…Literature has further indicated their importance within multimodal displays for vehicle control (23), and represented effective ways to improve multimodal redundancy and promote correct driver behavior (18). Additionally, evidence supports the idea that auditory displays can be useful in novel interfaces for autonomous vehicles to improve driver performance when taking over control of the vehicle (14,24).…”

Section: Ivaa Considerations For Hrgcs and Past Researchmentioning

confidence: 66%

Effects of Auditory Display Types and Acoustic Variables on Subjective Driver Assessment in a Rail Crossing Context

Nadri

Lee

Kekal

et al. 2021

Transportation Research Record

Self Cite

View full text Add to dashboard Cite

Highway-rail grade crossings (HRGCs) present multiple collision risks for motorists, suggesting the need for additional countermeasures to increase driver compliance. The use of in-vehicle auditory alerts (IVAAs) at HRGCs has been increasing, but there are limited standards or guidelines on how such alerts should be implemented. In the current study, we sought to investigate the effect of different auditory display variables, such as display type and acoustics, on subjective user assessments. We recruited 24 participants and asked them to rate 36 different IVAAs belonging to one of three display types (earcons—short synthetic tones, speech alerts, and hybrid alerts consisting of an earcon and speech) along 11 subjective ratings. Results showed that a hybrid alert led to better overall ratings for acceptance, safety, and semantic understanding when compared with earcon or speech alerts. Additional analyses revealed that semantic variables, such as speech order and gender, should be accounted for when designing IVAAs in an HRGC context. Hybrid IVAAs with spatial audio showed lower Urgency and Hazard level ratings. Findings of the current study can help inform the design of IVAAs for HRGCs.

show abstract

“…In particular, many novel designs explored visualizing health information using interactive light [17], digital assistants [18], ambient [19] and headsup displays [20] in the AV context. Modalities such as auditory [21][22][23][24][25][26], olfactory [27], gaze [28], and tactile [29] interactions have also been applied to improve driving experiences. Due to the prevalence of visual computing, augmented reality and virtual reality display techniques have also been increasingly utilized to facilitate various daily activities in the car, including entertainment [30], working [31], calling [32], etc.…”

Section: Introductionmentioning

confidence: 99%

Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous Vehicles

Zheng

Ren

2022

MTI

View full text Add to dashboard Cite

With the development of autonomous technology, the research into multimodal human-machine interaction (HMI) for autonomous vehicles (AVs) has attracted extensive attention, especially in automotive wellness. To support the design of HMIs for automotive wellness in AVs, this paper proposes a multimodal design framework. First, three elements of the framework were envisioned based on the typical composition of an interactive system. Second, a five-step process for utilizing the proposed framework was suggested. Third, the framework was applied in a design education course for exemplification. Finally, the AttrakDiff questionnaire was used to evaluate these interactive prototypes with 20 participants who had an affinity for HMI design. The questionnaire responses showed that the overall impression was positive and this framework can help design students to effectively identify research gaps and expand design concepts in a systematic way. The proposed framework offers a design approach for the development of multimodal HMIs for autonomous wellness in AVs.

show abstract

Multimodal Displays for Take-over in Level 3 Automated Vehicles while Playing a Game

Cited by 19 publications

References 7 publications

Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience

Novel Auditory Displays in Highly Automated Vehicles: Sonification Improves Driver Situation Awareness, Perceived Workload, and Overall Experience

Effects of Auditory Display Types and Acoustic Variables on Subjective Driver Assessment in a Rail Crossing Context

Developing a Multimodal HMI Design Framework for Automotive Wellness in Autonomous Vehicles

Contact Info

Product

Resources

About