Intelligent In‐Vehicle Interaction Technologies

Abstract

Autonomous vehicles (AVs) will soon become a reality with almost every major automotive original equipment manufacturer (OEM) such as Tesla, BMW, Daimler, and big technology giants such as Google's Waymo and Apple Car pushing toward the full self-driving objective. According to the SAE J3016 taxonomy [1] of autonomous driving, there are six levels of automated driving systems ranging from level 0 (completely manual) to level 5 (full selfdriving [FSD]) automated systems that are expected to function in all geographic locations, all weather conditions, and under all conditions. The proposed benefits of intelligent vehicles include fewer road accidents, enhanced safety, reduced traffic congestion, effective commute time usage, and importantly enjoyable and comfortable ride. With increased autonomy, the drivers also assume the role of mere passengers who are engaged in nondriving activities and are unavailable to participate in traffic interactions. This would increase complexity in a mixed-autonomy traffic environment as interactions with pedestrians and cyclists are based on visual cues with the driver. Therefore, intelligent vehicles also need to autonomously interact with other traffic participants such as pedestrians and cyclists and other vehicles.Human-vehicle interaction (HVI) is closely related to the field of human-robot interaction (HRI). It entails the problem of understanding and shaping the interaction dynamics between humans and vehicles. Particularly, the domain of interaction involves the study of sensation, perception, information exchange, inference, and decision-making. [2] With increasing levels of automation, the driver will have more time and choice to perform various tasks other than driving and this opens new avenues for interaction. As a result, a growing number of sensors are being incorporated into the vehicles to understand the driver's and/or passenger's actions, emotions, and personal choices to offer the precise functionalities and services for an enjoyable ride. [3] Figure 1 shows the schematic of in-vehicle interaction consisting of various interactive interfaces and sensing modalities present in the vehicle as well as some modes of interaction such as gestures, speech, and eye gaze.The advances in HVI have been presented in previous review articles, which have mainly focused on the detection of particular characteristics for driving assistance such as driver attention detection, [4] emotion recognition, [5] drowsiness detection, [6] mental workload, [7] and so on. A few other articles have reviewed the interior designs of AVs to better support and interact with drivers and passengers. [8,9] Likewise, the user interfaces (UIs) and user experience (UX) of vehicle interiors have been studied in context with manual as well as automated driving. [10] A number of previous works have also studied the interaction with the external

Evaluation of Multimodal and Multi-Staged Alerting Strategies for Forward Collision Warning Systems

“…The haptic channel has similar utility to the auditory channel warnings [ 4 ], and both are used in combination to provide perceptible warnings to the driver in high-noise environments. The haptic warning alerts the driver through vibration signals generated by the seat, seat belt, steering wheel, and foot pedals.…”

“…The multimodal warning is to convey the information of safety, efficiency, and service of the intelligent connected vehicle to the driver in a timely and clear manner through different sensory channels of the driver [ 4 ]. The advantage is more evident in the fact that multimodal warning can also be delivered to the driver through tactile and auditory redundant channels when the driver’s eyes deviate from the interface of warning [ 5 ].…”

Electronic Waste Reduction Through Devices and Printed Circuit Boards Designed for Circularity

“…The composition of WPCB may vary with the design, functionality, manufacturing route and application. For example, the planar PCBs are sufficient for most EEEs, but emerging applications such as wearable electronics, vehicles with interactive interiors and robotics require conformable and flexible PCBs (FPCBs) [35][36][37][38][39]. Typically, WPCBs comprise a mixture of materials that can be grouped into nonferrous and ferrous metals and plastics [14].…”

Flexible Tactile Sensors Using AlN and MOSFETs Based Ultra-Thin Chips

“…NSPIRED by human skin, the smart sensors and electronic skin (e-Skins) are being explored for advancements in applications such as human-machine interaction, robotics, interactive vehicles, and wearables systems for health monitoring [1][2][3][4][5][6][7]. In this regard, various sensing systems have been widely studied using capacitive, piezoelectric, triboelectric, piezoresistive, inductive, optical mechanisms, and their combinations [6,[8][9][10][11][12][13][14].…”