Effects of Gesture-Based Interaction on Driving Behavior: A Driving Simulator Study Using the Projection-Based Vehicle-in-the-Loop

Abstract

Objective We observe the driving performance effects of gesture-based interaction (GBI) versus touch-based interaction (TBI) for in-vehicle information systems (IVISs). Background As a contributing factor to a number of traffic accidents, driver distraction is a significant problem for traffic safety. More specifically, visual distraction has a strong negative impact on driving performance and risk perception. Thus, the implementation of new interaction systems that use midair gestures to encourage glance-free interactions could reduce visual distraction among drivers. Methods In this experiment, participants drove a projection-based Vehicle-in-the-Loop. The projection-based technology combines a visual simulation with kinesthetic, vestibular, and auditory feedback from a car on a test track. While driving, participants used GBI or TBI to perform IVIS tasks. To investigate driving behavior related to critical driving situations and car-following maneuvers, vehicle data based upon longitudinal and lateral driving were collected. Results Participants reacted faster to critical driving situations when using GBI compared to TBI. For drivers using TBI, steering performance decreased and time headway to a preceding vehicle was higher. Conclusion Gestures provide a safe alternative to in-vehicle interactions. Moreover, GBI has fewer effects on driver distraction than TBI. Application Potential applications of this research include all in-vehicle interaction systems used by drivers.

I See Your Gesture: A VR-Based Study of Bidirectional Communication between Pedestrians and Automated Vehicles

“…It can be expected that the camera systems of future AVs will be able to detect a hand gesture. e use of driver gestures has previously been studied for the control of in-vehicle information systems [26,27] and maneuver-based AV control [28,29]. It has been found that hand gesture usage is effective for letting manually driven vehicles stop for pedestrians [30].…”

Road geometrical design out of standards: a preliminary study in a simulated context

“…Complete control of vehicle telemetry, pavement condition and main driver's psycho-physiological factors (Graichen et al, 2022).…”

Understanding the domain of driving distraction with knowledge graphs

“…proposed to reduce the distraction caused by conventional head-down displays in automobiles by keeping the glance on the road [43], and new "human-machine interaction" methods and designs have brought new vitality into distraction reduction [44,45]. Outside of vehicles, "roadside billboard" and "traffic sign" are common distractors [6,46,47], while "intersection", which could be subdivided into signalized and unsignalized ones, draws much attention with the complex traffic flow [48,49].…”