Authorized Traffic Controller Hand Gesture Recognition for Situation-Aware Autonomous Driving

Abstract

An authorized traffic controller (ATC) has the highest priority for direct road traffic. In some irregular situations, the ATC supersedes other traffic control. Human drivers indigenously understand such situations and tend to follow the ATC; however, an autonomous vehicle (AV) can become confused in such circumstances. Therefore, autonomous driving (AD) crucially requires a human-level understanding of situation-aware traffic gesture recognition. In AVs, vision-based recognition is particularly desirable because of its suitability; however, such recognition systems have various bottlenecks, such as failing to recognize other humans on the road, identifying a variety of ATCs, and gloves in the hands of ATCs. We propose a situation-aware traffic control hand-gesture recognition system, which includes ATC detection and gesture recognition. Three-dimensional (3D) hand model-based gesture recognition is used to mitigate the problem associated with gloves. Our database contains separate training and test videos of approximately 60 min length, captured at a frame rate of 24 frames per second. It has 35,291 different frames that belong to traffic control hand gestures. Our approach correctly recognized traffic control hand gestures; therefore, the proposed system can be considered as an extension of the operational domain of the AV.

Research on action recognition algorithm of aging square dance app based on image deep learning

“…As an important part of human body language, action has the advantages of large amount of information and intuition, and is widely used in automobile [8], virtual reality [9], medical care [10] and other fields, among which how to improve the accuracy and real-time of gesture recognition to obtain friendly interaction is particularly critical. However, with the influence of environment and illumination, the complexity of background information and so on, the recognition based on vision will have an impact on the results, and there are many places to be improved.…”

Gesture Recognition with Keypoint and Radar Stream Fusion for Automated Vehicles

“…For gesture recognition of police officers, related work processes camera image snippets [3] directly. Due to the advances in human body pose estimation [5,4], related approaches extract the body skeleton data from the images and perform gesture recognition on it [35,22,15]. For processing skeletons to predict the gesture, recurrent neural networks [35] or convolutional neural networks [22] are applied.…”

A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams

“…Outdoor interactions are those between autonomous vehicles and persons outside them, such as pedestrians. Most of the outdoor HAVI applications focus on the car-to-pedestrian interaction [ 22 , 23 ] and car-to-cyclist communication [ 24 ] for road safety purposes, but other applications have been explored, such as traffic control gestures recognition [ 25 ], where traffic control officers can request an autonomous vehicle to stop or turn with specific hand gestures.…”