Autonomous Braking and Throttle System: A Deep Reinforcement Learning Approach for Naturalistic Driving

Abstract

Autonomous Braking and Throttle control is key in developing safe driving systems for the future. There exists a need for autonomous vehicles to negotiate a multi-agent environment while ensuring safety and comfort. A Deep Reinforcement Learning based autonomous throttle and braking system is presented. For each time step, the proposed system makes a decision to apply the brake or throttle. The throttle and brake are modelled as continuous action space values. We demonstrate 2 scenarios where there is a need for a sophisticated braking and throttle system, i.e when there is a static obstacle in front of our agent like a car, stop sign. The second scenario consists of 2 vehicles approaching an intersection. The policies for brake and throttle control are learned through computer simulation using Deep deterministic policy gradients. The experiment shows that the system not only avoids a collision, but also it ensures that there is smooth change in the values of throttle/brake as it gets out of the emergency situation and abides by the speed regulations, i.e the system resembles human driving.

Intelligent Control of Robots with Minimal Power Consumption in Pick-and-Place Operations

“…Together with unsupervised and supervised learning approaches, deep reinforcement learning (RL) is now considered the most progressive machine-learning methodology, during which the system is forcibly trained using a "stimulus-response" principle [37][38][39][40][41]. Unlike the previous two, RL does not rely on a static dataset, but operates in a dynamic environment and learns from collected experiences.…”

A Collision Avoidance Strategy Based on Entropy-Increasing Risk Perception in a Vehicle–Pedestrian-Integrated Reaction Space

“…Collision avoidance research must give consideration to both pedestrians and vehicles as they are major participants within a traffic system. With AI algorithms, some studies utilized convolutional neural networks to predict behavior trajectories [23][24][25][26], while others used deep reinforcement-learning algorithms to improve the accuracy of trajectory predictions [27][28][29][30][31]. Pedestrian behavior on the road is highly random, significantly increasing the challenge of collision avoidance, especially when uncertain factors arise during emergencies and increase the risk of collisions.…”

Autonomous Braking System Using Linear Actuator

“…As a result, we developed an automated braking system in which the ultrasonic sensor is replaced by a lidar sensor. The lidar sensor emits rapid laser signals, sometimes up to 150,000 pulses per second, and provides both the location and a three-dimensional image of objects in front of the automobile [5]. The system is controlled by the microcontroller (Arduino UNO), which in turn controls the linear actuator that applies the brake.…”