By aiming at addressing the left-turning problem of an autonomous vehicle considering the oncoming vehicles at an urban unsignallized intersection, a hierarchical reinforcement learning is proposed and a two-layer model is established to study behaviors of left-turning driving. Compared with the conventional decision-making models with a fixed path, the proposed multi-paths decision-making algorithm with horizontal and vertical strategies can improve the efficiency of autonomous vehicles crossing intersections while ensuring safety.
Navigation in complex urban environments is very difficult, mainly due to perceptual uncertainty caused by obstructions in the field of view. The perceptual uncertainty is mainly due to sensors obstructed by obstacles. This has a significant impact on the safety of autonomous vehicles. Existing approaches based on partially observable Markov decision processes or reinforcement learning for the uncertainty problem may lead to conservative planning and expensive computation. We propose caution-driven networks combined with distributional reinforcement learning fully parameterized quantile function, which termed Intrinsic caution module – fully parameterized quantile function (ICM-FQF). The method is also applied in the continuous action space. The method is used to evaluate two challenging scenarios, pedestrians crossing with occlusion and a unsignalized intersection with a limited field of view. The algorithm is trained and evaluated using the CARLA simulator. Compared to conventional RL algorithms, the method makes smarter decisions and reduces the rate of collisions.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.