Mobile Robot Application with Hierarchical Start Position DQN

Abstract

Advances in deep learning significantly affect reinforcement learning, which results in the emergence of Deep RL (DRL). DRL does not need a data set and has the potential beyond the performance of human experts, resulting in significant developments in the field of artificial intelligence. However, because a DRL agent has to interact with the environment a lot while it is trained, it is difficult to be trained directly in the real environment due to the long training time, high cost, and possible material damage. Therefore, most or all of the training of DRL agents for real-world applications is conducted in virtual environments. This study focused on the difficulty in a mobile robot to reach its target by making a path plan in a real-world environment. The Minimalistic Gridworld virtual environment has been used for training the DRL agent, and to our knowledge, we have implemented the first real-world implementation for this environment. A DRL algorithm with higher performance than the classical Deep Q-network algorithm was created with the expanded environment. A mobile robot was designed for use in a real-world application. To match the virtual environment with the real environment, algorithms that can detect the position of the mobile robot and the target, as well as the rotation of the mobile robot, were created. As a result, a DRL-based mobile robot was developed that uses only the top view of the environment and can reach its target regardless of its initial position and rotation.

Smart Reserve Planning Using Machine Learning Methods in Power Systems with Renewable Energy Sources

“…In order to reduce the spatial dimension, the pooling layer samples data from the preceding convolution layer. The two-dimensional feature is then mapped to the one-dimensional output data by the complete link layer [50].…”

A Novel Deep Dense Block-Based Model for Detecting Alzheimer’s Disease

“…Machine-learning (ML)-based systems have been successfully applied in fields such as energy [13], robotics [14] health [15], and transportation [16]. These s have demonstrated potential for assisting radiologists and physicians in the time tification and categorization of AD via computer-aided diagnosis (CAD) system Timely diagnosis and accurate analysis of brain atrophy are crucial, and the aut detection of brain atrophy can greatly contribute to these goals.…”

“…Machine-learning (ML)-based systems have been successfully applied in various fields such as energy [13], robotics [14] health [15], and transportation [16]. These systems have demonstrated potential for assisting radiologists and physicians in the timely identification and categorization of AD via computer-aided diagnosis (CAD) systems [17].…”

Alzheimer Teşhisi için Derin Öğrenme Tabanlı Morfometrik Analiz

“…Gelişmiş görüntüleme teknikleri (Aslan ve Çelebi, 2022), daha performanslı görüntü işleme araçları (Çalışkan ve ark., 2022), iyileştirilmiş makine öğrenimi teorileri ve son olarak derin öğrenme mimarisinin ortaya çıkışı bunu mümkün kıldı (Karaman ve ark., 2021;Pacal, 2022). Tıbbi görüntü işleme ve analizinde otomatik hastalık tespiti, hastalık kategorisi sınıflandırması, hastalık ilerlemesinin izlenmesi popüler araştırma konularıdır (Pacal ve Karaboga, 2021;Othman ve Aydin, 2022;Erkan, 2022). Tıbbi görüntüleri kullanan hastalık tespiti ve hastalık sınıflandırma problemlerine yönelik geleneksel yaklaşımlar, çeşitli özellik çıkarma ve sınıflandırma algoritmalarını benimsemiştir.…”