Target localization in local dense mapping using RGBD SLAM and object detection

Abstract

Summary Target localization in unknown environment is one of the development directions of mobile robots. Simultaneous localization and mapping (SLAM) can be used to build maps in unknown environments, but it has the problem of poor readability and interactivity. In this article, target detection and SLAM are combined to search and locate the target by using rich RGBD images information. The determined position in the global map is conducive to the follow‐up operation of the target by mobile robots. By establishing a local dense point cloud map of the target object, the current state of the target object is directly displayed, the readability of the map is improved, and the disadvantages of difficult understanding of the global sparse map and slow construction of the global dense map are avoided. A target localization algorithm under the framework of yolov4 is designed to apply in the process of SLAM global mapping. Our works are helpful for obtaining positions of objects in three‐dimensional space. The experimental results show that the time‐consuming of this method in dense mapping is reduced by 50%–70%, and the number of point clouds is also reduced by 60%–70%.

Genetic Algorithm-Based Trajectory Optimization for Digital Twin Robots

“…The project demonstrates that a trained robot can perform a given task even if it is currently in a state it has never been in before ( Matulis and Harvey, 2021 ). Liu et al proposed a digital-driven machining quality tracking and dynamic control method, which effectively solved the problems of low efficiency of quality problem traceability, poor timeliness and unpredictability of quality control in machining process ( Liu Y et al, 2021b ).…”

Intelligent Detection of Steel Defects Based on Improved Split Attention Networks

“…Good performance of ResNet on image recognition and localization tasks showed that characterisation depth is of central importance for many visual recognition tasks. In the following years, excellent feature extraction networks such as ResNeXt, DenseNet, RegNet, SEnet, SKNet, etc ( Xie et al, 2017 ; Liu X. et al, 2021 ; Liu et al, 2021b ; Liu et al, 2021c ; Liu et al, 2021d ; Sun et al, 2020c ; Sun et al, 2020d ). were successively proposed, constantly refreshing the accuracy rate of tasks such as image classification.…”

Attitude Stabilization Control of Autonomous Underwater Vehicle Based on Decoupling Algorithm and PSO-ADRC

“…Position control is the basis and key of the whole underwater navigation control of AUV ( Sun et al, 2020c ; Tao et al, 2021 ; Liu et al, 2022d ). Its position control accuracy is determined by the attitude control accuracy, and the attitude control error of AUV will amplify its position control error, so in order to ensure the high accuracy control of speed and position during underwater navigation, its attitude must be accurately controlled.…”