A visual terrain classification method for mobile robots’ navigation based on convolutional neural network and support vector machine

Abstract

In this paper, a hybrid method based on deep learning is proposed to visually classify terrains encountered by mobile robots. Considering the limited computing resource on mobile robots and the requirement for high classification accuracy, the proposed hybrid method combines a convolutional neural network with a support vector machine to keep a high classification accuracy while improve work efficiency. The key idea is that the convolutional neural network is used to finish a multi-class classification and simultaneously the support vector machine is used to make a two-class classification. The two-class classification performed by the support vector machine is aimed at one kind of terrain that users are mostly concerned with. Results of the two classifications will be consolidated to get the final classification result. The convolutional neural network used in this method is modified for the on-board usage of mobile robots. In order to enhance efficiency, the convolutional neural network has a simple architecture. The convolutional neural network and the support vector machine are trained and tested by using RGB images of six kinds of common terrains. Experimental results demonstrate that this method can help robots classify terrains accurately and efficiently. Therefore, the proposed method has a significant potential for being applied to the on-board usage of mobile robots.

Hydrocode Investigations of Terminal Astroballistics Problems during the Hypothetical Future Planetary Defense System’s Space Mission

“…The details of the first phase concern the remote recognition of the asteroid’s shape and composition using image spectrometry and autonomous sensors on robots for precise shape scanning and surface morphology. Currently, the problems of the visual classification of terrain for robot navigation based on AI methods are being considered [ 23 ]. Further sub-phases will determine the mean density and mass, sampling to determine the local porosity, and possibly the strength of the mixtures of components of the asteroid material.…”

A terrain segmentation method based on pyramid scene parsing-mobile network for outdoor robots

“…As shown in Figure 7, we have made a more detailed division of outdoor terrains compared with Zhang et al 1 and Wang et al. 2 Based on the characteristics of common working spaces for outdoor robots, in HDU-Terrain Dataset, the feasible terrains were divided into grass, woodland, mud, cement, masonry, and bumpy road. Bumpy road includes gravel roads and uneven hard roads, which have a high traffic cost for wheeled robots.…”

“…In 2020, a low-risk terrain recognition strategy was proposed to classify the outdoor terrains in Zhang et al 1 to make up for the deficiency of manual feature extraction and high misjudgment rate in risky terrains. In Wang et al, 2 a visual terrain classification method based on a convolutional neural network (CNN) and support vector machine was designed, focusing on terrain segmentation and its application to autonomous navigation of an outdoor robot.…”

Fault Diagnosis in Robot Manipulators Using SVM and KNN

“…It requires t-times training, which in its turn needs a lot of computation (which is CPU-intensive). The SVM algorithm can be hybridized with other algorithms such as the Convolutional Neural Network (CNN) [27]. The aim of the combination is to achieve an accurate diagnosis.…”