This paper presents a vision-based people detection system for improving safety in heavy machines. We propose a perception system composed of a monocular fisheye camera and a LiDAR. Fisheye cameras have the advantage of a wide field-of-view, but the strong distortions that they create must be handled at the detection stage. Since people detection in fisheye images has not been well studied, we focus on investigating and quantifying the impact that strong radial distortions have on the appearance of people, and we propose approaches for handling this specificity, adapted from state-of-the-art people detection approaches. These adaptive approaches nevertheless have the drawback of high computational cost and complexity. Consequently, we also present a framework for harnessing the LiDAR modality in order to enhance the detection algorithm for different camera positions. A sequential LiDAR-based fusion architecture is used, which addresses directly the problem of reducing false detections and computational cost in an exclusively vision-based system. A heavy machine dataset was built, and different experiments were carried out to evaluate the performance of the system. The results are promising, in terms of both processing speed and performance.
In this paper we focus on improving the performance of people detection algorithm on fish-eye images in a safety system for heavy machines. Fish-eye images give the advantage of a very wide angle-of-view, which is important in the context of heavy machines. However, the distortions in fish-eye images present many difficulties for image processing. The underlying framework of the proposed detection system uses Histogram of Oriented Gradients (HOG) and Support Vector Machine (SVM). By analyzing the effect of distortions in different regions in the field-of-view and by adding artificial distortions in the training process of the binary classifier, we can obtain better detection results on fish-eye images.
In this paper, we propose a multi-sensors system to detect people in the context of construction sites using heavy machines. The system includes a LIght Detection And Ranging (Lidar) sensor and a fisheye camera. We present an effective method to determine regions of interest (ROI) on fisheye images using Lidar data, which can be used with different sensors configurations. A Deformable Part Model (DPM) approach is adapted and used as the main people detector on image. We also present a specific dataset built using the multi-sensor system mounted on a heavy machine for evaluation. Index Terms-Heavy machines, sensor fusion, pedestrian detection, deformable part model, fisheye, histogram of oriented gradients.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.