Vision-Based People Detection System for Heavy Machine Applications

Abstract

This paper presents a vision-based people detection system for improving safety in heavy machines. We propose a perception system composed of a monocular fisheye camera and a LiDAR. Fisheye cameras have the advantage of a wide field-of-view, but the strong distortions that they create must be handled at the detection stage. Since people detection in fisheye images has not been well studied, we focus on investigating and quantifying the impact that strong radial distortions have on the appearance of people, and we propose approaches for handling this specificity, adapted from state-of-the-art people detection approaches. These adaptive approaches nevertheless have the drawback of high computational cost and complexity. Consequently, we also present a framework for harnessing the LiDAR modality in order to enhance the detection algorithm for different camera positions. A sequential LiDAR-based fusion architecture is used, which addresses directly the problem of reducing false detections and computational cost in an exclusively vision-based system. A heavy machine dataset was built, and different experiments were carried out to evaluate the performance of the system. The results are promising, in terms of both processing speed and performance.

Restricted Deformable Convolution-Based Road Scene Semantic Segmentation Using Surround View Cameras

“…DeepLab-RDC-λ mIoU@val/test λ = 0 1 , dilation (2,2,2) 67.9/66.7 λ = 0, dilation (4,4,4) 69.4/λ = 0, dilation (6,6,6) 70 initialize the weights. Two GPUs are used to train the models on the original Cityscapes dataset the resolution of which is 1024 × 2048.…”

Real-Time Semantic Segmentation for Fisheye Urban Driving Images Based on ERFNet

“…The main issue with fisheye cameras is how to correctly handle distortion. Distortion is heterogeneous over the different fisheye image areas [9], being a function of both the radial angle and the distance between the principal point of the camera and the image points of the detected objects. This adds complexity to the training of CNNs, as they are forced to learn complicated features that allow the detection of objects with changing appearances depending on their position in the image in order to perform an accurate detection.…”

Untitled

“…Below is a diagram of working. In another work done, it was aimed to prevent occupational accidents by performing human detection with a fish-eye camera placed in front of heavy duty machines [3]. Object distortions from fish-eye cameras used to obtain a wide angle were the biggest challenge they faced.…”