Multimodal imaging sensor based on lidar for advanced perception tasks

Abstract

Automated systems increase their requirements in all fields, tightening their performance requirements in aspects like reliability, and ease of manipulation. Within this communication, we will present the development of a compact perception unit which includes a 3D lidar, RGB and thermal imaging for advanced perception purposes. The proposed unit intends to solve the usual hardware problems that software developers intend to solve in field applications. The basic features and performance of the system will be presented, and the applicability of the multimodal sensing approach presented to different applications in security, autonomous vehicles, and other application areas will be overviewed with examples.