Signal Processing Platform for Long-Range Multi-Spectral Electro-Optical Systems

Latinović, Nikola; Popadić, Ilija; Tomic, Branko; Simić, Aleksandar; Milanović, Petar; Nijemčević, Srećko; Peric, Miroslav; Veinović, Mladen

doi:10.3390/s22031294

Cited by 7 publications

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Each camera is connected with a Vlatacom Video Signal Processing (vVSP) platform [ 38 ] via appropriate interface board. The vVSP can capture and process video signals from various types of cameras and provide outputs as IP stream.…”

Section: Experiments Workflowmentioning

confidence: 99%

Deep Learning Based SWIR Object Detection in Long-Range Surveillance Systems: An Automated Cross-Spectral Approach

Pavlović

Milanović

Stanković

et al. 2022

Sensors

Self Cite

View full text Add to dashboard Cite

SWIR imaging bears considerable advantages over visible-light (color) and thermal images in certain challenging propagation conditions. Thus, the SWIR imaging channel is frequently used in multi-spectral imaging systems (MSIS) for long-range surveillance in combination with color and thermal imaging to improve the probability of correct operation in various day, night and climate conditions. Integration of deep-learning (DL)-based real-time object detection in MSIS enables an increase in efficient utilization for complex long-range surveillance solutions such as border or critical assets control. Unfortunately, a lack of datasets for DL-based object detection models training for the SWIR channel limits their performance. To overcome this, by using the MSIS setting we propose a new cross-spectral automatic data annotation methodology for SWIR channel training dataset creation, in which the visible-light channel provides a source for detecting object types and bounding boxes which are then transformed to the SWIR channel. A mathematical image transformation that overcomes differences between the SWIR and color channel and their image distortion effects for various magnifications are explained in detail. With the proposed cross-spectral methodology, the goal of the paper is to improve object detection in SWIR images captured in challenging outdoor scenes. Experimental tests for two object types (cars and persons) using a state-of-the-art YOLOX model demonstrate that retraining with the proposed automatic cross-spectrally created SWIR image dataset significantly improves average detection precision. We achieved excellent improvements in detection performance in various variants of the YOLOX model (nano, tiny and x).

show abstract

Section: Experiments Workflowmentioning

confidence: 99%

Deep Learning Based SWIR Object Detection in Long-Range Surveillance Systems: An Automated Cross-Spectral Approach

Pavlović

Milanović

Stanković

et al. 2022

Sensors

Self Cite

View full text Add to dashboard Cite

show abstract

Structure design and implementation of a two-axis four-gimbal electro-optical pod

Zhang,

Xi,

Zhang

et al. 2023

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

Multi-load, high stability and precision optoelectronic pods have become the development trend of pod technology applications. The two-axis four-gimbal electro-optical pod has the characteristics of high integration and stability. The research object of this project is a two-axis four-frame optoelectronic pod carried by helicopter. It can realize the transmission of active video and measurement control data through an airborne data chain. The system composition of the pod was introduced, and a mechanical structure model was established. To ensure rotational performance, a method for calculating the torque of the motor was provided, simulation of a main load-bearing structural part was conducted to ensure the structural strength. Finally, the stable accuracy was verified through testing. Design and analysis methods can provide some references for the design of two-axis four-frame pods.

show abstract

Object Tracking in SWIR Imaging Based on Both Correlation and Robust Kalman Filters

Pavlović

Banjac²,

Kovačevíc

2023

IEEE Access

View full text Add to dashboard Cite

Signal Processing Platform for Long-Range Multi-Spectral Electro-Optical Systems

Cited by 7 publications

References 15 publications

Deep Learning Based SWIR Object Detection in Long-Range Surveillance Systems: An Automated Cross-Spectral Approach

Deep Learning Based SWIR Object Detection in Long-Range Surveillance Systems: An Automated Cross-Spectral Approach

Structure design and implementation of a two-axis four-gimbal electro-optical pod

Object Tracking in SWIR Imaging Based on Both Correlation and Robust Kalman Filters

Contact Info

Product

Resources

About