Vision-based sensing of UAV attitude and altitude from downward in-flight images

Abstract

Autonomous unmanned aerial vehicles (UAVs) often carry video cameras as part of their payload. Outdoor video captured by such cameras can be used to estimate the attitude and altitude of the UAV by detecting the location of the horizon in the video frames. This paper presents a video frame processing algorithm for estimating the pitch and roll of a UAV, as well as its altitude. The frames are obtained from a downward pointing video camera equipped with a fisheye lens. These open-loop estimates can serve as redundant data used to implement graceful-degradation in the event that the main closed-loop control sensors fail, or for fault-tolerance purposes to augment inertial sensors for increased accuracy. The estimated values had a mean error of AE0.7 angular degrees for roll and AE0.9 angular degrees for pitch, while the altitude estimation from the video had a mean error of AE0.9 meters. The results are presented and compared to actual attitude and altitude values obtained from a traditional inertial measurement unit and, in the case of altitude comparison, an absolute air pressure sensor. The algorithm was developed on a personal computer to work at 10 frames per second and uses only simple image processing functions that can be deployed using open source libraries on lightweight computing boards capable of image processing.

A review on drones controlled in real-time

“…The commonly used state observer is the inertial guidance system. Other attitude determination devices such as infrared or vision based sensors can be used [ 61 , 62 ]. The inertial guidance system (IGS), also referred to as inertial navigation system (INS) [ 63 ] consists of the inertial measurement unit (IMU) and the navigation computer.…”

PSO-based online estimation of aerodynamic ground effect in the backstepping controller of quadrotor

“…But it must be considered in any practical design. Many researchers have tried to implement the nonlinear controllers on quadrotor projects [23][24][25][26][27][28]. The goal of this control strategy is to track a desired trajectory, when the quadrotor flies close to the ground surface.…”

The Feasibility Assessment Study of Bridge Crack Width Recognition in Images Based on Special Inspection UAV

“…Carrio et al [25] used the infrared thermal imaging technology to detect obstacles, enhancing the ability of UAV of avoiding obstacles in direct sunlight and night time. Rawashdeh et al [26] utilized the imaging frame changes in a video to estimate the pitching and rolling of a UAV. Fernández et al [27] used the UAV to detect wind turbine blades and developed a robust feedback procedure to effectively deal with flight disturbances.…”