Flight Guardian: Autonomous Flight Safety Improvement by Monitoring Aircraft Cockpit Instruments

Abstract

During in-flight emergencies, a pilot's workload increases significantly, and it is often during this period of increased stress that human errors occur that consequently diminish the flight safety. Research studies indicate that many plane crashes can be attributed to ineffective cockpit instrument monitoring by the pilot. This paper entails the development of Flight Guardian ¶ system being first of its kind that aims to provide efficient flight-deck awareness to improve flight safety while assisting the pilot in abnormal situations. The system is intended to be used in older aircraft that cannot easily or cost effectively be modified with modern digital avionic systems. One of the important features of the Flight Guardian system is being not physically connected to the aircraft, which avoids any impact on airworthiness or the need for recertification. For the first time, a composite of techniques including video analysis, knowledge representation, and machine belief representations are combined to build a novel flight-deck warning system. The prototype system is tested in both simulation-based laboratory and real flight environments under the guidance of expert pilots. The overall system performance is evaluated using statistical analysis of experimental results that proved the robustness of the proposed methodology in terms of automated warning generation in hazardous situations.

Experimental Verification of Objective Visual Fatigue Measurement Based on Accurate Pupil Detection of Infrared Eye Image and Multi-Feature Analysis

“…In addition, the dry corneal surface due to increased visual fatigue causes frequent blinking. Based on the results of this study, it is expected that visual fatigue can be measured in flight stability improvement systems [ 27 ], Virtual reality equipment, video conference systems, the video content production field, and the post-traumatic stress disorder treatment. In addition, this result can be applied to various studies (emotion recognition, gaze tracking, etc.)…”

Novel Framework for Outdoor Mobility Assistance and Auditory Display for Visually Impaired People

“…In addition to VIPs' outdoor mobility, computer vision and data processing approaches have been applied into diverse application domains such as autonomous vehicles for the intelligent traffic sign recognition [14], video surveillance [15] for the real-time tracking object tracking, aerospace [16,17] for live cockpit monitoring, underground mapping of objects [18], clustering of objects [19], biomedical [20,21] for skin lesions characterisation and diabetes prediction, robotics [22][23][24][25] for multi-sensor data fusion, multi-obstacle detection [26] using laser scanner, self-driving cars [27], speech template matching [28,29], healthcare technologies [30][31][32][33][34][35], and other adjacent domains. Likewise, recent research advancement include autonomous scene recognition using advance computer vision.…”

A High-Robust Automatic Reading Algorithm of Pointer Meters Based on Text Detection

“…Because most of these meters have no digital communication interface, the manual reading method is usually adopted, but the manual detection cost is high and the efficiency is low, which is insufficient to meet the real-time and intelligent monitoring requirements in industry [ 2 ]. The automatic reading of pointer meters [ 3 , 4 , 5 , 6 , 7 ] can save a lot of labor and time costs for factories, so it has great practical value [ 8 , 9 , 10 ].…”