Enhanced and synthetic vision for terminal maneuvering area NextGen operations

Kramer, Lynda J.; Bailey, Randall E.; Ellis, Kyle K.; Norman, Robert M.; Williams, Steven P.; Arthur, Jarvis J.; Shelton, Kevin J.; Prinzel, Lawrence J.

doi:10.1117/12.885902

Cited by 13 publications

(7 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Studies show that significantly lower touchdown sink rates are flown under manual than automatic landings [2], and experimental evidence show that the HUD promotes better sink rate control and touchdown performance [3] [4]. Despite these advantages, HUDs are not standard equipage, although their prevalence is increasing.…”

Section: Overviewmentioning

confidence: 99%

Flight test of a head-worn display as an equivalent-HUD for terminal operations

Shelton

Arthur

Prinzel

et al. 2015

Display Technologies and Applications for Defense, Security, and Avionics IX; And Head- And Helmet-Mounted Displays XX

View full text Add to dashboard Cite

Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). Under NASA's Aviation Safety Program, one specific area of research is the use of small Head-Worn Displays (HWDs) as a potential equivalent display to a Head-up Display (HUD). Title 14 of the US CFR 91.175 describes a possible operational credit which can be obtained with airplane equipage of a HUD or an "equivalent"' display combined with Enhanced Vision (EV). A successful HWD implementation may provide the same safety and operational benefits as current HUD-equipped aircraft but for significantly more aircraft in which HUD installation is neither practical nor possible. A flight test was conducted to evaluate if the HWD, coupled with a head-tracker, can provide an equivalent display to a HUD. Approach and taxi testing was performed on-board NASA's experimental King Air aircraft in various visual conditions. Preliminary quantitative results indicate the HWD tested provided equivalent HUD performance, however operational issues were uncovered. The HWD showed significant potential as all of the pilots liked the increased situation awareness attributable to the HWD's unique capability of unlimited field-ofregard.

show abstract

Section: Overviewmentioning

confidence: 99%

Flight test of a head-worn display as an equivalent-HUD for terminal operations

Shelton

Arthur

Prinzel

et al. 2015

Display Technologies and Applications for Defense, Security, and Avionics IX; And Head- And Helmet-Mounted Displays XX

View full text Add to dashboard Cite

show abstract

“… The explicit display of flight path and energy information on the HUD promotes precision touchdown capability and energy management -i.e., maximizing landing performance (minimizing aircraft wear-and-tear). Studies show that significantly lower touchdown sink rates are flown under manual than automatic landings (Rustenburg, Tipps, and Skinn, 2001) and experimental evidence show that the HUD promotes better sink rate control and touchdown performance (Bailey, Kramer, and Williams, 2010;Kramer et al, 2011).…”

Section: Equivalent Hud Capabilitiesmentioning

confidence: 99%

Head-worn displays for NextGen

2011

Self Cite

View full text Add to dashboard Cite

The operating concepts emerging under the Next Generation air transportation system (NextGen) require new technology and procedures -not only on the ground-side -but also on the flight deck. Flight deck display and decision support technologies are specifically targeted to overcome aircraft safety barriers that might otherwise constrain the full realization of NextGen. One such technology is the very lightweight, unobtrusive head-worn display (HWD). HWDs with an integrated head-tracking system are being researched as they offer significant potential benefit under emerging NextGen operational concepts. Two areas of benefit for NextGen are defined. First, the HWD may be designed to be equivalent to the Head-Up Display (HUD) using Virtual HUD concepts. As such, these operational credits may be provided to significantly more aircraft for which HUD installation is neither practical nor possible. Second, the HWD provides unique display capabilities, such as an unlimited field-of-regard. These capabilities may be integral to emerging NextGen operational concepts, eliminating safety issues which might otherwise constrain the full realization of NextGen. The paper details recent research results, current HWD technology limitations, and future technology development needed to realize HWDs as a enabling technology for NextGen.

show abstract

“…The location of the sensor is presented in Figure 1. Processing of the EVS frame for effective presentation on the HUD received a lot of scholar attention recently (Howells, Brown, 2007, Mohideen et al, 2013, Kramer et al, 2011. Still, to the best of our knowledge, there is no research regarding elimination of the parallax between the pilot's eyebox and the EVS sensor pose.…”

Section: Introductionmentioning

confidence: 99%

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Danilov

Kozyrev

Grechanichenko

et al. 2020

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. Situational awareness of the crew is critical for the safety of the air flight. Head-up display allows providing all required flight information in front of the pilot over the cockpit view visible through the cockpit’s front window. This device has been created for solving the problem of informational overload during piloting of an aircraft. While computer graphics such as scales and digital terrain model can be easily presented on the such display, errors in the Head-up display alignment for correct presenting of sensor data pose challenges. The main problem arises from the parallax between the pilot’s eyes and the position of the camera. This paper is focused on the development of an online calibration algorithm for conform projection of the 3D terrain and runway models on the pilot’s head-up display. The aim of our algorithm is to align the objects visible through the cockpit glass with their projections on the Head-up display. To improve the projection accuracy, we use an additional optical sensor installed on the aircraft. We combine classical photogrammetric techniques with modern deep learning approaches. Specifically, we use an object detection neural network model to find the runway area and align runway projection with its actual location. Secondly, we re-project the sensor’s image onto the 3D model of the terrain to eliminate errors caused by the parallax. We developed an environment simulator to evaluate our algorithm. Using the simulator we prepared a large training dataset. The dataset includes 2000 images of video sequences representing aircraft’s motion during takeoff, landing and taxi. The results of the evaluation are encouraging and demonstrate both qualitatively and quantitatively that the proposed algorithm is capable of precise alignment of the 3D models projected on a Head-up display.

show abstract

Enhanced and synthetic vision for terminal maneuvering area NextGen operations

Cited by 13 publications

References 13 publications

Flight test of a head-worn display as an equivalent-HUD for terminal operations

Flight test of a head-worn display as an equivalent-HUD for terminal operations

Head-worn displays for NextGen

Synthetic Vision System Calibration for Conform Projection on the Pilot’s Head-Up Display

Contact Info

Product

Resources

About