N-SEEV in SOAS: Predicting Time to Notice for Multi-Modal Cockpit Alerting Events

Abstract

This paper presents the current work to extend the N-SEEV model of visual attention to both the auditory and tactile modalities in support a cockpit adaptive automation system for pilot spatial disorientation. Cockpit countermeasure systems use visual, auditory and tactile modalities to communicate problems to the pilot. The SOAS spatial orientation aiding system uses all three modalities to support a disoriented pilot. The system initiates increasingly intrusive countermeasure as it determines that the probability and severity of a detected disorientation is increasing. N-SEEV has been included within SOAS to support the change to countermeasure levels based on the prediction of the pilot noticing countermeasure onset. Previous versions of N-SEEV could predict a time-to-notice for the onset of a visual cockpit countermeasure. In this work, N-SEEV is extended to include noticing predictions for both the auditory and tactile modes.