Integration framework for NASA NextGen Volumetric Cockpit Situation Display with haptic feedback

Abstract

In this paper, we present a framework for the integration of force feedback information in a NASA NextGen Volumetric Cockpit Situation Display (CSD). With the current CSD, the user retrieves operational information solely through visual displays and interacts with the CSD tools through using a mouse. The advanced capabilities of the CSD may require complex manipulation of information which may be difficult to perform with input devices found in today's cockpits. Performance with the CSD could benefit from a new user input device and enhanced user feedback modalities that can be operated safely, effectively, and intuitively in a cockpit environment. In this work, we investigate the addition of force feedback in two key CSD tasks: object selection and route manipulation. Different force feedback models were applied to communicate guidance commands, such as collision avoidance and target contact. We also discuss the development of a GUIbased software interface to allow the integration of a haptic device for the CSD. A preliminary user study was conducted on a testbed system using the Novint Falcon force-feedback device. A full experiment, assessing the effectiveness and usability of the feedback model in the CSD, will be performed in the next phase of our research.

Effectiveness of Force Feedback on Movement Time and Path for Target Selection in the Presence of Distractors

“…The Novint Falcon was programed to provide two types of forces to the participant, an attractive gravitational force and a resistive, spring force. The gravitational force (F 1 in Newtons/Pixel 2 ; N/p 2 ) was inversely proportional to the square of the distance (d) of the cursor from the target center, with the magnitude of the force proportional to the gain (K 1 ) as shown in Equation 1 (Robles et al, 2012).…”

“…where r is the radius of the target. When the cursor was inside the target, the force feedback changed to a spring force (F 2 in Newton-Pixels; N-P) that resists movements away from the target center (Robles et al, 2012). The magnitude of this force was determined by the distance from target center (d) and force gain (K 2 ), as shown in Equation 2.…”

“…In a series of experiments in our lab, we have designed and evaluated force feedback models to assist the user in simple CDTI manipulation tasks such as point-and-click, click-and-drag, and their combinations (e.g., Robles et al, 2012;Park et al, 2013). The force-feedback model is a combination of an attractive gravitational force when the cursor is outside the target (Equation 1) and a resistive spring force when the cursor is inside the target (Equation 2).…”

A Haptic Shared-Control Architecture for Guided Multi-Target Robotic Grasping

“…The user is provided with haptic guidance for selecting fundamental frequencies from a continuous range. A different application is proposed in [45], where the authors propose a haptic-based framework for the integration of force feedback in a NASA NextGen Volumetric Cockpit Situation Display. The user is provided with haptic guidance for object selection and route manipulation while acting on a 2D screen interface.…”

Effects of Type and Strength of Force Feedback on Movement Time in a Target Selection Task

“…These inputs can be difficult due to the unstable nature of the cockpit environment, the small display size that will likely be required, and the potential need for manipulation of the 3-D display. The use of force feedback with the CDTI has been studied as a potential method for allowing operators to make quick and accurate inputs (e.g., Robles et al, 2012).…”