Design of a Teleoperation User Interface for Shared Control of Highly Automated Agricultural Machiness

Abstract

This paper presents a focused examination of critical performance and design issues for the introduction of highly automated tractors and their user interfaces in agriculture. An industry that as of today mainly uses direct-controlled machines that at least to some extent have partly automated functionalities. Issues include out-of-the-loop unfamiliarity, interface complexity, automation transparency, and changing information modalities in teleoperation scenarios for former cabin-based operated machines. Selected evidence and accompanying concepts and findings from literature are put in context to each issue, informing a systematic design process that utilizes the frameworks of knowledge engineering and ecological interface design. The resulting user interface prototype is built upon the identified requirements in analysis and collected design guidelines, stemming from various research areas. The documentation of the consideration of these in context with additional requirements, such as complexity reduction, information interactivity, and users' existing experiences is meant to provide insights into the often opaque and art-like design space.

Synthetic Displays and Their Potential for Driver Assistance Systems

“…Suggestions for the promising use of synthetic displays can also be found in other domains. Whether assisting in surgical procedures through image-guided surgery [14], predicting flight paths and offering guidance in aviation [15], providing virtual annotations for enhanced visibility in challenging conditions [16], facilitating the monitoring of highly automated machines [17], or for damage visualization in buildings after earthquakes [18], synthetic displays can be used within a wide range of applications. Their success will largely depend on whether the information from different sensors can be integrated into one meaningful display.…”