Human-Centered HMI for Crane Teleoperation: Intuitive Concepts Based on Mental Models, Compatibility and Mental Workload

Top, Felix; Pütz, Sebastian; Fottner, Johannes

doi:10.1007/978-3-030-77932-0_34

Cited by 5 publications

(3 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In teleoperation, this rich data has to be transformed, transmitted and understood using mainly the visual channel, bound to state of the art in interaction devices available to machine producers today. This modality transformation at least challenges operators' skills in pattern detection, situational awareness, and workload due to required mental transformations (Wickens, 2002), their ability to assign existing mental models of machine operation and operation environments (Top et al, 2021;Picking et al, 2010) as well as their feeling of immersion or presence (Parasuraman et al, 2008;DeJong et al, 2004;Chen et al, 2011). Tree major competency-related human performance issues summarize the crucial role of the operators' competencies in 1) impaired situational awareness for out-of-the-loop and teleoperation conditions, 2) poor maintenance of knowledge and skills through decrease and infrequency of active involvement, and 3) impeded applicability of existing competencies due to the changed system and UI functionalities, technology, and behaviour of automated machines, 4) danger of complacency as a result of miscalibrated trust on automation capabilities and 5) the requirements for new competences to meet the new functionalities involved technology and new modes of operation in automated systems.…”

Section: Human-performance Issues In Automation Operationmentioning

confidence: 99%

Design of a Teleoperation User Interface for Shared Control of Highly Automated Agricultural Machiness

Lorenz

2023

Proc. Des. Soc.

View full text Add to dashboard Cite

This paper presents a focused examination of critical performance and design issues for the introduction of highly automated tractors and their user interfaces in agriculture. An industry that as of today mainly uses direct-controlled machines that at least to some extent have partly automated functionalities. Issues include out-of-the-loop unfamiliarity, interface complexity, automation transparency, and changing information modalities in teleoperation scenarios for former cabin-based operated machines. Selected evidence and accompanying concepts and findings from literature are put in context to each issue, informing a systematic design process that utilizes the frameworks of knowledge engineering and ecological interface design. The resulting user interface prototype is built upon the identified requirements in analysis and collected design guidelines, stemming from various research areas. The documentation of the consideration of these in context with additional requirements, such as complexity reduction, information interactivity, and users' existing experiences is meant to provide insights into the often opaque and art-like design space.

show abstract

Section: Human-performance Issues In Automation Operationmentioning

confidence: 99%

Design of a Teleoperation User Interface for Shared Control of Highly Automated Agricultural Machiness

Lorenz

2023

Proc. Des. Soc.

View full text Add to dashboard Cite

show abstract

“…video feeds) and 1D sources (e.g. time-dependent parameters like recorded distance to an object) to create a mental representation required for precise control [22]. A 3D presentation of the work site, on the other hand, potentially allows the human operator to allocate more cognitive resources to meaningful control.…”

Section: Introductionmentioning

confidence: 99%

Augmented reality‐based telepresence in a robotic manipulation task: An experimental evaluation

de Boer,

de Winter,

Eisma

2023

IET Collab Intel Manufact

View full text Add to dashboard Cite

A spectrum of control methods in human–robot interaction was investigated, ranging from direct control to telepresence with a virtual representation of the robot arm. A total of 24 participants used a setup that included a Franka Emika Panda robot arm, Varjo XR‐3 head‐mounted display, and Leap Motion Controller. Participants performed a box‐and‐block task using the bare hand (A), and under five gesture‐controlled robotic operation methods: direct sight (B), sight via video‐feedthrough (C), in a 3D telepresence environment with (D) and without (E) virtual representation of the robot arm, and using a 2D video feed (F). The number of grabbing attempts did not differ significantly between conditions, but local operation (B & C) yielded more transferred blocks than teleoperation (D–F). Teleoperation using a 3D presentation was advantageous compared to teleoperation using a 2D video feed, as demonstrated by lower peak forces and smaller range in gripper heights in conditions D and E compared to condition F, a finding supported by analyses of the head movement activity. Finally, the bare hand yielded the best performance and subjective ratings. In summary, teleoperation using a 3D presentation provided a smoother interaction than teleoperation with a 2D video feed. However, direct human interaction remains a benchmark yet to surpass.

show abstract

“…Touch screens, rotary controls, and joysticks are part of modern human-machine interfaces (HMIs) in industrial contexts. They are often integrated into complex HMIs and used to control cranes, drilling rigs, agricultural machines, or medical devices [1][2][3][4][5][6]. The development of complex HMIs is ideally conducted according to a user-centered design process [7].…”

Section: Introductionmentioning

confidence: 99%

Design of Control Elements in Virtual Reality—Investigation of Factors Influencing Operating Efficiency, User Experience, Presence, and Workload

Hinricher

Schröer

Backhaus³

2023

Applied Sciences

View full text Add to dashboard Cite

Virtual reality (VR) enables prototypes of devices to be evaluated in a simulation of a future usage environment. A disadvantage is the insufficient feedback design during the interaction with prototypes. In this study, we investigated how virtual control elements in VR must be designed to compensate for the lack of feedback. Therefore, 35 participants performed VR tasks using a virtual joystick and virtual rotary control. According to the design of experiments method, 12 factors, such as haptic feedback, sensitivity, size, and shape, were systematically varied. The control accuracy, task time, user experience, presence, and mental workload were recorded. The effect of a factor on the recorded parameters was examined using multifactorial ANOVA. Linear regression was used to calculate the mathematical models between the factors and parameters. These models were used to calculate the optimal design of the control elements in the VR. For rotary control, eight factors had a significant influence on the recorded parameters. There were seven factors for the joystick. With mathematical models, optimized control element designs for VR were calculated for the first time. These findings can help to better adapt prototypes and human–machine interfaces to different modalities in VR.

show abstract

Human-Centered HMI for Crane Teleoperation: Intuitive Concepts Based on Mental Models, Compatibility and Mental Workload

Cited by 5 publications

References 28 publications

Design of a Teleoperation User Interface for Shared Control of Highly Automated Agricultural Machiness

Design of a Teleoperation User Interface for Shared Control of Highly Automated Agricultural Machiness

Augmented reality‐based telepresence in a robotic manipulation task: An experimental evaluation

Design of Control Elements in Virtual Reality—Investigation of Factors Influencing Operating Efficiency, User Experience, Presence, and Workload

Contact Info

Product

Resources

About