A low-cost predictive display for teleoperation: Investigating effects on human performance and workload

Dybvik, Henrikke; Løland, Martin; Gerstenberg, Achim; Slåttsveen, Kristoffer; Steinert, Martin

doi:10.1016/j.ijhcs.2020.102536

Cited by 18 publications

(11 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results of the analysis obtained in this study indicate that the workload has a positive and significant effect on the performance of the Examiner at the Supreme Audit Agency of South Sumatra province, so the first hypothesis can be accepted. The results of this study are in line with the results of research from (van de Merwe et al, 2022;Tortia et al, 2022;Ijaz, 2022;Husin & Aisyah, 2021;Norawati et al, 2021;Marucci, 2021;Manurung, 2020;Azra, 2020;Balducci et al, 2021;Causse et al, 2019;Perlman, 2019;Dybvik, 2019;Polakitang et al, 2019;Nurwahhyuni, 2019) shows the results that the workload has a positive and significant effect on employee performance.…”

Section: Resultssupporting

confidence: 89%

influence of workload and provision of compensation on the performance of examiners at the financial audit agency representative of the Province of South Sumatera

Sari

Perizade

Widiyanti

et al. 2022

ijss

View full text Add to dashboard Cite

This study aims to determine the effect of workload and compensation on the performance of auditors at the State Audit Board of South Sumatra Province. In this study, the number of samples was 100 respondents from the Supreme Audit Agency's Representative Office of South Sumatra Province. The statistical tool used in this study is multiple linear regression using analysis media in the form of the IBM series 22 Statistical Package for the Social Sciences (SPSS) program. The results of this study show: (1) Workload has a positive and significant effect on the Examiner's performance as Supreme Audit Agency Representative of South Sumatra Province; (2) The provision of compensation has a positive and significant effect on the performance of the Auditor at the State Audit Board of South Sumatra Province. The workload given by the agency can be done quickly and on time because the Examiner always tries and is ready to complete all his duties and responsibilities. However, it should still be necessary to increase the number of examiners following the assigned job map and workload so that the work results can follow the expected quality standards.

show abstract

Section: Resultssupporting

confidence: 89%

influence of workload and provision of compensation on the performance of examiners at the financial audit agency representative of the Province of South Sumatera

Sari

Perizade

Widiyanti

et al. 2022

ijss

View full text Add to dashboard Cite

show abstract

“…Using one operator to control multiple robots has benefits in terms of cost and control coherency but leads to a higher workload and decrease in situation awareness [29]. The human operator is often overlooked when supervising robots [30], despite their workload influencing task performance [31] and in fact having long-term negative effects on well-being [32]. Indeed, J. M. Riley et al [33] have demonstrated that an increase in the number of robots per human significantly degrades performance and situation awareness.…”

Section: Related Workmentioning

confidence: 99%

Scheduling and Path-Planning for Operator Oversight of Multiple Robots

et al. 2021

View full text Add to dashboard Cite

There is a need for semi-autonomous systems capable of performing both automated tasks and supervised maneuvers. When dealing with multiple robots or robots with high complexity (such as humanoids), we face the issue of effectively coordinating operators across robots. We build on our previous work to present a methodology for designing trajectories and policies for robots such that a few operators can supervise multiple robots. Specifically, we: (1) Analyze the complexity of the problem, (2) Design a procedure for generating policies allowing operators to oversee many robots, (3) Present a method for designing policies and robot trajectories to allow operators to oversee multiple robots, and (4) Include both simulation and hardware experiments demonstrating our methodologies.

show abstract

“…Considering the impacts of latency on teleoperation performance, a significant research effort has been made to the design of predictive interface‐based teleoperation systems (Deng & Jagersand, 2003; Dybvik et al, 2020; Ha et al, 2018; Matheson et al, 2013; Ricks et al, 2004; C. Wang et al, 2016; Wilde et al, 2020; Witus et al, 2011; Y. Xiong et al, 2006). These predictive interfaces have attempted to compensate latency through first‐order predictive interfaces that mostly offer the predicted state variables for the period of delay (Artstein, 1982; Manitius & Olbrot, 1979).…”

Section: Introductionmentioning

confidence: 99%

“…However, for parallax movement, their technique is not applicable. In addition to the cropping and zooming method, Dybvik et al (2020) applied positional and scale transformations for a better predictive display.…”

Section: Introductionmentioning

confidence: 99%

Long future frame prediction using optical flow‐informed deep neural networks for enhancement of robotic teleoperation in high latency environments

Moniruzzaman

Rassau

Chai

et al. 2022

Journal of Field Robotics

View full text Add to dashboard Cite

High latency in teleoperation has a significant negative impact on operator performance. While deep learning has revolutionized many domains recently, it has not previously been applied to teleoperation enhancement. We propose a novel approach to predict video frames deep into the future using neural networks informed by synthetically generated optical flow information. This can be employed in teleoperated robotic systems that rely on video feeds for operator situational awareness. We have used the image-to-image translation technique as a basis for the prediction of future frames. The Pix2Pix conditional generative adversarial network (cGAN) has been selected as a base network. Optical flow components reflecting real-time control inputs are added to the standard RGB channels of the input image. We have experimented with three data sets of 20,000 input images each that were generated using our custom-designed teleoperation simulator with a 500-ms delay added between the input and target frames. Structural Similarity Index Measures (SSIMs) of 0.60 and Multi-SSIMs of 0.68 were achieved when training the cGAN with three-channel RGB image data. With the five-channel input data (incorporating optical flow) these values improved to 0.67 and 0.74, respectively. Applying Fleiss' κ gave a score of 0.40 for three-channel RGB data, and 0.55 for fivechannel optical flow-added data. We are confident the predicted synthetic frames are of sufficient quality and reliability to be presented to teleoperators as a video feed that will enhance teleoperation. To the best of our knowledge, we are the first to attempt to reduce the impacts of latency through future frame prediction using deep neural networks.

show abstract

A low-cost predictive display for teleoperation: Investigating effects on human performance and workload

Cited by 18 publications

References 27 publications

influence of workload and provision of compensation on the performance of examiners at the financial audit agency representative of the Province of South Sumatera

influence of workload and provision of compensation on the performance of examiners at the financial audit agency representative of the Province of South Sumatera

Scheduling and Path-Planning for Operator Oversight of Multiple Robots

Long future frame prediction using optical flow‐informed deep neural networks for enhancement of robotic teleoperation in high latency environments

Contact Info

Product

Resources

About