Using High Frequency Accelerometer and Mouse to Compensate for End-to-end Latency in Indirect Interaction

Abstract

End-to-end latency corresponds to the temporal difference between a user input and the corresponding output from a system. It has been shown to degrade user performance in both direct and indirect interaction. If it can be reduced to some extend, latency can also be compensated through software compensation by trying to predict the future position of the cursor based on previous positions, velocities and accelerations. In this paper, we propose a hybrid hardware and software prediction technique specifically designed for partially compensating endto-end latency in indirect pointing. We combine a computer mouse with a high frequency accelerometer to predict the future location of the pointer using Euler based equations. Our prediction method results in more accurate prediction than previously introduced prediction algorithms for direct touch. A controlled experiment also revealed that it can improve target acquisition time in pointing tasks.

Geometrically Compensating Effect of End-to-End Latency in Moving-Target Selection Games

“…In addition disturbed user interaction, higher latency hinder human performance [2] also. With general tasks such as programming and problem-solving, it has been found that latency impairs work efficiency [4,33,46,48].…”

“…In their studies, delaying the system response of the button-pressing reduced the user's error rate by 5-94%. The effect of latency is more complicated in an anticipatory task than in a reactive task, and, to the best of 2 The number of kills that a player made in average one minute. our knowledge, there remains no decent model to explain and predict it.…”

“…Using prediction, Knibbe et al improved high-speed motionprojector-camera systems by such means as projecting images onto moving objects [25]. Recently, some researchers have applied trajectory prediction in combination with additional sensors such as accelerometers or inertial measurement units (IMUs) [2,26]. Their approach is effective with ballistic motion but cannot be directly applied to a movingtarget selection task, which is performed based on a user's small movement with a single button.…”

“…Latency has an especially strong unintended effect on user experience when accurate time management is critical: in applications such as real-time games. Addressing such situations, this paper has two goals: (1) to provide a clear understanding of how latency changes the user experience and (2) to suggest a novel method of compensating for latency effects.…”

TurboMouse

“…We present TurboMouse [1], a hybrid hardware and software compensation of end-to-end latency on desktop computers when operated using a computer-mouse, and we contribute a prediction technique specifically designed for indirect pointing. Our technique is based on the prediction of pointer position based on the velocity measured by the mouse and the acceleration from an accelerometer embedded in the mouse.…”