Adaptive haptic rendering for time‐varying haptic and video frame rates in multi‐modal interactions

Abstract

In multi-modal interactions including haptics, problems such as input sensor noise, temporal mismatch between graphics and haptics, and non-constant refresh rates may cause non-smooth force/torque display. This paper proposes temporal smoothing technique for haptic interaction using a sensing glove in multi-modal applications. The proposed technique employs two processes: (1) a noise reduction method is applied to reduce jitter noise at the sensors in the sensing glove and (2) an adaptive force extrapolation is applied for timevarying haptic and video frame rates. To demonstrate the performance of the proposed method, we developed a test platform to assess a simple box model and relatively complex models such as gamephone, portable media player (PMP). It was subsequently demonstrated that the proposed method can support smooth haptic interactions in multi-modal applications where a haptic device and a sensing glove are used.