The Effect of Dissociation between Proprioception and Vision on Perception and Grip Force Control in a Stiffness Judgment Task

Abstract

Our sensorimotor system estimates stiffness to form stiffness perception, such as for choosing a ripe fruit, and to generate actions, such as to adjust grip force to avoid slippage of a scalpel during surgery. We examined how temporal manipulation of the haptic and visual feedback affect stiffness perception and grip force adjustment during a stiffness discrimination task. We used delayed force feedback and delayed visual feedback to break the natural relations between these modalities when participants tried to choose the harder spring between pairs of springs. We found that visual delay caused participants to slightly overestimate stiffness while force feedback delay caused a mixed effect on perception; for some it caused underestimation and for some overestimation of stiffness. Interestingly and in contrast to previous findings without vision, we found that participants increased the magnitude of their applied grip force for all conditions. We propose a model that suggests that this increase was a result of coupling the grip force adjustment to their proprioceptive hand position, which was the only modality which we could not delay. Our findings shed light on how the sensorimotor system combines information from different sensory modalities for perception and action. These results are important for the design of improved teleoperation systems that suffer from unavoidable delays.

Visual Feedback Weakens the Augmentation of Perceived Stiffness by Artificial Skin Stretch

“…However, these studies did not provide participants with visual feedback about object deformation, which has the potential to affect the integration of the haptic information. For example, in [20], the addition of visual feedback influenced the effect of introducing delay into force feedback on the control of grip force in a stiffness discrimination task. The effect of adding visual feedback when both kinesthetic and artificial tactile feedback are presented is currently unknown.…”