Comparing the effects of visual-auditory and visual-tactile feedback on user performance

Burke, Jennifer; Prewett, Matthew Scott; Gray, Ashley A.; Yang, Liuquin; Stilson, Frederick R. B.; Coovert, Michael D.; Elliot, Linda R.; Redden, Elizabeth S.

doi:10.1145/1180995.1181017

Cited by 179 publications

(125 citation statements)

References 33 publications

(5 reference statements)

Supporting

Mentioning

116

Contrasting

Order By: Relevance

“…A review of 43 such studies [10] indicated that combining visual feedback with auditory or tactile feedback led to reduced reaction times and improved performance measures, although error rates were not improved. Studies on the effects of haptic feedback in handheld touchscreen devices indicated improvements in subjective workload [11] and reduced task completion times [12]; in both of these cases, improvements were also observed in error rates.…”

Section: Touchscreens and Multimodal Interactionmentioning

confidence: 99%

Evaluating User Response to In-Car Haptic Feedback Touchscreens Using the Lane Change Test

Pitts

Skrypchuk

Wellings

et al. 2012

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

Touchscreen interfaces are widely used in modern technology, from mobile devices to in-car infotainment systems. However, touchscreens impose significant visual workload demands on the user which have safety implications for use in cars. Previous studies indicate that the application of haptic feedback can improve both performance of and affective response to user interfaces. This paper reports on and extends the findings of a 2009 study conducted to evaluate the effects of different combinations of touchscreen visual, audible, and haptic feedback on driving and task performance, affective response, and subjective workload; the initial findings of which were originally published in (M. J. Pitts et al., 2009). A total of 48 non-expert users completed the study. A dual-task approach was applied, using the Lane Change Test as the driving task and realistic automotive use case touchscreen tasks. Results indicated that, while feedback type had no effect on driving or task performance, preference was expressed for multimodal feedback over visual alone. Issues relating to workload and cross-modal interaction were also identified.

show abstract

Section: Touchscreens and Multimodal Interactionmentioning

confidence: 99%

Evaluating User Response to In-Car Haptic Feedback Touchscreens Using the Lane Change Test

Pitts

Skrypchuk

Wellings

et al. 2012

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

show abstract

“…Attending to multimodality, several studies (i.e. see meta-analysis performed in [8]) have reported the benefits of providing richer sensory outputs in a VE. But despite its benefits, multimodality can become an additional source of mismatches for the design of a VE, due to the synchronization requirements of all the system sensory outputs.…”

Section: Introductionmentioning

confidence: 99%

The role of mismatches in the sensory feedback provided to indicate selection within a virtual environment

Viciana-Abad

Reyes‐Lecuona

Poyade

et al. 2010

Multimed Tools Appl

View full text Add to dashboard Cite

It is generally understood that virtual reality simulations have a high computational cost. Hence, they rarely can reduce completely all the incoherence within the cross-modal sensory outputs provided. The main research approaches to date have consisted in technically reducing possible mismatches, however minimal research has been conducted so as to analyse their influence on human capabilities. Thus, the objective of this study is to provide further insights to the designers of virtual reality about the negative influence of simulation lags and interesting design implications. To clearly show this, we have investigated the importance of coherent sensory feedback by incorporating time delays and spatial misalignments in the feedback provided by the simulation as a response to participant´s actions to mimic computationally expensive environments. We have also evaluated these misalignments considering two typical interaction setups. In particular, the sensory mismatches influence has been assessed in human factors, such as the sense of presence, task performance and delay perception. Our experimental results indicate that the closer the interaction conditions are to real configurations the higher the sensory requirements are regarding accuracy. The implications of this study offer the designer guidelines to prioritise the reduction of those mismatches in the sensory cues provided depending on the simulations goals.

show abstract

“…The approach stems from the multiple resource theory [93] that suggests that humans can efficiently compartmentalize information processing across modalities, although not entirely without interference [94].  Using this approach enables all relevant information for motor learning involving a motor task to be efficiently and simultaneously delivered to the user.…”

Section: Style 4: Concurrentmentioning

confidence: 99%

A Survey of Multimodal Systems and Techniques for Motor Learning

Tadayon

McDaniel²,

Panchanathan

2017

J Inf Process Syst

View full text Add to dashboard Cite

This survey paper explores the application of multimodal feedback in automated systems for motor learning. In this paper, we review the findings shown in recent studies in this field using rehabilitation and various motor training scenarios as context. We discuss popular feedback delivery and sensing mechanisms for motion capture and processing in terms of requirements, benefits, and limitations. The selection of modalities is presented via our having reviewed the best-practice approaches for each modality relative to motor task complexity with example implementations in recent work. We summarize the advantages and disadvantages of several approaches for integrating modalities in terms of fusion and frequency of feedback during motor tasks. Finally, we review the limitations of perceptual bandwidth and provide an evaluation of the information transfer for each modality.

show abstract

Comparing the effects of visual-auditory and visual-tactile feedback on user performance

Cited by 179 publications

References 33 publications

Evaluating User Response to In-Car Haptic Feedback Touchscreens Using the Lane Change Test

Evaluating User Response to In-Car Haptic Feedback Touchscreens Using the Lane Change Test

The role of mismatches in the sensory feedback provided to indicate selection within a virtual environment

A Survey of Multimodal Systems and Techniques for Motor Learning

Contact Info

Product

Resources

About