Multisensory teamwork: using a tactile or an auditory display to exchange gaze information improves performance in joint visual search

Wahn, Basil; Schwandt, Jessika; Krüger, Matti; Crafa, Daina; Nunnendorf, Vanessa; König, Peter

doi:10.1080/00140139.2015.1099742

Cited by 45 publications

(73 citation statements)

References 62 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…More generally, the present findings suggest that pupil sizes could provide a general metric to assess attentional load in attention demanding visuospatial tasks (e.g., in visual search [48, 49] or visuomotor tasks [50]) without necessarily taking the task performance into account. Findings could also be applicable to demanding real world tasks (e.g., air-traffic control, driving a car, or flying an airplane) to assess the current attentional load during task performance.…”

Section: Discussionmentioning

confidence: 80%

Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task

et al. 2016

Self Cite

View full text Add to dashboard Cite

Previous studies have related changes in attentional load to pupil size modulations. However, studies relating changes in attentional load and task experience on a finer scale to pupil size modulations are scarce. Here, we investigated how these changes affect pupil sizes. To manipulate attentional load, participants covertly tracked between zero and five objects among several randomly moving objects on a computer screen. To investigate effects of task experience, the experiment was conducted on three consecutive days. We found that pupil sizes increased with each increment in attentional load. Across days, we found systematic pupil size reductions. We compared the model fit for predicting pupil size modulations using attentional load, task experience, and task performance as predictors. We found that a model which included attentional load and task experience as predictors had the best model fit while adding performance as a predictor to this model reduced the overall model fit. Overall, results suggest that pupillometry provides a viable metric for precisely assessing attentional load and task experience in visuospatial tasks.

show abstract

Section: Discussionmentioning

confidence: 80%

Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…For instance, when synchronizing actions, co-actors divide attention between locations relevant for their own and for their co-actor’s goal (Kourtis et al, 2014; see Böckler et al, 2012; Ciardo et al, 2016 for similar results using different tasks), and sharing gaze affects object processing by making attended objects motorically and emotionally more relevant (Becchio et al, 2008; Innocenti et al, 2012; Scorolli et al, 2014). Moreover, in a joint search task, co-actors who mutually received information about each other’s gaze location via different sensory modalities (i.e., vision, audition, and touch) searched faster than without such information (Brennan et al, 2008; Wahn et al, 2015). Together, these findings demonstrate the important role of gaze information for joint action.…”

Section: Sharing Sensorimotor Informationmentioning

confidence: 99%

Joint Action: Mental Representations, Shared Information and General Mechanisms for Coordinating with Others

Vesper¹,

et al. 2017

Self Cite

View full text Add to dashboard Cite

In joint action, multiple people coordinate their actions to perform a task together. This often requires precise temporal and spatial coordination. How do co-actors achieve this? How do they coordinate their actions toward a shared task goal? Here, we provide an overview of the mental representations involved in joint action, discuss how co-actors share sensorimotor information and what general mechanisms support coordination with others. By deliberately extending the review to aspects such as the cultural context in which a joint action takes place, we pay tribute to the complex and variable nature of this social phenomenon.

show abstract

“…Arrighi et al found that the MOT task selectively interfered with the visual discrimination task while the auditory discrimination performance was not affected, suggesting distinct attentional resources for the visual and auditory modalities. Relatedly, in other recent studies (Wahn & König, 2016; Wahn et al, 2015), participants performed a visual search task (i.e., a task in which participants needed to discriminate targets from distractors) and either a tactile or visual localization task at the same time. The localization task interfered with the visual search task, regardless of whether the localization task was performed in the tactile or visual sensory modality.…”

Section: Combining Object-based and Spatial Attention Tasksmentioning

confidence: 99%

Is Attentional Resource Allocation Across Sensory Modalities Task-Dependent?

Wahn

König

2017

ACP

Self Cite

104

View full text Add to dashboard Cite

Human information processing is limited by attentional resources. That is, via attentional mechanisms, humans select a limited amount of sensory input to process while other sensory input is neglected. In multisensory research, a matter of ongoing debate is whether there are distinct pools of attentional resources for each sensory modality or whether attentional resources are shared across sensory modalities. Recent studies have suggested that attentional resource allocation across sensory modalities is in part task-dependent. That is, the recruitment of attentional resources across the sensory modalities depends on whether processing involves object-based attention (e.g., the discrimination of stimulus attributes) or spatial attention (e.g., the localization of stimuli). In the present paper, we review findings in multisensory research related to this view. For the visual and auditory sensory modalities, findings suggest that distinct resources are recruited when humans perform object-based attention tasks, whereas for the visual and tactile sensory modalities, partially shared resources are recruited. If object-based attention tasks are time-critical, shared resources are recruited across the sensory modalities. When humans perform an object-based attention task in combination with a spatial attention task, partly shared resources are recruited across the sensory modalities as well. Conversely, for spatial attention tasks, attentional processing does consistently involve shared attentional resources for the sensory modalities. Generally, findings suggest that the attentional system flexibly allocates attentional resources depending on task demands. We propose that such flexibility reflects a large-scale optimization strategy that minimizes the brain’s costly resource expenditures and simultaneously maximizes capability to process currently relevant information.

show abstract

Multisensory teamwork: using a tactile or an auditory display to exchange gaze information improves performance in joint visual search

Cited by 45 publications

References 62 publications

Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task

Pupil Sizes Scale with Attentional Load and Task Experience in a Multiple Object Tracking Task

Joint Action: Mental Representations, Shared Information and General Mechanisms for Coordinating with Others

Is Attentional Resource Allocation Across Sensory Modalities Task-Dependent?

Contact Info

Product

Resources

About