Temporal Audiovisual Motion Prediction in 2D- vs. 3D-Environments

Abstract

Predicting motion is essential for many everyday life activities, e.g., in road traffic. Previous studies on motion prediction failed to find consistent results, which might be due to the use of very different stimulus material and behavioural tasks. Here, we directly tested the influence of task (detection, extrapolation) and stimulus features (visual vs. audiovisual and three-dimensional vs. non-three-dimensional) on temporal motion prediction in two psychophysical experiments. In both experiments a ball followed a trajectory toward the observer and temporarily disappeared behind an occluder. In audiovisual conditions a moving white noise (congruent or non-congruent to visual motion direction) was presented concurrently. In experiment 1 the ball reappeared on a predictable or a non-predictable trajectory and participants detected when the ball reappeared. In experiment 2 the ball did not reappear after occlusion and participants judged when the ball would reach a specified position at two possible distances from the occluder (extrapolation task). Both experiments were conducted in three-dimensional space (using stereoscopic screen and polarised glasses) and also without stereoscopic presentation. Participants benefitted from visually predictable trajectories and concurrent sounds during detection. Additionally, visual facilitation was more pronounced for non-3D stimulation during detection task. In contrast, for a more complex extrapolation task group mean results indicated that auditory information impaired motion prediction. However, a post hoc cross-validation procedure (split-half) revealed that participants varied in their ability to use sounds during motion extrapolation. Most participants selectively profited from either near or far extrapolation distances but were impaired for the other one. We propose that interindividual differences in extrapolation efficiency might be the mechanism governing this effect. Together, our results indicate that both a realistic experimental environment and subject-specific differences modulate the ability of audiovisual motion prediction and need to be considered in future research.

Seeing and extrapolating motion trajectories share common informative activation patterns in primary visual cortex

“…able to estimate the time when a vehicle will reappear, after being occluded by a bus, to plan our next action accordingly, indicating that we can successfully infer the reappearance of a dynamically occluded object (e.g., Coull et al, 2008;Dittrich & Noesselt, 2018). Although such inference mechanisms underpin many actions of our daily life, little is known about their exact neural representations and their informational content.…”

Seeing and Extrapolating motion trajectories share common informative activation patterns in primary visual cortex

“…For instance, when driving or crossing a street, we are able to estimate the time when a vehicle will reappear, after being occluded by a bus, to plan our next action accordingly, indicating that we can successfully infer the reappearance of a dynamically occluded object (e.g. Coull et al, 2008, Dittrich & Noesselt, 2018). Although such inference mechanisms underpin many actions of our daily life, little is known about their exact neural representations and their informational content.…”