A Neural Model of MST and MT Explains Perceived Object Motion during Self-Motion

Layton, Oliver W.; Fajen, Brett R.

doi:10.1523/jneurosci.4593-15.2016

Cited by 36 publications

(41 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interestingly, neurons with incongruent visual/vestibular heading tuning in the dorsal subdivision of the medial superior temporal (MST) area may play an important role in dissociating object and observer motion. By signaling discrepancies between the retinal image motion of an object and visual and/or vestibular heading cues, incongruent neurons in dorsal MST, as well as network interactions between the middle temporal (MT) area and MST, have been suggested to contribute to the process of discounting self-motion when judging object motion or estimating heading in the presence of object motion (38,39,57). These neural mechanisms might also play key roles in the neural implementation of causal inference.…”

Section: Discussionmentioning

confidence: 99%

Causal inference accounts for heading perception in the presence of object motion

Dokka

Park

Jansen

et al. 2019

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

The brain infers our spatial orientation and properties of the world from ambiguous and noisy sensory cues. Judging self-motion (heading) in the presence of independently moving objects poses a challenging inference problem because the image motion of an object could be attributed to movement of the object, self-motion, or some combination of the two. We test whether perception of heading and object motion follows predictions of a normative causal inference framework. In a dual-report task, subjects indicated whether an object appeared stationary or moving in the virtual world, while simultaneously judging their heading. Consistent with causal inference predictions, the proportion of object stationarity reports, as well as the accuracy and precision of heading judgments, depended on the speed of object motion. Critically, biases in perceived heading declined when the object was perceived to be moving in the world. Our findings suggest that the brain interprets object motion and self-motion using a causal inference framework.

show abstract

Section: Discussionmentioning

confidence: 99%

Causal inference accounts for heading perception in the presence of object motion

Dokka

Park

Jansen

et al. 2019

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

“…These observations support the view that MSTd contains a population heading map that pools motion signals across the visual field for heading estimation without any segmentation of independent object motion. In contrast, a subset of MT neurons with differential motion properties could provide the segmentation of object motion from the global flow field (Layton & Fajen, 2016d;Royden, Sannicandro, & Webber, 2015), which is then further elaborated either in MSTl (Eifuku & Wurtz, 1999) or in a subset of MSTd neurons that respond to local motion in addition to heading stimuli (Krekelberg, Paolini, Bremmer, Lappe, & Hoffmann, 2001). Accordingly, these neurons can serve the perception of scene-relative object-motion during self-motion.…”

Section: Discussionmentioning

confidence: 99%

No special treatment of independent object motion for heading perception

Lappe³

et al. 2018

Journal of Vision

View full text Add to dashboard Cite

How do we judge the direction of self-motion (i.e., heading) in the presence of independent object motion? Previous studies that examined this question confounded the effects of a moving object's speed and its position on heading judgments, and did not examine whether the visual system uses salient nonmotion visual cues (such as color contrast and binocular disparity) to segment a moving object from global optic flow prior to heading estimation. The current study addressed these issues with both behavioral testing and computational modeling. Our results show that the visual system does not treat independent object motion separately for the perception of heading during self-motion. This is surprising because we all can segment a moving object from global optic flow and perceive its scene-relative motion independent of self-motion. Our findings support the claim that the perception of self-motion with independent object motion and the perception of object motion during self-motion are performed by different neural mechanisms.

show abstract

“…As demonstrated previously and in the current study, MT neurons have relatively small RFs compared with MSTd neurons and thus are well suited for processing local motion information within their RFs. The outcome of such local motion processing in MT is subsequently pooled by downstream areas such as MSTd to generate complex-flow motion (Layton and Fajen, 2016;Yu et al, 2018). Processing of visual information along a hierarchy of visual areas results in a distribution of temporal responses (Schmolesky et al, 1998).…”

Section: Integration Time Window For Global Illusory Complex-flow Motmentioning

confidence: 99%

“…Although translational direction signals are encoded in V1 (Hubel and Wiesel, 1968), MT (also known as V5; Zeki, 1974;Maunsell and Van Essen, 1983;Albright et al, 1984), and medial superior temporal area (MST; Zeki, 1980;Tanaka et al, 1986), neural correlates of global complexflow motion are first encountered in the dorsal portion of MST (MSTd; Saito et al, 1986;Graziano et al, 1994;Lagae et al, 1994;Smith et al, 2006;Britten, 2008). MSTd neurons have been hypothesized to integrate local translational motion signals from early visual cortices into global complex-flow motion perceptions (Wurtz and Duffy, 1992;Warren and Saunders, 1994;Royden, 2002;Layton et al, 2012;Mineault et al, 2012;Layton and Fajen, 2016;Yu et al, 2018); however, the details remain elusive.…”

Section: Introductionmentioning

confidence: 99%

Going with the Flow: The Neural Mechanisms Underlying Illusions of Complex-Flow Motion

Luo

Andolina³

et al. 2019

J. Neurosci.

View full text Add to dashboard Cite

Studying the mismatch between perception and reality helps us better understand the constructive nature of the visual brain. The Pinna-Brelstaff motion illusion is a compelling example illustrating how a complex moving pattern can generate an illusory motion perception. When an observer moves toward (expansion) or away (contraction) from the Pinna-Brelstaff figure, the figure appears to rotate. The neural mechanisms underlying the illusory complex-flow motion of rotation, expansion, and contraction remain unknown. We studied this question at both perceptual and neuronal levels in behaving male macaques by using carefully parametrized Pinna-Brelstaff figures that induce the above motion illusions. We first demonstrate that macaques perceive illusory motion in a manner similar to that of human observers. Neurophysiological recordings were subsequently performed in the middle temporal area (MT) and the dorsal portion of the medial superior temporal area (MSTd). We find that subgroups of MSTd neurons encoding a particular global pattern of real complex-flow motion (rotation, expansion, contraction) also represent illusory motion patterns of the same class. They require an extra 15 ms to reliably discriminate the illusion. In contrast, MT neurons encode both real and illusory local motions with similar temporal delays. These findings reveal that illusory complex-flow motion is first represented in MSTd by the same neurons that normally encode real complex-flow motion. However, the extraction of global illusory motion in MSTd from other classes of real complex-flow motion requires extra processing time. Our study illustrates a cascaded integration mechanism from MT to MSTd underlying the transformation from external physical to internal nonveridical flow-motion perception.

show abstract

A Neural Model of MST and MT Explains Perceived Object Motion during Self-Motion

Cited by 36 publications

References 37 publications

Causal inference accounts for heading perception in the presence of object motion

Causal inference accounts for heading perception in the presence of object motion

No special treatment of independent object motion for heading perception

Going with the Flow: The Neural Mechanisms Underlying Illusions of Complex-Flow Motion

Contact Info

Product

Resources

About