Binding biological motion and visual features in working memory.

Ding, Xiaowei; Zhao, Yangfan; Wang, Fan; Lu, Xiqian; Gao, Zaifeng; Shen, Mowei

doi:10.1037/xhp0000061

Cited by 29 publications

(85 citation statements)

References 114 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, one previous behavioral study found that the dual task for actions and colored dots did not affect behavioral performance (Wood, a). A more recent VSTM study showed that changing the color of biological motion stimuli did not affect the behavioral performance for actions, and changing the motions did not affect the performance for colors either (Ding et al, ).…”

Section: Discussionmentioning

confidence: 99%

“…Recent studies on VSTM have focused on three separate systems: an object/agent recognition system that maintains identity information (what/who is involved in the event), a place recognition system that maintains location information (where the event takes place), and an object tracking system that maintains action information (what happens; Wood, a). Preliminary support for this “core knowledge” architecture of VSTM has come from experiments that found independent storage capacity limits for actions, objects, and locations (Shen, Gao, Ding, Zhou, & Huang, ; Wood, a) and from studies that showed impaired performance of VSTM of actions when they were bound with agents or locations (Ding et al, ; Wood, ). This core knowledge architecture in VSTM is also in line with the sensory‐recruitment theory of VSTM, which posits that the stimulus‐specific sensorimotor cortices (i.e., regions involved in perception) are also engaged in the temporary maintenance of the perceived representations, whereas the fronto–parietal network (FPN) is involved in allocating attention to the maintained representations (D'Esposito & Postle, ).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Distinct neural substrates for visual short‐term memory of actions

Cai

Urgolites

Wood

et al. 2018

Human Brain Mapping

View full text Add to dashboard Cite

Fundamental theories of human cognition have long posited that the short-term maintenance of actions is supported by one of the "core knowledge" systems of human visual cognition, yet its neural substrates are still not well understood. In particular, it is unclear whether the visual short-term memory (VSTM) of actions has distinct neural substrates or, as proposed by the spatio-object architecture of VSTM, shares them with VSTM of objects and spatial locations. In two experiments, we tested these two competing hypotheses by directly contrasting the neural substrates for VSTM of actions with those for objects and locations. Our results showed that the bilateral middle temporal cortex (MT) was specifically involved in VSTM of actions because its activation and its functional connectivity with the frontal-parietal network (FPN) were only modulated by the memory load of actions, but not by that of objects/agents or locations. Moreover, the brain regions involved in the maintenance of spatial location information (i.e., superior parietal lobule, SPL) was also recruited during the maintenance of actions, consistent with the temporal-spatial nature of actions. Meanwhile, the frontoparietal network (FPN) was commonly involved in all types of VSTM and showed flexible functional connectivity with the domain-specific regions, depending on the current working memory tasks. Together, our results provide clear evidence for a distinct neural system for maintaining actions in VSTM, which supports the core knowledge system theory and the domain-specific and domain-general architectures of VSTM.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Distinct neural substrates for visual short‐term memory of actions

Cai

Urgolites

Wood

et al. 2018

Human Brain Mapping

View full text Add to dashboard Cite

show abstract

“…These studies predominantly focused on the WM storage of the pure action information embedded in BMs. For instance, WM can retain three to four individual actions that are stored independently from location, color, shape, and color-shape binding (e.g., Cai et al, 2018;Gao, Bentin, & Shen, 2015;Lu et al, 2016;Shen, Gao, Ding, Zhou, & Huang, 2014;Wood, 2007Wood, , 2011; storing actionrelated binding is resource-demanding (e.g., Ding et al, 2015;Liu, Lu, Wu, Shen, & Gao, 2019;Lu, Ma, Zhao, Gao, & Shen, 2019). To isolate pure action information, the tested BM stimuli were in fact collected from a single actor in almost all WM studies of BM (e.g., the BMs from the widely used Vanrie & Verfaillie, 2004, database were acquired from one actor).…”

Section: Introductionmentioning

confidence: 99%

Agent identity drives adaptive encoding of biological motion into working memory

et al. 2019

Journal of Vision

Self Cite

View full text Add to dashboard Cite

To engage in normal social interactions, we have to encode human biological motions (BMs, e.g., walking and jumping), which is one of the most salient and biologically significant types of kinetic information encountered in everyday life, into working memory (WM). Critically, each BM in real life is produced by a distinct person, carrying a dynamic motion signature (i.e., identity). Whether agent identity influences the WM processing of BMs remains unknown. Here, we addressed this question by examining whether memorizing BMs with different identities promoted the WM processing of task-irrelevant clothing colors. Two opposing hypotheses were tested: (a) WM only stores the target action (element-based hypothesis) and (b) WM stores both action and irrelevant clothing color (event-based hypothesis), interpreting each BM as an event. We required participants to memorize actions that either performed by one agent or distinct agents, while ignoring clothing colors. Then we examined whether the irrelevant color was also stored in WM by probing a distracting effect: If the color was extracted into WM, the change of irrelevant color in the probe would lead to a significant distracting effect on action performance. We found that WM encoding of BMs was adaptive: Once the memorized actions had different identities, WM adopted an event-based encoding mode regardless of memory load and probe identity (Experiment 1, different-identity group of Experiment 2, and Experiment 3). However, WM used an elementbased encoding mode when memorized-actions shared the same identity (same-identity group of Experiment 2) or were inverted (Experiment 4). Overall, these findings imply that agent identity information has a significant effect on the WM processing of BMs.

show abstract

“…Or it may be that the object-location binding of BM was relatively difficult, since there was a similar observation Participants were presented with one or five point-light walkers for variable durations (500; 1,000;, 2,500; or 5,000 ms) followed by motion masks for 200 ms. After a blank period of 1 s, a probe item was presented, and participants adjusted the heading direction of the probe walker to match that of the item that had been presented at the same location in the sample array. The circling arrow in the right-most panel is shown for illustrative purposes only and was not actually presented that the color-action binding of BM was severely limited in capacity (Ding et al, 2015).…”

Section: Resultsmentioning

confidence: 99%

Gradual formation of visual working memory representations of motion directions

Tsuda

Saiki

2018

Atten Percept Psychophys

View full text Add to dashboard Cite

Although it is well accepted that the formation of visual working memory (VWM) representations from simple static features is a rapid and effortless process that completes within several hundred milliseconds, the storage of motion information in VWM within that time scale can be challenging due to the limited processing capacity of the visual system. Memory formation can also be demanding especially when motion stimuli are visually complex. Here, we investigated whether the formation of VWM representations of motion direction is more gradual than that of static orientation and examined the effects of stimulus complexity on that process. To address these issues, we examined how the number and the precision of stored items in VWM develop over time by using a continuous report procedure. Results showed that while a viewing duration of several seconds was required for the successful storage of multiple motion directions in VWM regardless of motion complexity, the accumulation of memory precision was much slower when the motion stimulus was visually complex (Experiments 1 & 2). Additional experiments showed that the difference in memory performance for simple and complex motion stimuli cannot be explained by differences in signal-to-noise levels of the stimulus (Experiment 3). These results demonstrate remarkable temporal limitations in the formation of VWM representations for dynamic objects, and further show how this process is affected by stimulus properties such as visual complexity and signal-to-noise levels.

show abstract

Binding biological motion and visual features in working memory.

Cited by 29 publications

References 114 publications

Distinct neural substrates for visual short‐term memory of actions

Distinct neural substrates for visual short‐term memory of actions

Agent identity drives adaptive encoding of biological motion into working memory

Gradual formation of visual working memory representations of motion directions

Contact Info

Product

Resources

About