Action verbs are processed differently in metaphorical and literal sentences depending on the semantic match of visual primes

Abstract

Language comprehension requires rapid and flexible access to information stored in long-term memory, likely influenced by activation of rich world knowledge and by brain systems that support the processing of sensorimotor content. We hypothesized that while literal language about biological motion might rely on neurocognitive representations of biological motion specific to the details of the actions described, metaphors rely on more generic representations of motion. In a priming and self-paced reading paradigm, participants saw video clips or images of (a) an intact point-light walker or (b) a scrambled control and read sentences containing literal or metaphoric uses of biological motion verbs either closely or distantly related to the depicted action (walking). We predicted that reading times for literal and metaphorical sentences would show differential sensitivity to the match between the verb and the visual prime. In Experiment 1, we observed interactions between the prime type (walker or scrambled video) and the verb type (close or distant match) for both literal and metaphorical sentences, but with strikingly different patterns. We found no difference in the verb region of literal sentences for Close-Match verbs after walker or scrambled motion primes, but Distant-Match verbs were read more quickly following walker primes. For metaphorical sentences, the results were roughly reversed, with Distant-Match verbs being read more slowly following a walker compared to scrambled motion. In Experiment 2, we observed a similar pattern following still image primes, though critical interactions emerged later in the sentence. We interpret these findings as evidence for shared recruitment of cognitive and neural mechanisms for processing visual and verbal biological motion information. Metaphoric language using biological motion verbs may recruit neurocognitive mechanisms similar to those used in processing literal language but be represented in a less-specific way.

EEG beta-power changes reflect motor involvement in abstract action language processing

“…Our current findings are further in accordance with results of other studies proposing a gradual involvement of motor representations in abstract action language processing (Desai et al, 2011(Desai et al, , 2013Romero Lauro et al, 2013;Sakreida et al, 2013;Troyer, Curley, Miller, Saygin, & Bergen, 2014). Desai et al (2011) compared brain activation patterns in response to arm/hand related action verbs, which were embedded in literal and metaphoric contexts.…”

Painful semantic context modulates the relationship between action words and biological movement perception

“…Moreover, the results demonstrated that this effect is precluded when an action verb is presented in a painful semantic context. Altogether, these findings accord with previous results that have shown that semantic context affects the relationship between action words and the motor system (Aravena et al, 2014;Aravena et al, 2012;Bidet-Ildei et al, In press;Gilead et al, 2013;Taylor & Zwaan, 2008;Troyer et al, 2014;van Dam et al, 2014;van Dam et al, 2012;Zwaan et al, 2010). Moreover, they demonstrate that pain suggested in the sentences directly precludes the relationship between action verbs and BM detection.…”

“…Moreover, when processing point-light BM, observers are able to access an actor's characteristics, such as gender (Kozlowski & Cutting, 1977;Troje, Sadr, Geyer, & Nakayama, 2006), identity (Beardsworth & Buckner, 1981;Loula, Prasad, Harber, & Shiffrar, 2005), emotions (Atkinson, Dittrich, Gemmell, & Young, 2004;Chouchourelou, Matsuka, Harber, & Shiffrar, 2006) and intentions (Iacoboni et al, 2005;Martel, Bidet-Ildei, & Coello, 2011). In relation to embodied cognition theory, which postulates that language, abstract and symbol processing emerge from sensorimotor experience (Barsalou, 1999;Wilson, 2002), some studies have shown that BM perception is also related to higher-level cognitive processes, such as action-word processing (Bidet-Ildei, Sparrow, & Coello, 2011;Bidet-Ildei & Toussaint, 2015;Springer, Huttenlocher, & Prinz, 2012;Springer & Prinz, 2010;Troyer, Curley, Miller, Saygin, & Bergen, 2014). For example, Bidet-Ildei et al (2011) show that reading an action verb facilitates the subsequent detection of congruent point-light action embedded in a high-density dynamical point light.…”

“…More recently, some studies have shown that the context of action-word presentation can influence the relationship between language and action (Aravena et al, 2014;Aravena et al, 2012;Gilead, Liberman, & Maril, 2013;Taylor & Zwaan, 2008;Troyer et al, 2014;van Dam, Brazil, Bekkering, & Rueschemeyer, 2014;van Dam, van Dijk, Bekkering, & Rueschemeyer, 2012;Zwaan, Taylor, & de Boer, 2010). For example, it has been shown that motor activation during action-verb processing appears only when action verbs are presented in affirmative sentences (Aravena et al, 2012).…”

“Pushing the Button While Pushing the Argument”: Motor Priming of Abstract Action Language

“…This suggests that detailed motor representations are linked to concrete action language processing, whereas abstract action language processing might be linked to rather broad motor representations. Troyer, Curley, Miller, Saygin, and Bergen () came to a similar conclusion. They used point light walkers as visual action primes and had participants read literal and metaphoric action sentences.…”