Speech Recognition and Sensory Integration

Effects of sentence context and expectation on the McGurk illusion

“…That is, they must give higher cognitive processes access to representations of audiovisually integrated speech cues. Whereas the Fuzzy logical model of perception (FLMP) explicitly considers these interactions (e.g., Massaro, 1996;Massaro & Stork, 1998), these interactions as not well specified in amodal theories which attribute the McGurk effect to nonlinguistic modules in the brain, located, e.g., the insula (Bushara et al, 2003) or the claustrum (Olson et al, 2002). Moreover, the FLMP is also consistent with the fact that the effects were highly reliable in the rating measure reflecting a continuous measure of the strength of the illusion (Massaro & Cohen, 1983a, 1983b.…”

“…The model states that visual and auditory speech cues are first analyzed separately and continuously up to the level of phoneme analysis. The results of these two independent processes are then combined and matched with stored phoneme prototypes based on a relative goodness rule (Massaro, 1987(Massaro, , 1996(Massaro, , 1998Massaro & Stork, 1998).…”

“…Such models can nevertheless account for lexical-semantic effects on phonemic identifications by implementing decision nodes at a (relatively late) processing level whose activity can be influenced not only by phonetic factors but by lexical-semantic levels as well (as in MERGE, see Norris, McQueen, & Cutler, 2000). Likewise, the Fuzzy-Logical Model of Perception (FLMP; Massaro, 1987Massaro, , 1996Massaro, , 1998Massaro & Stork, 1998) is a non-interactive model that formalizes how the information from independent sources is combined and weighted as the system attempts to match current information with stored knowledge. FLMP assumes that this matching process will be held back for as long as possible to assemble all available evidence before a selection is made.…”

Fuzzy logical model of bimodal emotion perception: Comment on “The perception of emotions by ear and by eye” by de Gelder and Vroomen

“…These results are particularly valuable to us because they represent an independent test of our theoretical framework by researchers other than ourselves. We use their results to test the fuzzy logical model of perception (FLMP), which to date has survived a number of empirical tests (Massaro, 1998;Massaro & Stork, 1998).…”

Introduction to the special issue on language–vision interactions

“…There is a rich tradition of examining how visual information from the face, especially the lips, combines with auditory information to form phonetic percepts (Massaro, 1998;Massaro, Cohen, & Smeele, 1996;Massaro & Stork, 1998;McGurk & MacDonald, 1976). And, in the early, heady days of the cognitive revolution in the 1960s, psycholinguists explored a variety of tasks designed to provide insights into the representations and processes that enable language users to produce and comprehend language.…”