Processing of words presented simultaneously to eye and ear.

Abstract

The simultaneous processing of auditorily and visually presented messages was examined in three experiments. Subjects searched lists of words for a target word while processing auditorily presented information. Across conditions, subjects searched for (a) target words in a list of words presented auditorily, (b) the same target words in lists presented visually, (c) a member of a taxonomic category in a visually presented list, and (d) a rhyme in a list of words presented visually. The level of processing of a simultaneous auditory message varied across experiments. In experiment 1, subjects shadowed lists of digits. In Experiment 2, subjects reported the antonym of each word in a list. In Experiment 3, subjects named the taxonomic category of each word in a list. In all three experiments, subject had high detection rates for target words presented visually and for category targets but low detection rates for target words presented auditorily and for rhyme targets. These results suggest that processing the semantic properties, but not the acoustic properties, of words presented to the visual modality is independent of simultaneous processing in the auditory modality. Implication for models of selective attention are discussed.

Testing visual short-term memory: Simultaneous versus sequential presentations

“…Two auditory tasks or two visual tasks tend to interfere with each other more than an auditory task and a visual task would (e.g., Baddeley & Lieberman, 1980;Brooks, 1968Brooks, , 1970Proctor, 1978;Rollins & Hendricks, 1980;Segal & Fusella, 1970). Therefore, it is reasonable to suppose that when the to-be-recalled items are stored in auditory short-term memory, speaking the prefix would impair recall more than writing the prefix, whereas when the items are stored in visual short-term memory, writing the prefix would impair recall more than speaking the prefix.…”

Cognitive principles of multimedia learning: The role of modality and contiguity.

“…This result would be expected for the cases in which the two visual sources are spatially separated so both cannot access foveal vision simultaneously or in which the two auditory sources mask each other. Nevertheless, the modality effect persists even when the studies control for such peripheral interference (Isreal, 1980;Rollins & Hendricks, 1980;Treisman & Davies, 1973).…”

Interruption in Digital Convergence: Focused on Multi-Modality and Multi-Tasking

“…[Allport, 1993;Allport, 1980;Neumann, 1987;Allport, 1987]. 본 연구의 결과는 기존의 연구 결과 [Latorella, 1998;Rollins and Hendricks, 1980;Wickens, 1980;Paivio, 1986;Wickens, 2002] Models of Working Memory [Baddeley, 1992], Cognitive…”