We used event-related potentials (ERPs) and gamma band oscillatory responses (GBRs) to examine whether intermodal attention operates early in the auditory, visual, and tactile modalities. To control for the effects of spatial attention, we spatially coregistered all stimuli and varied the attended modality across counterbalanced blocks in an intermodal selection task. In each block participants selectively responded to either auditory, visual, or vibrotactile stimuli from the stream of intermodal events. Auditory and visual ERPs were modulated at the latencies of early cortical processing, but attention manifested later for tactile ERPs. For ERPs, auditory processing was modulated at the latency of the Na (29 ms) which indexes early cortical or thalamocortical processing and the subsequent P1 (90 ms) ERP components. Visual processing was modulated at the latency of the early phase of the C1 (62-72 ms) thought to be generated in primary visual cortex and the subsequent P1 and N1 (176 ms). Tactile processing was modulated at the latency of the N160 (165 ms) likely generated in secondary association cortex. Intermodal attention enhanced early sensory GBRs for all three modalities: auditory (onset 57 ms), visual (onset 47 ms) and tactile (onset 27 ms). Together, these results suggest that intermodal attention enhances neural processing relatively early in the sensory stream independent from differential effects of spatial and intramodal selective attention.