Spinocerebellar ataxia 6 (SCA6), an autosomal dominant degenerative disease, is characterized by diplopia, gait ataxia, and incoordination due to severe progressive degeneration of Purkinje cells in the vestibulo- and spinocerebellum. Ocular motor deficits are common, including difficulty fixating on moving objects, nystagmus and disruption of smooth pursuit movements. In presymptomatic SCA6, there are alterations in saccades and smooth-pursuit movements. We sought to assess functional and structural changes in cerebellar connectivity associated with a visual task, hypothesizing that gradual changes would parallel disease progression. We acquired functional magnetic resonance imaging and diffusion tensor imaging data during a passive smooth-pursuit task in 14 SCA6 patients, representing a range of disease duration and severity, and performed a cross-sectional comparison of cerebellar networks compared with healthy controls. We identified a shift in activation from vermis in presymptomatic individuals to lateral cerebellum in moderate-to-severe cases. Concomitantly, effective connectivity between regions of cerebral cortex and cerebellum was at its highest in moderate cases, and disappeared in severe cases. Finally, we noted structural differences in the cerebral and cerebellar peduncles. These unique results, spanning both functional and structural domains, highlight widespread changes in SCA6 and compensatory mechanisms associated with cerebellar physiology that could be utilized in developing new therapies.