We have analyzed effects of the hyperfine interaction on electric dipole spin resonance when the amplitude of the quantum-dot motion becomes comparable or larger than the quantum dot's size. Away from the well known small-drive regime, the important role played by transverse nuclear fluctuations leads to a gaussian decay with characteristic dependence on drive strength and detuning. A characterization of spin-flip gate fidelity, in the presence of such additional drive-dependent dephasing, shows that vanishingly small errors can still be achieved at sufficiently large amplitudes. Based on our theory, we analyze recent electric-dipole spin resonance experiments relying on spin-orbit interactions or the slanting field of a micromagnet. We find that such experiments are already in a regime with significant effects of transverse nuclear fluctuations and the form of decay of the Rabi oscillations can be reproduced well by our theory.PACS numbers: 85.35. Be,03.65.Yz Introduction. The interest in coherent manipulation of single electron spins has stimulated intense research efforts, leading to a great degree of control in a variety of nanostructures [1, 2]. For electrons in quantum dots, electron spin resonance (ESR) was first demonstrated in Ref. [3]. However, full electric control of local spins might be a better strategy for complex architectures of many quantum dots, envisioned to realize quantum information processing [4]. Thus, electric dipole spin resonance (EDSR) was developed relying on either spin-orbit couplings [5,6] or the inhomogeneous magnetic field induced by a micromagnet [7,8]. The effectiveness of EDSR is highlighted by recent experiments, which could demonstrate Rabi oscillations with frequencies larger than 100 MHz for both approaches [9,10]. To further improve the performance of such spin manipulation schemes, it is important to characterize relevant dephasing mechanisms, and especially those which might become dominant at strong electric drive. In fact, as it will become clear in the following, a sufficiently strong drive is able to induce significant and yet unexplored modifications on how typical dephasing sources affect EDSR. For this reason, while representing the main limitation for accurate spin manipulation, dephasing is still poorly understood in large-amplitude regime of EDSR (i.e., when the amplitude of motion becomes comparable to the quantum dot's size).