We observe for the first time an effect on the driver caused by the motion of ions in a plasma wakefield accelerator. The effect manifests itself as a beam tail, which only occurs when sufficient motion of ions suppresses wakefields. By changing the plasma ions (helium, argon, xenon) in the experiment, we show that the effect depends inversely on the ion mass, as predicted from theory and simulations. Wakefields are driven resonantly by multiple bunches, and simulation results indicate that the ponderomotive force causes the motion of ions. In this case, the effect is also expected to depend on the amplitude of the wakefields, as also observed by varying the bunch charge.