Existing high-order variational drift kinetic theories contain unphysical rapidly varying modes that are not seen at low-orders. These unphysical modes, which may be rapidly oscillating, damped, or growing, are ushered in by a failure of conventional high-order drift kinetic theory to preserve the structure of its parent model's initial value problem (Vlasov-Poisson for electrostatics, Vlasov-Darwin or Vlasov-Maxwell for electromagnetics.) In short, the system phase space is unphysically enlarged in conventional high-order variational drift kinetic theory. I present an alternative, "renormalized" variational approach to drift kinetic theory that manifestly respects the parent model's initial value problem. The basic philosophy underlying this alternate approach is that high-order drift kinetic theory ought to be derived by truncating the all-orders system phase space Lagrangian instead of the usual "field+particle" Lagrangian. For the sake of clarity, this story is told first through the lens of a finite-dimensional toy model of high-order variational drift kinetics; the analogous full-on drift kinetic results are discussed subsequently. The renormalized drift kinetic system, while just as accurate as conventional formulations, does not support the troublesome rapidly varying mode.