We present new determinations of the rest-UV luminosity functions (LFs) at z = 2-9 to extremely low luminosities (>−14 mag) from a sample of >2500 lensed galaxies found behind the HFF clusters. For the first time, we present faint-end slope results from lensed samples that are fully consistent with blank-field results over the redshift range z = 2-9, while reaching to much lower luminosities than possible from the blank-field studies. Combining the deep lensed sample with the large blank-field samples allows us to set the tight constraints on the faint-end slope α of the z = 2-9 UV LFs and its evolution. We find a smooth flattening in α from −2.28±0.10 (z = 9) to −1.53±0.03 (z = 2) with cosmic time (dα/dz=−0.11±0.01), fully consistent with dark matter halo buildup. We utilize these new results to present new measurements of the evolution in the U V luminosity density ρ U V brightward of −13 mag from z ∼ 9 to z ∼ 2. Accounting for the SFR densities to faint luminosities implied by our LF results, we find that unobscured star formation dominates the SFR density at z 4, with obscured star formation dominant thereafter. Having shown we can quantify the faint-end slope α of the LF accurately with our lensed HFF samples, we also quantify the apparent curvature in the shape of the UV LF through a curvature parameter δ. The constraints on the curvature δ strongly rule out the presence of a turn-over brightward of −13.1 mag at z ∼ 3, −14.3 mag at z ∼ 6, and −15.5 mag at all other redshifts between z ∼ 9 to z ∼ 2.