We construct the non-relativistic and Carrollian versions of Jackiw-Teitelboim gravity. In the second order formulation, there are no divergences in the non-relativistic and Carrollian limits. Instead, in the first order formalism, some divergences can be avoided by starting from a relativistic BF theory with (A)dS2 × ℝ gauge algebra. We show how to define the boundary duals of the gravity actions using the method of non-linear realisations and suitable Inverse Higgs constraints. In particular, the non-relativistic version of the Schwarzian action is constructed in this way. We derive the asymptotic symmetries of the theory, as well as the corresponding conserved charges and Newton-Cartan geometric structure. Finally, we show how the same construction applies to the Carrollian case.