The Mandelstam-Tamm and Margolus-Levitin quantum speed limits are two well-known evolution time estimates for isolated quantum systems. These bounds are usually formulated for fully distinguishable initial and final states, but both have tight extensions to systems that evolve between states with arbitrary fidelity. However, the foundations for these extensions differ in some essential respects. The extended Mandelstam-Tamm quantum speed limit has been proven analytically and has a clear geometric interpretation. Furthermore, the systems that saturate the limit have been completely classified. The derivation of the extended Margolus-Levitin quantum speed limit, on the other hand, is based on numerical estimates. Moreover, the limit lacks a geometric interpretation, and there is no complete characterization of the systems reaching it. In this paper, we derive the extended Margolus-Levitin quantum speed limit analytically and describe in detail the systems that saturate the limit. We also provide the limit with a symplectic-geometric interpretation, indicating that it is of a different character than most existing quantum speed limits. At the end of the paper, we analyze the maximum of the extended Mandelstam-Tamm and Margolus-Levitin quantum speed limits, and we derive a dual version of the extended Margolus-Levitin quantum speed limit. The maximum limit is tight regardless of the fidelity of the initial and final states. However, the conditions under which the maximum limit is saturated differ depending on whether or not the initial and final states are fully distinguishable. The dual limit is also tight and follows from a time reversal argument. We describe all systems that saturate the dual quantum speed limit.