Quantitative phase imaging (QPI) is a promising tool for imaging complex objects. ByCombining self-reference interferometry and phase retrieval, this paper proposes a general exact QPI for arbitrary complex-objects as well as a one-shot exact QPI for transparent objects with small phase range (i.e., weak scattering object). The optical configuration is similar to the Zernike phase contrast, while the phase-shifting area is a little smaller. With three frames of phase-shift, the algebraic relationship between the phase and the measured intensity is built, providing an excellent approximate phase recovery. Then, an efficient iterative optimization strategy is reported to turn that approximate solution into an exact one. The iteration exhibits linear convergence property. Thus exact phase map is achieved with a sufficient number of iterations.When the object is a pure phase sample with a small phase ranges of [0, π], a single intensity measurement will be enough for exact phase recovery by selecting a tiny phase shifting value, based on a similar linear-convergence iterative algorithm. The feasibility and accuracy of our method are verified by both numerical simulations and experiments on diverse phase objects.