The practical utility of Møller-Plesset (MP) perturbation theory is severely constrained by the use of Hartree-Fock (HF) orbitals. It has recently been shown that use of regularized orbital-optimized MP2 orbitals and scaling of MP3 energy could lead to a significant reduction in MP3 error (J. Phys. Chem. Lett. 10, 4170, 2019). In this work we examine whether density functional theory (DFT) optimized orbitals can be similarly employed to improve the performance of MP theory at both the MP2 and MP3 levels. We find that use of DFT orbitals leads to significantly improved performance for prediction of thermochemistry, barrier heights, non-covalent interactions,