Quantitative phase imaging (QPI) has been an important technique for the determination of various biophysical parameters, such as the refractive index and morphology of biological cells and tissues. The technique has been implemented using off-axis and common path digital holographic microscopy (DHM). Off-axis DHM, though being ideal for QPI, offers lower temporal phase stability compared to common path techniques. Common path DHM offers a higher temporal phase stability but, being a coherent imaging technique, suffers from speckle artefacts and spurious interference fringes due to the high coherence of the light source. Both artefacts not only degrade the image quality, but also affect the phase measurement results. In this paper, we report the implementation of common path QPI set-up using a partially spatially coherent multi-spectral light source. The spatial coherence of the red and green color lasers is reduced by using a rotating diffuser. Also, a speckle free QPI was implemented using common path Fresnel biprism interferometer. A Fresnel biprism is used in the self-referencing mode, thus offering the advantage of no optical power loss in addition to high temporal stability and the least speckle artefacts. Furthermore, it is very easy to implement, as the system completely replaces the need for spatial filtering at the source end as well as for the reference beam generation. The experiments have been carried out on industrial and biological samples to prove the effect.