Phase image in Fourier domain Doppler optical coherence tomography offers additional flow information of investigated samples, which provides valuable evidence towards accurate medical diagnosis. High quality phase images are thus desirable. We propose a noise reduction method for phase images by combining a synthetic noise estimation criteria based on local noise estimator (LNE) and distance median value (DMV) with anisotropic diffusion model. By identifying noise and signal pixels accurately and diffusing them with different coefficients respectively and adaptive iteration steps, we demonstrated the effectiveness of our proposed method in both phantom and mouse artery images. Comparison with other methods such as filtering method (mean, median filtering), wavelet method, probabilistic method and partial differential equation based methods in terms of peak signal-to-noise ratio (PSNR), equivalent number of looks (ENL) and contrast-to-noise ratio (CNR) showed the advantages of our method in reserving image energy and removing noise.