Background and Objective: Prostate segmentation on Magnetic Resonance (MR) imaging is problematic because disease changes the shape and boundaries of the gland and it can be difficult to separate the prostate from surrounding tissues. We propose an automated model that extracts and combines multi-level features in a deep neural network to segment prostate on MR images. Methods: Our proposed model, the Propagation Deep Neural Network (P-DNN), incorporates the optimal combination of multilevel feature extraction as a single model. High level features from the convolved data using DNN are extracted for prostate localization and shape recognition, while labeling propagation, by low level cues, is embedded into a deep layer to delineate the prostate boundary. Results: A well-recognized benchmarking dataset (50 training data and 30 testing data from patients) was used to evaluate the P-DNN. When compared it to existing DNN methods, the P-DNN statistically outperformed the baseline DNN models with an average improvement in the DSC of 3.19%. When compared to the state-of-the-art non-DNN prostate segmentation methods, P-DNN was competitive by achieving 89.9 ±2.8% DSC and 6.84±2.5mm HD on training sets and 84.13±5.18% DSC and 9.74±4.21mm HD on testing sets. Conclusion: Our results show that P-DNN maximizes multi-level feature extraction for prostate segmentation of MR images.