The moving object detection refers to the detection of physical moving objects from a video, which is applied in video surveillance, object recognition, object counting, human-computer interaction, and so on. Moreover, nowadays, real-time moving object detection is used as services in the cloud, edge, and fog computing. However, the existing methods do not meet the trade-off between accuracy and complexity. To address these issues, we present a background subtraction-based moving object detection method, called Fast-D. In this paper, we look at the 'non-smoothing color feature' to make the moving object detection more robust in real-time. Each color feature is given equal significance during the classification of a pixel. Background model and threshold are initialized for each pixel. And then, the background model and threshold are updated dynamically when there are changes in the background of the video. Adaptive post-processing is considered to discard salt and pepper noise and fill holes in the detected moving object silhouettes. The evaluation of our proposed method on four complex datasets exhibits the significance. INDEX TERMS Real-time moving object detection, background subtraction, object segmentation, change detection.