The design and development of autonomous vehicles ensure to move safely on roads while focusing on pedestrian detection systems has brought convention so that pedestrians can be detected quickly and precisely. Moreover, the researchers have mentioned that pedestrian skin detection has proven to be a tough challenge since skin color can vary in appearance due to various factors such as weather conditions, sun-lighting, occlusion, race, etc. Thus, the detection of pedestrian skin tone has not been thoroughly explored in some circumstances to detect pedestrians; they used the different characteristics of all pedestrians as one sample. The evidence is that pedestrian skin tones fit the Fitzpatrick scale of 4 to 6, which is hard to detect with an existing state-of-art algorithm. Our proposed methodology, the radar-camera fusion technique, is used to predict the obstacle in any scenario. A convolution neural network extracts pedestrian features from RGB images and radar data. Also, we have introduced data preparation and feature extraction. We feature mapping to get more detection accuracy and clustering to find the similarities between features that will attain darker skin pedestrian details.