Degradation in surface finish of the material is an important concern in engineering applications. However, most of the conventional techniques available to monitor the surface roughness requires dismantling of the machine element. Though in rotary components like bearing, it is practically not feasible. Therefore, in this work, an on-board technique is proposed to compare the level of surface roughness based on vibration signature. To demonstrate, five different industrial standard coatings (Nickel, Copper, Zinc phosphate (ZnP), Silver, and Black oxide) were carried out on raw five ball bearings (NBC6205). Two sets of coated bearing were prepared, where first set was utilized for experimentation and second for the purpose of measuring surface roughness of bearing surface. These coated bearings were tested at five different RPMs ranging from 300 RPM to 1500 RPM and their vibration signals were recorded. The recorded vibration signals must be having characteristics originated from ball rolling on different level of surface roughness and hence distributed in nature. Further, to target distributed characteristics present in the signal, commonly used statistical parameters for vibration signature analysis (RMS, Crest factor, Variance, Skewness, Kurtosis, Shannon entropy and Log energy) were calculated. Then, correlation of the parameters was checked in relation to the different levels of surface roughness, but no relation was found. The signals were then decomposed into six intrinsic mode functions (IMFs) using Variational Mode Decomposition (VMD) method. Again, same statistical parameters were calculated for these decomposed levels, it has been noted that Shannon entropy have shown correlation to surface roughness in at least one decomposed level between 900 to 1500 RPM with minimum value of chain index as 176.65. Moreover, in this RPM range, responsive frequency bands found to be shifted towards higher side i.e. from 567 to 4590 Hz.