With the rapid development of visual inspection technology, computer technology, and image processing technology, machine vision technology has become more and more mature, and the role of quality inspection and control in the steel industry is becoming more and more obvious and important. Defects on the surface of the strip are a key factor affecting the quality inspection process. Its inspection plays an extremely important role in improving the final quality. For a long time, traditional manual inspection methods cannot meet actual production needs, so in-depth research on steel surface defect inspection systems has become the consensus of today’s steel companies. The accuracy and low performance of traditional detection methods can no longer meet the needs of people and society. The surface defect detection method based on machine vision has the characteristics of high accuracy, fast processing speed, and intelligent processing, which is the main trend of surface defect detection. We select a steel plate; take the invariant moment features of the cracks, holes, scratches, oil stains, and other images on it; extract the data results; and analyze them. Then, we read the texture features of these defect images again, extract the data results, and analyze them. The experimental results prove that after the mean value filter and Gaussian filter process the image, the mean variance value MSE is relatively large (
46.276
>
31.2271
), and as the concentration of salt and pepper noise increases, the rate of increase of MSE increases obviously, and as the peak signal-to-noise ratio and the mean variance value MSE increase continuously (
32.2271
<
33.3695
), the image distortion is more serious. The method designed in this paper is extremely effective. Improving the surface quality of steel is of great significance to improving market competitiveness.