e health state of concrete is deteriorating during its service. Nonlinear ultrasonic detection based on the amplitude of the fundamental and the second harmonic is considered to be a powerful tool for the discovery of the microcrack in concrete. However, the research on processing the nonlinear ultrasonic signal is still insufficient. In order to highlight the real frequency domain components in the nonlinear ultrasonic signal, wavelet and ensemble empirical mode decomposition (EEMD) were joined to denoise the numerical and measured signal. e optimal wavelet base and the decomposition level were determined by the signal-to-noise ratios (SNRs). en, the wavelet threshold denoising signal was decomposed by EEMD, omitting the highfrequency components and ultimately achieving the desired denoising effect. e denoising result of the test signals demonstrates that this method is effective in denoising the details of the ultrasonic signal and improving the reliability and adaptability of the nonlinear ultrasonic testing. In this experiment, the concrete with the microcrack was tested by linear and nonlinear ultrasonic methods. Based on the variation regularity of the nonlinear ultrasonic coefficient β and velocity v, we can conclude that the nonlinear ultrasonic parameter β is more sensitive to the microcrack in concrete than the traditional wave velocity v. e nonlinear ultrasonic testing can be an important supplement to the current nondestructive testing technique of the concrete.