Registration of infrared and visible images is very difficult because of their different imaging principles. Considering the correlation of edges in these two kinds of images, an improved registration algorithm is proposed in this paper. Firstly, the wavelet transform modulus maximum algorithm is used to detect edges in images. Then the Speeded Up Robust Features (SURF) algorithm is used for feature points detection on the edges. Finally, feature points are matched by rough matching and accurate matching, and the least squares method is employed to find optimal solution to affine transform equations. Experimental results show the high accuracy and stability of this registration method.