Abstract: Since the problem of how to accurately find the corresponding matching characteristics by the heterologenetic sensors when image registration, in combination with the characteristics of the red and visible images，the extraction of the Canny edge of images is proposed by utilizing the similar characteristics of the edge outline when the different two sensors image a same scene. That is, find the corresponding matching point at the edge outline according to the similarity of the location included angle between the pixels on the edge curves. The validity and registration accuracy of the algorithm were verified through the simulation and comparison of the experimental data with the true value.