Abstract: A real-time algorithm for detecting and tracking ground moving target by using unmanned aerial vehicle(UAV) video was proposed. Two images were matched based on the correspondence of feature points, and the change detection was proceeded on the basis of the matched images.Then according to the changing and moving information, target was detected and part of false alarm was eliminated. If tracking failed,the target could be correctly relocated to obtain full trace of moving target finally by combining detecting with tracking. The test result of groud vehicle image by UAV implies that the moving target can be detected and tracked at a real-time processing speed of more than 25 f/s by using our algorithm.