Abstract: In order to enhance robustness of target tracking algorithm under conditions of motion displacement, occlusion, deformation and similar object disturbance, it is proposed to construct target appearance model by using super pixel, and match appearance model with candidate region to obtain candidate region target super pixel, and use Meanshift algorithm to determine target center point tracking algorithm. Simulation experiments select representative of video Girl and FaceOcc1 from Benchmark library, which represent video scene in terms of movement displacement, occlusion, deformation, interference of similar objects. Tracking success rate and tracking accuracy of algorithm are 0.601 and 0.856 in video Girl, and success rate and accuracy of KCF algorithm with best tracking performance are higher than normal algorithm of 0.059 and 0.084 respectively. In video FaceOcc1, tracking success rate and accuracy of proposed algorithm only ranked second to KCF, suggesting a fine robustness even when target is blocked or interfered by analogues.