Abstract: Since the most visual tracking can only track face target with displacement but not rotation, this paper presents a displacement and rotation tracking method based on maximum posterior probability. On the basis of maximum posterior probability visual tracking algorithm, this paper uses adaptive angle template to perform rotation tracking of face target. Compared with traditional visual tracking method, this method can accurately obtain the position and direction of human face when the face is slanted. The experimental results show that this method can efficiently track the face target with displacement and rotation.