Abstract: The traditional dynamic displacement measurement method is classified as the contact measurement method, the strain displacement meter is often used to measure the structural deformation directly, and its measuring precision is often determined by the installation of the displacement meter. In addition, the electrical signals measured by it are easily affected by the experimental environment. With the continuous development of optical measurement technology, the optical measurement method based on binocular stereo vision and digital image processing technology has been applied to displacement measurement. In order to solve the accuracy problem of traditional dynamic displacement measurement and the interference of environment to the signal, the binocular stereo vision technology was applied to the shaking table test of a three-story steel frame structure, the displacement time history of the structure under earthquake action was measured.The displacement time history and displacement deviation rate were compared and analyzed with the traditional measurement methods. The results show that the optical measurement method reduces the relative lag time of 2.0 s~3.5 s and enhances the reliability of data. The maximum displacement deviation rate is 7.03% and the minimum is 0.02%, which is within the allowable range of measurement error, verifying the feasibility and superiority of the optical displacement measurement method in the structural seismic test.