Abstract: The infrared image is a commonly used image source of modern optical equipment, the display effect of the image directly affects the user experience of the device, and the noise in the infrared sequence images can cause the decline of display effect. In order to reduce the effect of noise on the display effect of infrared sequence images, by weighting the gray values of multiple historical frames and estimating the noise-free image of the current frame, a denoising algorithm based on the temporal Gaussian filtering was proposed. Referring to the weight distribution method of spatial bilateral filtering, the influence of the gray value was introduced to correct the weight of temporal Gaussian filtering, which solved the trailing and blurring of moving targets in sequence images caused by the temporal filtering. The experimental results show that the temporal filtering method can effectively smooth the noise between frames and reduce the deterioration of display effect of the infrared sequence images caused by the noise; and the problem of trailing and blurring caused by the temporal filtering can be solved with the influence of gray value which is introduced to correct the filtering weight.