Research and implementation of real-time fog and haze video image restoration system based on FPGA

YE Mao; HUANG Pingao; LYU Yang; TANG Ning; LIU Jianwei

doi:10.5768/JAO201940.0502004

Journal of Applied Optics > 2019 > 40(5): 812-817. > DOI: 10.5768/JAO201940.0502004

YE Mao, HUANG Pingao, LYU Yang, TANG Ning, LIU Jianwei. Research and implementation of real-time fog and haze video image restoration system based on FPGA[J]. Journal of Applied Optics, 2019, 40(5): 812-817. DOI: 10.5768/JAO201940.0502004

Citation:

PDF (1175 KB)

Research and implementation of real-time fog and haze video image restoration system based on FPGA

1.
National Demonstration Center for Experimental Education of Mechanical and Electrical Engineering Training, Guilin University of Electronic Technology, Guilin 541004, China
2.
Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen 518055, China
3.
Xi'an Institute of Applied Optics, Xi'an 710065, China

More Information

Received Date: October 29, 2018
Revised Date: March 03, 2019

Graphical Abstract

Abstract

Abstract

Aiming at the need of video surveillance and other outdoor video equipment for real-time restoration of video image under severe weather conditions such as fog and fog, an field-programmable gate array(FPGA) implementation method for fast image restoration algorithm was proposed. By appropriately reducing the complexity of the algorithm, the purpose of reducing time cost and hardware implementation complexity could be achieved.In this algorithm, a frame of video is decomposed into 3×3 small windows for operation, and a frame of video pixel calculation is replaced by a pipeline calculation of the center pixel of the window, so that each pixel's all operations are processed in 3 clock cycles, ensuring that the system can be restored in real time, and the hardware cost of the recovery module can be reduced.Experimental results show that the results of FPGA processing coincide with the results of MATLAB processing, the real-time processing resolution is 640×480, and the video can be displayed smoothly at 29 frames /s under the premise of ensuring the defogging effect.
- video restoration,
- FPGA,
- real-time,
- defog

FullText(HTML)

References (15)

References

[1]	TAREL L, HAUTIERE N. Fast visibility restoration from a single color or gray level image: 2009 IEEE 12th International Conference on Computer Vision, 20[C].Kyoto, Japan: IEEE, 2009.
[2]	HE Kaiming, SUN Jian, TANG Xiaoou. Single image haze removal using dark channel prior[C]// Computer Vision and Pattern Recognition, 2009(CVPR 2009).USA: IEEE, 2009.
[3]	LIU Qian, CHEN Maoyin, ZHOU Donghua. Fast haze removal from a single image[C]// 2013 25th Chinese Control and Decision Conference (CCDC).[S.l]: [s.n], 2013
[4]	刘光飞, 胡辽林.暗通道先验去雾算法的改进及FPGA实现[J].西安理工大学学报, 2016(1):77-82. http://d.old.wanfangdata.com.cn/Periodical/xalgdxxb201601015 LIU Guangfei, HU Liaolin. Improvement and FPGA implementation of dark channel priori dehazing algorithm[J]. Journal of Xi'an University of Technology, 2016(1):48-51 http://d.old.wanfangdata.com.cn/Periodical/xalgdxxb201601015
[5]	黄黎红.一种基于单尺度Retinex的雾天降质图像增强新算法[J].应用光学, 2010, 31(5):728-733. doi: 10.3969/j.issn.1002-2082.2010.05.011 HUANG Lihong. Fog-degraded image enhancement based on single-scale retinex[J].Journal of Applied Optics, 2010, 31(5):728-733. doi: 10.3969/j.issn.1002-2082.2010.05.011
[6]	曹亚辉, 刘峰.基于FPGA的高清实时视频去雾系统的设计与实现[J].电视技术, 2015, 39(7):48-51. http://d.old.wanfangdata.com.cn/Periodical/dsjs201507011 CAO Yahui, LIU Feng. Design and implementation of High-definition Real-time Video Dehazing system based on FPGA[J].Video Engineering, 2015, 39(7):45-51. http://d.old.wanfangdata.com.cn/Periodical/dsjs201507011
[7]	YANG Jiachen, BIN Jiang, LV Zhihan, et al. A real-time image dehazing method considering dark channel and statistics features[J]. Journal of Real-Time Image Processing, 2017, 13(3):1-12. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=45d4b38552c01381a63998f0d7b9cbe8
[8]	MCCARTNEY E J, JR F F H. Optics of the atmosphere: scattering by molecules and particles[M]. New Jersey:WILEY, 1976.
[9]	黄品高, 叶懋, 张子方, 等.一种暗通道先验去雾后图像参数的调节方法[J].电视技术, 2016, 40(7):118-122. http://d.old.wanfangdata.com.cn/Periodical/dsjs201607026 HUANG Pingao, YE Mao, ZHANG Zifang, et al. Method for adjusting the parameters of image dehazed by method of dark channel prior[J]. Video engineering, 2016, 40(7) : 118-122. http://d.old.wanfangdata.com.cn/Periodical/dsjs201607026
[10]	DAS D, CHAUDHURI S S, ROY S. Dehazing technique based on dark channel prior model with sky masking and its quantitative analysis[C]//2016 2nd International Conference on Control.[S.l]: [s.n.], 2016.
[11]	ZHANG Jiawan, Li Lliang, ZHANG Yi, et al. Video dehazing with spatial and temporal coherence[J]. The Visual Computer, 2011, 27(6-8):749-757. doi: 10.1007/s00371-011-0569-8
[12]	TAN R T.Visibility in bad weather from a single image[C]. USA: IEEE, 2008.
[13]	GU Zhenfei, JU Mingye, ZHANG Dengyin. A single image dehazing method using average saturation prior[J]. Mathematical Problems in Engineering, 2017, 2017:1-17. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=3ca6bab6230592520952e56ee73654f2
[14]	LIANG Zhonghao, PENG Dewei, JIN Yanxu, et al. Single image dehazing algorithm based on traffic scene region enhancement[J]. Journal of Computer Applications, 2018, 38(5):1420-1426. http://d.old.wanfangdata.com.cn/Periodical/jsjyy201805035
[15]	ALAJARMEH A, SALAM R A, ABODULRAHIM K, et al. Real-time framework for image dehazing based on linear transmission and constant-time airlight estimation[J]. Information Sciences, 2018, 436-437:108-130. doi: 10.1016/j.ins.2018.01.009

Cited By

Cited by

Periodical cited type(6)

1.	杨朝政，李淑英. 基于虚拟现实技术的激光三维图像优化系统设计. 激光杂志. 2023(04): 152-157 .
2.	郏露锋，张凯亮. 基于LabVIEW的大视场激光视频图像采集系统. 激光杂志. 2023(04): 259-264 .
3.	张宇驰，陈义，李鸿. 基于视频技术的煤矿在线应急预警系统的研究与应用. 煤炭技术. 2022(02): 189-193 .
4.	姜睿林，陈春晓，崔建良，徐俊琪. 基于FPGA的内窥镜窄带光生成方法研究. 生物医学工程研究. 2022(01): 7-12 .
5.	张泽宇，张弘，伍凌帆，杨一帆，李旭亮. 基于FPGA的实时Bayer解马赛克算法与实现. 应用光学. 2022(02): 240-247 . 本站查看
6.	格日勒，王刚，柳智鑫. 基于视频技术的煤矿在线应急预警系统研究. 能源与环保. 2021(09): 41-45 .

Other cited types(4)

Get Citation

PDF

XML

Article views (1012) PDF downloads (67) Cited by(10)

Turn off MathJax

Article Contents

Abstract

References

Research and implementation of real-time fog and haze video image restoration system based on FPGA