Dual-head enhancement and non-uniform correction for underwater image enhancement algorithm

YANG Xiao; SUN Bangyong

doi:10.5768/JAO202445.0202002

Journal of Applied Optics > 2024 > 45(2): 354-364. > DOI: 10.5768/JAO202445.0202002

YANG Xiao, SUN Bangyong. Dual-head enhancement and non-uniform correction for underwater image enhancement algorithm[J]. Journal of Applied Optics, 2024, 45(2): 354-364. DOI: 10.5768/JAO202445.0202002

Citation:

PDF (4889 KB)

Dual-head enhancement and non-uniform correction for underwater image enhancement algorithm

YANG Xiao^1,,
SUN Bangyong^{1, 2, ,}

1.
College of Printing, Packaging and Digital Media, Xi'an University of Technology, Xi'an 710048, China
2.
Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, China

More Information

Received Date: May 04, 2023
Revised Date: August 06, 2023
Available Online: February 27, 2024

Graphical Abstract

Abstract

Abstract

Affected by the high turbidity, insufficient illumination and poor uniformity of the underwater environment, the images obtained by imaging mechanisms have defects such as low contrast, blurred details and color distortion. To handle above problems, an underwater image enhancement algorithm based on a dual-head enhancement and non-uniform correction was proposed. The dual-head enhanced network was constructed to extract multi-scale features from shallow information and to fuse the context information of different channels, which was conducive to the enhancement of low contrast of underwater images. Furthermore, the constructed non-uniform correction network was used to perform nonlinear weighted fusion of different channels and positions of the image, which was conducive to the recovery of color consistency and brightness. Compared with the 10 algorithms, the optimal value of the peak signal-to-noise ratio and structural similarity in the UIEB test set was improved by 4.02 dB and 0.120, decreased by 1.51 on the CIEDE2000 index, and decreased by 2.13 dB, 0.025 and 0.48 on the LUSI test set, respectively. Experimental results show that the proposed algorithm has a significant enhancement effect for non-uniform underwater images, and is more in line with the characteristics of the human eye.
- deep learning,
- underwater image enhancement,
- underwater imaging model,
- dual-head enhancement,
- non-uniform correction

FullText(HTML)

References (31)

References

[1]	蔡鹏, 朱海荣, 任永健, 等. 水下环境光学特性测量方法[J]. 应用光学,2018,39(1):83-87. CAI Peng, ZHU Hairong, REN Yongjian, et al. Optical properties measurement of underwater environment[J]. Journal of Applied Optics,2018,39(1):83-87.
[2]	于洪志, 孙春生, 胡艺铭. 一种全局参数估计的水下主动偏振去雾算法[J]. 应用光学,2020,41(1):107-113. doi: 10.5768/JAO202041.0102007 YU Hongzhi, SUN Chunsheng, HU Yiming. Underwater active polarization defogging algorithm for global parameter estimation[J]. Journal of Applied Optics,2020,41(1):107-113. doi: 10.5768/JAO202041.0102007
[3]	CHAO Liu, WANG Meng. Removal of water scattering[C]//2010 2nd International Conference on Computer Engineering and Technology. Chengdu, China: IEEE, 2010: V2-35-39.
[4]	CHIANG J Y, CHEN Y C. Underwater image enhancement by wavelength compensation and dehazing[J]. IEEE Transaction on Image Processing,2011,21(4):1756-1769.
[5]	HE K M, SUN J, TANG X O. Single image haze removal using dark channel prior[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence,2010,33(12):2341-2353.
[6]	ANCUTI C, ANCUTI C O, HABER T, et al. Enhancing underwater images and videos by fusion [C]// 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, USA: IEEE, 2012: 81-88.
[7]	ANCUTI C O, ANCUTI C, VLEESCHOUWER C D, et al. Color channel compensation (3C): a fundamental pre-processing step for image enhancement[J]. IEEE Transaction on Image Processing,2020,29:2653-2665. doi: 10.1109/TIP.2019.2951304
[8]	LAND E H, MCCANN J J. Lightness and retinex theory[J]. Journal of Optical Society of America,1971,61(1):1-11. doi: 10.1364/JOSA.61.000001
[9]	FAN Chunnian, ZHANG Fuyan. Homomorphic filtering based illumination normalization method for face recognition[J]. Pattern Recognition Letters,2011,32(10):1468-1479. doi: 10.1016/j.patrec.2011.03.023
[10]	LI C Y, GUO C L, REN W Q, et al. An underwater image enhancement benchmark dataset and beyond[J]. IEEE Transaction on Image Processing,2019,29:4376-4389.
[11]	LI C Y, ANWAR S, HOU J H, et al. Underwater image enhancement via medium transmission-guided multi-color space embedding[J]. IEEE Transaction on Image Processing,2021,30:4985-5000. doi: 10.1109/TIP.2021.3076367
[12]	CAO X T, RONG S H, LIU Y B, et al. NUICNet: non-uniform illumination correction for underwater image using fully convolutional network[J]. IEEE Access,2020,8:109989-110002. doi: 10.1109/ACCESS.2020.3002593
[13]	严浙平, 曲思瑜, 邢文. 水下图像增强方法研究综述[J]. 智能系统学报,2022,17(5):860-873. YAN Zheping, QU Siyu, XING Wen. An overview of underwater image enhancement methods[J]. CAAI Transaction on Intelligent Systems,2022,17(5):860-873.
[14]	GORDON H R. Can the Lambert-Beer law be applied to the diffuse attenuation coefficient of ocean water?[J]. Limnology and Oceanography,1989,34(8):1389-1409. doi: 10.4319/lo.1989.34.8.1389
[15]	简梦真, 李旦, 张建秋. 基于非均匀入射光成像模型的水下图像复原[J]. 光学学报,2021,41(15):1501003. doi: 10.3788/AOS202141.1501003 JIAN Mengzhen, LI Dan, ZHANG Jianqiu. Underwater image restoration based on non-uniform incident light imaging model[J]. Acta Optica Sinica,2021,41(15):1501003. doi: 10.3788/AOS202141.1501003
[16]	MCGLAMERY B L. A computer model for underwater camera systems[J]. SPIE Proceedings on Ocean Optics VI,1980,208:221-231. doi: 10.1117/12.958279
[17]	ZHANG Q L, YANG Y B. Sa-net: Shuffle attention for deep convolutional neural networks [C]// ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Toronto, ON, Canada: IEEE, 2021: 2235-2239.
[18]	PENG L T, ZHU C L, BIAN L H, et al. U-shape transformer for underwater image enhancement[EB/OL]. (2022-06-12)[2023-04-30]. http://arxiv.org/abs/2111.11843.
[19]	KORHONEN J AND YOU J. Peak signal-to-noise ratio revisited: Is simple beautiful? [C]// 2012 Fourth International Workshop on Quality of Multimedia Experience. Melbourne, VIC, Australia: IEEE, 2012: 37-38.
[20]	WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transaction on image processing,2004,13(4):600-612. doi: 10.1109/TIP.2003.819861
[21]	YANG M, SOWMYA A. An underwater color image quality evaluation metric[J]. IEEE Transaction on Image Processing,2015,24(12):6062-6071. doi: 10.1109/TIP.2015.2491020
[22]	PANETTA K, GAO C, AGAIAN S. Human-visual-system-inspired underwater image quality measures[J]. IEEE Journal of Oceanic Engineering,2015,41(3):541-551.
[23]	SHARMA G, WU W, DALAL E N. The CIEDE2000 color-difference formula: implementation notes, supplementary test data, and mathematical observations[J]. Color Research & Application,2005,30(1):21-30.
[24]	PENG Y T, CAO K M, COSMAN P C. Generalization of the dark channel prior for single image restoration[J]. IEEE Transaction on Image Processing,2018,27(6):2856-2868. doi: 10.1109/TIP.2018.2813092
[25]	GALDRAN A, PARDO D, PICÓN A, et al. Automatic red-channel underwater image restoration[J]. Journal of Visual Communication and Image Representation,2015,26:132-145. doi: 10.1016/j.jvcir.2014.11.006
[26]	FU X Y, ZHUANG P X, HUANG Y, et al. A retinex-based enhancing approach for single underwater image [C]// 2014 IEEE international conference on image processing (ICIP). Paris, France: IEEE, 2014: 4572-4576.
[27]	DREWS P, NASCIMENTO E, MORAES F, et al. Transmission estimation in underwater single images [C]// Proceedings of the IEEE international conference on computer vision workshops. Sydney, Australia: IEEE, 2013: 825-830.
[28]	LI C Y, ANWAR S, PORIKLI F. Underwater scene prior inspired deep underwater image and video enhancement[J]. Pattern Recognition,2020,98:107038. doi: 10.1016/j.patcog.2019.107038
[29]	ISLAM M J, XIA Y, SATTAR J. Fast underwater image enhancement for improved visual perception[J]. IEEE Robotics and Automation Letters,2020,5(2):3227-3234. doi: 10.1109/LRA.2020.2974710
[30]	BERMAN D, LEVY D, AVIDAN S, et al. Underwater single image color restoration using haze-lines and a new quantitative dataset[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence,2020,43(8):2822-2837.
[31]	REN T D, XU H Y, JIANG G Y, et al. Reinforced swin-convs transformer for underwater image enhancement[EB/OL]. (2022-05-01)[2023-04-30]. http://arxiv.org/abs/2205.00434.

[1]	LIU Tong, SUI Xiubao, CHEN Qian, CHEN Xingliao. Scale-separated non-uniformity correction algorithm based on spatio-temporal rolling guidance filter[J]. Journal of Applied Optics, 2025, 46(2): 309-318. DOI: 10.5768/JAO202546.0202003
[2]	LIU Xiujuan, YANG Ye, ZHENG Zhou, LIU Huan. Study on the test method of Photoresponse non-uniformity based on EBAPS[J]. Journal of Applied Optics.
[3]	CHEN Qingjiang, WANG Xuanjun, SHAO Fei. Underwater image enhancement based on multiscale residual attention networks[J]. Journal of Applied Optics, 2024, 45(1): 89-98. DOI: 10.5768/JAO202445.0102003
[4]	WEI Yonghui, WANG Shiyu, GUO Zhen, CAI Defang, LI Bingbin, WU Mengyao. Efficiency loss induced by non-uniform gain distribution in high power solid state lasers[J]. Journal of Applied Optics, 2019, 40(4): 542-550. DOI: 10.5768/JAO201940.0401003
[5]	Meng Siqi, Ren Kan, Lu Dongming, Gu Guohua, Chen Qian. A non-uniformity correction algorithm of infrared image sequences based on constant-statistics[J]. Journal of Applied Optics, 2017, 38(2): 304-308. DOI: 10.5768/JAO201738.0206002
[6]	Zhu Hui, Zhang Yong, Chen Zhi-xue, Dong Qi-lin, Liu Wan-gang, Luo Bei-bei. Infrared real-time calibration technology based on temperature control blackbody[J]. Journal of Applied Optics, 2014, 35(5): 884-890.
[7]	KONG Peng, HOU Min, LUO Bei-bei, YANG Dong, YI Xing-guo, LIU Wan-gang, ZHANG Wei. Real-time non-uniformity correction algorithm for infraredsearch and track system[J]. Journal of Applied Optics, 2014, 35(2): 327-331.
[8]	XU Xin-hang, YANG Hong-bo, GAO Yun-guo, WANG Bing. Auto-switch device for non-uniformity correction of infrared camera[J]. Journal of Applied Optics, 2013, 34(4): 658-662.
[9]	JIN Wei-qi, CAO Yang, LIU Chong-liang, LIU Xiu, DONG Li-quan, ZHANG Chang-quan. Uncooled infrared focal plane array detector module with the self-adaptive non-uniformity correction function[J]. Journal of Applied Optics, 2009, 30(2): 348-352.
[10]	ZHANG Yong, BAI Gui-ming, ZHU Hui. Non-uniformity correction for scanning thermal imager[J]. Journal of Applied Optics, 2008, 29(2): 170-173.

Cited By

Cited by

Periodical cited type(1)

周君，高焱，姜晴. 双边滤波下的低光照激光雷达图像超分辨增强技术. 激光杂志. 2024(12): 131-137 .

Other cited types(1)

Get Citation

PDF

XML

Article views (193) PDF downloads (49) Cited by(2)

Turn off MathJax

Article Contents

Abstract

References

Dual-head enhancement and non-uniform correction for underwater image enhancement algorithm