陈清江, 汪泽百, 柴昱洲. 改进VGG网络的多聚焦图像的融合方法[J]. 应用光学, 2020, 41(3): 500-507. DOI: 10.5768/JAO202041.0302003
引用本文: 陈清江, 汪泽百, 柴昱洲. 改进VGG网络的多聚焦图像的融合方法[J]. 应用光学, 2020, 41(3): 500-507. DOI: 10.5768/JAO202041.0302003
CHEN Qingjiang, WANG Zebai, CHAI Yuzhou. Multi-focus image fusion method based on improved VGG network[J]. Journal of Applied Optics, 2020, 41(3): 500-507. DOI: 10.5768/JAO202041.0302003
Citation: CHEN Qingjiang, WANG Zebai, CHAI Yuzhou. Multi-focus image fusion method based on improved VGG network[J]. Journal of Applied Optics, 2020, 41(3): 500-507. DOI: 10.5768/JAO202041.0302003

改进VGG网络的多聚焦图像的融合方法

Multi-focus image fusion method based on improved VGG network

  • 摘要: 为更好地保留原图像信息,提高图像融合性能,提出一种改进VGG卷积神经网络与边缘像素统计特征相结合的融合算法。首先,该算法将完整图像拆分成图像块,以图像块的预处理来获取较高的图像分类,精度达到0.985以上,以改进的VGG卷积神经网络来加快模型收敛速度,当图像块输入到网络当中,可以初步得到二分类的权值矩阵。其次,在高频细节部分,对于左聚焦图像和右聚焦图像的清晰模糊模块分别进行模糊化处理,根据像素点之间的统计特征经阈值分割后得到有明显边界的权值矩阵。最后,结合两次分割的权值矩阵,通过加权求和的融合策略,得到处处清晰的聚焦图像。为说明算法有效性,在实验部分展示其融合主观视觉效果图与信息熵等客观评价,该算法对比其他算法表现突出,可较好地保留原图像的信息。

     

    Abstract: In order to better retain the original image information and improve the image fusion performance, an improved fusion algorithm combining visual geometry group(VGG) convolutional neural network with edge pixel statistical features was proposed. Firstly, this algorithm divided the complete image into image blocks, preprocessed the image blocks to obtain a higher image classification accuracy of 0.985 or more, and used the improved VGG convolutional neural network to accelerate the convergence of the model. When the image blocks were input into the network, the weight matrix of binary classification could be preliminarily obtained. Secondly, in the high-frequency detail part, the clear blur modules of left-focus image and right-focus image were respectively subjected to blurring processing, and the weights matrix with obvious boundaries was obtained by the threshold segmentation based on the statistical feature between the pixel points. Finally, combined with the two-step weight matrix, the fusion strategy of weighted sum was used to obtain the clear focus image. In order to illustrate the effectiveness of the algorithm, the experimental part shows the objective evaluation of its fusion subjective visual effect diagram and information entropy, which is outstanding compared with other algorithms and can better retain the information of the original image.

     

/

返回文章
返回