基于显著性的双鉴别器GAN图像融合算法

Saliency-based dual discriminator GAN image fusion algorithm

  • 摘要: 针对红外图像与可见光图像在不同场景的特征表达不同的问题,提出一种基于显著性的双鉴别器生成对抗网络方法,将红外与可见光的特征信息相融合。区别于传统的生成对抗网络,该算法采用双鉴别器方式分别鉴别源图像与融合图像中的显著性区域,以两幅源图像的显著性区域作为鉴别器的输入,使融合图像保留更多的显著特征;并将梯度约束引入其损失函数中,使显著对比度和丰富纹理信息保留在融合图像中。实验结果表明:本文方法在熵值(entropy, EN)、平均梯度(mean gradient, MG)、空间频率(spatial frequency, SF)及边缘强度(edge intensity, EI)4个评价指标中均优于其他对比算法。该研究实现了红外图像与可见光图像高效融合,有望在目标识别等领域中获得应用。

     

    Abstract: To address the problem that infrared images and visible images have different feature expressions in different scenes, an saliency-based dual discriminator generative adversarial network method was proposed to fuse the infrared and visible feature information. Different from the traditional generative adversarial network, a dual discriminator approach was adopted to discriminate the saliency regions in the source images and the fusion images respectively in this algorithm, and the saliency regions of the two source images were used as the input of the discriminator so that the fusion image retained more salient features. The gradient constraint was introduced into its loss function so that the salient contrast and rich texture information could retain in the fusion image. The experimental results show that the proposed method outperforms other comparison algorithms in four evaluation indexes: entropy (EN), mean gradient (MG), spatial frequency (SF) and edge intensity (EI). This study achieves efficient fusion of infrared images and visible images, which is expected to gain applications in fields such as target recognition.

     

/

返回文章
返回