基于生成对抗网络的图像域转换算法

Image Domain Conversion Algorithm Based on Generative Adversarial Network

  • 摘要: 针对传统生成对抗网络在可见光图像转换至红外图像任务过程中存在细节纹理丢失,噪声以及转换效果不佳等问题,提出了基于Pix2Pix的图像域转换算法——Enhanced-Pix2Pix。首先提出了由深度残差连接编码器和基于双注意力机制的特征融合模块组成的生成器结构;同时,设计了一种多尺度判别器和复合损失函数增强模型的判别能力;最后,在RGB-T234可见光红外配对数据集上进行实验。实验结果表明,本文提出的图像域转换算法相比于传统生成对抗网络模型CycleGAN和Pix2Pix,PSNR指标分别提升了5.716和1.827,SSIM指标分别提升了0.134和0.049。

     

    Abstract: In this study, we proposed Enhanced-Pix2Pix as an infrared image migration algorithm based on Pix2Pix to address the issues of loss of detail in textures, noise, and poor conversion performance in traditional generative adversarial networks during the process of transferring visible light images to infrared images. First, a generator structure consisting of a deep radial connected encoder and a feature fusion module based on a convolution block attention module, and a multi-scale discriminator and composite loss function were designed to enhance the ability of the model to discriminate between objects. Experiments were conducted on the RGB-T234 visible-infrared paired dataset. The experimental results show that the proposed image domain conversion algorithm improved the peak signal to noise ratio (PSNR) by 5.716 and 1.827 and the structural similarity index measure (SSIM) by 0.134 and 0.049, respectively, compared to the traditional generative adversarial network models CycleGAN and Pix2Pix.

     

/

返回文章
返回