生成对抗网络结合Transformer模块增强水下图像

Generative Adversarial Networks Combined with Transformer Module to Enhance Underwater Images

  • 摘要: 由于水下环境复杂多变,采集到的水下图像通常会产生严重的颜色失真、清晰度低和对比度低等问题,对此本文设计了一种基于生成对抗网络的水下图像增强模型。生成器采用U形网架构,利用多维差分深度融合卷积,提高特征提取能力。在跳跃连接部分搭建基于高效加法注意力的多尺度特征融合Transformer模块来获取多尺度像素和通道信息;在瓶颈层部分搭建基于多尺度扩张注意力的特征重建Transformer模块来捕获更深层次的图像信息,构建全局信息特征。在四种水下图像数据集上进行试验和测试,实验结果表明该模型有效解决了水下图像的色偏、细节模糊和对比度低等方面的问题。在LSUI数据集上的增强表现最优,PSNR、SSIM、UIQM分别达到了25.22、0.86、3.09。

     

    Abstract: Due to the complex and variable underwater environment, the collected underwater images usually produced serious problems such as color distortion, low clarity and low contrast. For this, an underwater image enhancement model based on generative adversarial network was designed by this paper. The generator adopted a U-shaped network architecture and utilized multi-dimensional differential deep fusion convolution to improve the feature extraction capability. Based on the efficient additive attention, a multiscale feature fusion Transformer module was built in the jump connection part to acquire multiscale pixel and channel information. In the bottleneck layer, a feature reconstruction Transformer module based on multi-scale dilated attention has been built to capture deeper image information and construct global features. Experiments and tests were carried out on four underwater image datasets, and the experimental results show that the proposed model effectively solves the problems of color bias, detail blurring and low contrast of underwater images. The enhancement performance on the LSUI dataset is optimal, with PSNR, SSIM, and UIQM reaching 25.22, 0.86 and 3.09, respectively.

     

/

返回文章
返回