基于多尺度卷积挤压激励网络的红外与可见光图像融合

Infrared and Visible Image Fusion Based on a Multi-Scale Convolution Squeeze-and-Excitation Network

  • 摘要: 针对传统红外与可见光图像融合方法存在部分深度细节特征丢失的问题,本文提出一种基于多尺度卷积挤压激励融合网络框架进行红外与可见光图像融合。首先,提出一种挤压激励残差密集块提取源图像的深度特征,能够充分利用各个卷积层实现特征的重用;然后,在融合层设计双通道多尺度卷积注意力融合层网络对源图像提取的特征进行融合,并基于该融合层网络的特点设计相应的损失函数;最后,设计与编码器匹配的解码器网络实现特征重构。在公开数据集上的实验结果表明,所提融合网络在主观和客观评价上与近年来典型相关方法比较具有更好的综合性能,能保留更多的深度细节特征。

     

    Abstract: To address the partial loss of depth details in traditional infrared and visible image fusion methods, this study proposes a framework based on a multi-scale convolution squeeze–excitation fusion network for infrared and visible image fusion. First, a squeeze-and-excitation residual dense block was constructed to extract the deep features of the source images, which can fully utilize the reuse of features in each convolutional layer. Subsequently, a dual-channel multi-scale convolution attention fusion network was designed in the fusion layer to fuse the extracted features of the source images. The corresponding loss functions were designed based on the characteristics of this fusion network. Finally, a decoder network that matched the encoder was designed to achieve feature reconstruction. Experiments using public datasets revealed that the proposed fusion network had a better comprehensive performance in subjective and objective evaluations and preserved more deep-detail features compared to typical relevant methods from recent years.

     

/

返回文章
返回