纹理及边缘特征增强的多尺度图像融合算法

Multi-scale Image Fusion Algorithm for Texture and Edge Feature Enhancement

  • 摘要: 针对红外与可见光图像融合算法存在模型参数量大、效率低、特征提取不充分、细节纹理及边缘特征丢失等问题,本文提出了一种纹理及边缘特征增强的多尺度图像融合网络。首先,提出了边缘增强算子及边缘引导的注意力模块,以保留更多的边缘纹理信息并衰减不良伪影。其次,在多尺度通道注意力模块里融入深度可分离卷积和通道混洗操作,从而增强通道之间的交互能力并且降低时间复杂度。然后,将注意力特征融合里的顺序融合改进为双分支融合,以增强多尺度信息交互能力。最后,在多层感知机的基础上提出了卷积多层感知机,通过替换全连接层、增加深度可分离卷积和门控机制,在提供位置信息和增强表征能力的同时降低网络参数量。在TNO、MSRS、Roadscene数据集上的融合实验结果表明,相比于其他七种方法,文中方法的SD、SF、MI、SCD、SSIM指标平均分别提升了4.7%、7.9%、2.9%、1.7%、15.5%,融合后的图像边缘纹理清晰、对比度合适并且融合目标清晰可见。

     

    Abstract: A multiscale image fusion network with texture and edge feature enhancement was developed to overcome the problems imposed by the large number of model parameters, low efficiency, insufficient feature extraction, and loss of detail in texture and edge features when using infrared and visible image fusion algorithms. First, an edge enhancement operator and edge-guided attention module were developed to retain more edge texture information and attenuate bad artifacts. Second, deep separable convolution and channel shuffling operations were integrated into the multiscale channel attention module to enhance the interaction between channels and reduce the time complexity. Sequential attention feature fusion was changed to double-branch fusion to enhance the multiscale information interaction ability. Finally, a convolutional multilayer perceptron was developed to reduce the number of network parameters while providing location information and enhancing the representation ability by replacing the fully connected layer and adding a depth-separable convolution and gating mechanism. In fusion experiments on the TNO, MSRS, and road scene datasets, the SD, SF, MI, SCD, and SSIM indices of the proposed method increased by 4.7%, 7.9%, 2.9%, 1.7%, and 15.5%, respectively, compared with the results of seven other methods. The edge texture of the fused image was clear, the contrast was appropriate, and the fusion target was clearly visible.

     

/

返回文章
返回