通道边缘增强的红外可见光融合网络

Channel And Edge Enhanced Infrared-Visible Fusion Network

  • 摘要: 针对红外与可见光图像融合中多模态特征互补性不足与语义信息弱化的问题,本文提出一种通道-边缘增强模块( CEBAM)。该模块通过跨层通道注意力机制与边缘引导分支协同优化特征融合,嵌入梯度残差密集块(GRDB)框架,构建新型网络CEASeFusion。CEBAM(Channel and Edge BoostAttention Module)采用轻量化设计(分组卷积+低秩分解)降低计算开销,并结合联合损失函数(内容损失、边缘一致性损失、语义感知损失)提升融合图像的语义感知能力。在MSRS数据测试集上的实验表明,CEASeFusion融合图像在EN、MI、VIF、EI等多个客观与主观指标上均优于主流方法,在分割模型BiSeNet上测试的语义分割平均交并比mIoU较基线模型SeAFusion提升5.6个百分点,推理速度在NVIDIA RTX 4060上达20 FPS,兼顾融合质量与实时性。该模型生成的融合图像显著提升了目标显著性与纹理细节的保持能力,特别适用于自动驾驶、交通监控、夜间安防、无人机巡检等需要实时、鲁棒环境感知的领域。

     

    Abstract: To address the issues of insufficient complementarity of multimodal features and weakened semantic information in infrared and visible image fusion, this paper proposes a Channel-Edge Boost Attention Module (CEBAM). This module collaboratively optimizes feature fusion through a cross-layer channel attention mechanism and an edge-guided branch, and embeds it into the Gradient Residual Dense Block (GRDB) framework to construct a novel network called CEASeFusion. The CEBAM (Channel and Edge Boost Attention Module) adopts a lightweight design (grouped convolution + low-rank decomposition) to reduce computational overhead, and combines a joint loss function (content loss, edge consistency loss, semantic perception loss) to enhance the semantic perception ability of the fused image. Experiments on the MSRS dataset show that the fused images of CEASeFusion outperform mainstream methods in multiple objective and subjective indicators such as EN, MI, VIF, and EI. The mean Intersection over Union (mIoU) of semantic segmentation tested on the BiSeNet segmentation model is 5.6 percentage points higher than that of the baseline model SeAFusion. The inference speed reaches 20 FPS on an NVIDIA RTX 4060, balancing fusion quality and real-time performance. The fused images generated by this model significantly improve the saliency of targets and the preservation ability of texture details, and are particularly suitable for fields that require real-time and robust environmental perception, such as autonomous driving, traffic monitoring, night security, and drone inspection.

     

/

返回文章
返回