基于深度学习的红外与可见光图像融合研究进展

Review of Deep Learning-Based Infrared and Visible Image Fusion

  • 摘要: 围绕基于深度学习算法的红外与可见光图像融合(infrared and visible image fusion,IVIF)技术展开系统研究。首先,全面阐述了主流深度学习模型在IVIF任务中的研究现状,深入剖析了各类方法的框架结构、核心特性及计算复杂度,揭示了不同模型在信息提取与重构上的优劣。其次,系统梳理了IVIF的主客观评价体系,详细分析了主观评价与客观评价指标。再次,汇总了当前公开的常用IVIF数据集,为算法提供参考。最后,针对现有方法的不足,探讨了未来IVIF在模型轻量化、配准适应性、任务驱动融合等方向的发展趋势。

     

    Abstract: This paper presents the results of a systematic study on infrared and visible image fusion (IVIF) technology based on deep learning algorithms. First, it comprehensively elaborates on the research status of mainstream deep learning models used for IVIF tasks; discusses the results of an in-depth analysis of the framework structures, core characteristics, and computational complexities of various methods; and reveals the advantages and disadvantages of different models for information extraction and reconstruction. Second, it systematically sorts the subjective and objective evaluation systems for IVIF and analyzes the focus dimensions of the subjective evaluation and applicable scenarios of objective evaluation metrics in detail. Third, the currently publicly available and commonly used IVIF datasets are summarized to provide a reference for algorithm verification and comparison. Finally, aiming at the shortcomings of the existing methods, future development trends for IVIF in the directions of model lightweighting, registration adaptability, and task-driven fusion are discussed.

     

/

返回文章
返回