LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.
Citation: LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.

Image Fusion of Infrared and Visible Images Based on Residual Significance

More Information
  • Received Date: December 14, 2019
  • Revised Date: September 06, 2020
  • To make the fusion image show more image details and to obtain a better image visual effect, a fusion method based on residual significance is proposed. First, the infrared image is analyzed using residual significance to obtain its significance coefficients. Then, the source images are decomposed using a dual-tree complex wavelet transform, and the low- and high-frequency components are fused according to different fusion rules. Finally, the fusion image is reconstructed using the inverse transformation of a dual-tree complex wavelet. Experimental results showed that the fusion method proposed in this paper produced higher quality images and better visual effects than those of the traditional fusion method.
  • [1]
    敬忠良, 肖刚, 李振华.图像融合——理论与应用[M].北京:高等教育出版社, 2007.

    JING Zhongliang, XIAO Gang, LI Zhenhua. Image FusionTheory and Application[M]. Beijing: Higher Education Press, 2007.
    [2]
    刘信乐.热红外图像与可见光图像融合方法研究[D].成都: 电子科技大学, 2013.

    LIU Xinle. Research on Fusion Method of infrared image and visible image[D]. Chengdu: University of Electronic Science and Technology of China, 2013.
    [3]
    余美晨, 孙玉秋, 王超.基于拉普拉斯金字塔的图像融合算法研究[J].长江大学学报:自然科学版, 2016, 13(34): 770-776. http://www.cnki.com.cn/Article/CJFDTOTAL-CJDL201634005.htm

    YU Meichen, SUN Yuqiu, WANG Chao. Image fusion algorithm based on Laplacian pyramid[J]. Journal of Yangtze University: Natural Science, 2016, 13(34): 770-776. http://www.cnki.com.cn/Article/CJFDTOTAL-CJDL201634005.htm
    [4]
    Ashish V Vanmali, Vikram M Gadre. Visible and NIR image fusion using weight-map-guided Laplacian–Gaussian pyramid for improving scene visibility[J]. Springer Nature, 2017(6): 1063-1082.
    [5]
    Gonzalo P, Jesus M A wavelet-based image fusion tutorial[J]. Pattern Recognition, 2004, 37(9): 1855-1872.
    [6]
    Seal Ayan, Bhattacharjee Debotosh, NasipuriMita. A trous wavelet transform based hybrid image fusion for face recognition using region classifiers[J]. Expert Systems, 2018(12): 2185-2188.
    [7]
    王少杰, 潘晋孝, 陈平.基于双树复小波变换的图像融合[J].核电子学与探测技术, 2015, 35(7): 726-728.

    WANG Shaojie, PAN Jinxiao, CHEN Ping. Image fusion based on DT-CWT[J]. Nuclear Electronics & Detection Technology, 2015, 35(7): 726-728.
    [8]
    林子慧, 魏宇星, 张建林, 等.基于显著性图的红外与可见光图像融合[J].红外技术, 2019, 41(7): 640-645. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201810021

    LIN Zihui, WEI Yuxing, ZHANG Jianglin, et al. Image fusion of infrared image and visible image based on saliency map[J]. Infrared Technology, 2019, 41(7): 640-645. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201810021
    [9]
    TIAN Huawei, FANG Yuming. Salient region detection by fusing bottom-up and top-down features extracted from single image[J]. IEEE Transaction on Image Processing, 2014, 23(10): 4389-4397. DOI: 10.1109/TIP.2014.2350914
    [10]
    HOU X, ZHANG L. Salient detection: A spectral residual approach[C]//IEEE Conference on Computer Vison and Pattern Recognition, 2007: 18-23.
    [11]
    郭玲, 杨斌.基于视觉显著性的红外与可见光图像融合[J].计算机科学, 2015, 42(6): 211-214. http://www.cnki.com.cn/Article/CJFDTotal-GXYQ201604005.htm

    GUO Ling, YANG Bin. Image fusion of infrared image and visible image based on visual saliency[J]. Computer Science, 2015, 42(6): 211-214. http://www.cnki.com.cn/Article/CJFDTotal-GXYQ201604005.htm
    [12]
    张承鸿, 李范鸣, 吴滢跃.基于视觉显著性与对比度增强的红外图像融合[J].红外技术, 2017, 39(5): 421-426. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201612035

    ZHANG Chenghong, LI Fanming, WU Yingyue. Image fusion of infrared image and visible image based onvisual saliency and contrast enhancement[J]. Infrared Technology, 2017, 39(5): 421-426. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201612035
    [13]
    ZHENG Y F, Essock E. A new metric based on extended spatial frequency and its application to DWT based fusion algorithms[J]. Information Fusion, 2007, 8(2): 177-192. DOI: 10.1016/j.inffus.2005.04.003
    [14]
    QU G, ZHANG D, YAN P. Information measure for performance of image fusion[J]. Electron Lett, 2002, 38(7): 313-315. DOI: 10.1049/el:20020212
  • Related Articles

    [1]TONG Yaonan, YANG Haitao, CAO Zhiqi, CUI Jianshan, LIU Zhi. Infrared Image Fusion Enhancement Algorithm Based on Improved Wavelet Threshold Function and Full-Scale Retinex[J]. Infrared Technology , 2024, 46(3): 332-341.
    [2]LIU Qihang, HE Mingxia, ZHAO Jinwu, LI Yan. Terahertz Imaging of Caries Wavelet Gradient Domain Reconstruction Fusion[J]. Infrared Technology , 2023, 45(8): 890-896.
    [3]JIANG Mai, SHA Guijun, LI Ning. Infrared and Low-level Visible Light Images Fusion Based on Perception Unified Color Space and Dual Tree Complex Wavelet Transform[J]. Infrared Technology , 2022, 44(7): 716-725.
    [4]SHEN Xuechen, LIU Jun, GAO Ming. Polarizing Image Fusion Algorithm Based on Wavelet-Contourlet Transform[J]. Infrared Technology , 2020, 42(2): 182-189.
    [5]ZHEN Mei, WANG Shupeng. An Adaptive Weighted Average Fusion Method for Visible and Infrared Images[J]. Infrared Technology , 2019, 41(4): 341-346.
    [6]HUANG Fusheng, LIN Suzhen. Multi-Band Image Fusion Rules Comparison Based on the Laplace Pyramid Transformation Method[J]. Infrared Technology , 2019, 41(1): 64-71.
    [7]FAN Dong-yan, CAI Yu. Research on the Fusion of Dual-source Traffic Image Based on Transform Domain and Edge Detection[J]. Infrared Technology , 2015, (9): 740-745.
    [8]CHENG Jian, WANG Jing-dong, LI Peng. Research on Wavelet Basis Selection in the Image Fusion in SAR and Visual[J]. Infrared Technology , 2008, 30(3): 158-162. DOI: 10.3969/j.issn.1001-8891.2008.03.010
    [9]XU Kai-yu, LI Shuang-yi. A Images Fusion Algorithm Based on Wavelet Transform[J]. Infrared Technology , 2007, 29(8): 455-458. DOI: 10.3969/j.issn.1001-8891.2007.08.006
    [10]TAO Bing-jie, WANG Jing-ru, XU Jun-ping. Study on Image Fusion Based on Different Fusion Rules of Wavelet Transform[J]. Infrared Technology , 2006, 28(7): 431-434. DOI: 10.3969/j.issn.1001-8891.2006.07.014
  • Cited by

    Periodical cited type(8)

    1. 杨帆,王志社,孙婧,余朝发. 红外与可见光图像交互自注意力融合方法. 光子学报. 2024(06): 221-232 .
    2. 张宗包. 基于图像融合技术的变电站二次设备热故障自主定位研究. 机械与电子. 2023(03): 18-22 .
    3. 王树泽,张志华,邓砚学. 基于机载高光谱遥感图像的城市绿地覆盖研究. 激光杂志. 2022(02): 77-81 .
    4. 王君尧,王志社,武圆圆,陈彦林,邵文禹. 红外与可见光图像多特征自适应融合方法. 红外技术. 2022(06): 571-579 . 本站查看
    5. 陈海峰,庄金雷,朱标,李培华,杨潘,刘丙友,樊璇. 基于改进Canny算子的图像边缘融合方法. 新乡学院学报. 2022(12): 23-27 .
    6. 管声启,胡璐萍,常江,倪奕棋,王琪璇,管宇灿,张理博. 基于视觉显著模型的织物起球等级评价. 西安工程大学学报. 2021(04): 20-27 .
    7. 杨九章,刘炜剑,程阳. 基于对比度金字塔与双边滤波的非对称红外与可见光图像融合. 红外技术. 2021(09): 840-844 . 本站查看
    8. 杨雅芳. 一种基于小波去噪的遥感图像显著性区域检测算法. 吉林化工学院学报. 2021(09): 47-52 .

    Other cited types(8)

Catalog

    Article views (285) PDF downloads (42) Cited by(16)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return