QIAN Zhenlong, CHEN Bo. Image Fusion Algorithm Based on Thermal Radiation Information Retention[J]. Infrared Technology , 2021, 43(9): 861-868.
Citation: QIAN Zhenlong, CHEN Bo. Image Fusion Algorithm Based on Thermal Radiation Information Retention[J]. Infrared Technology , 2021, 43(9): 861-868.

Image Fusion Algorithm Based on Thermal Radiation Information Retention

More Information
  • Received Date: October 20, 2020
  • Revised Date: December 24, 2020
  • Focusing on the issue that existing algorithms of infrared and visible image fusion cannot retain thermal radiation information from infrared images, an image fusion algorithm based on thermal radiation information retention was proposed. Multi-scale decomposition of infrared and visible light images was performed through NSCT transformation to obtain the respective high-frequency sub-bands and low-frequency sub-bands. The low-frequency sub-bands of visible light were extracted by the Laplacian and superimposed with the infrared low-frequency sub-bands to obtain low-frequency sub-bands of the fused image. The fusion rule, which is based on point sharpness, and detail enhancement were used to obtain the high-frequency coefficients of the high-frequency part; the fused image was then reconstructed through inverse NSCT transformation. The experimental results indicate that compared with other image fusion algorithms, the proposed algorithm can retain the thermal radiation information of infrared images, while maintaining good performance with clear details, and is superior to other algorithms in several objective evaluation indices. The proposed algorithm has better visual effects and a good visual experience after pseudo-color transformation, which verifies the effectiveness and feasibility of the proposed algorithm.
  • [1]
    谢春宇, 徐建, 李新德, 等. 基于深度学习的红外与可见光图像融合方法[J]. 指挥信息系统与技术, 2020, 11(2): 15-20, 38. https://www.cnki.com.cn/Article/CJFDTOTAL-ZHXT202002003.htm

    XIE Chunyu, XU Jian, LI Xinde, et al. Infrared and visible image fusion method based on deep learning[J]. Command Information System and Technology, 2020, 11(2): 15-20, 38. https://www.cnki.com.cn/Article/CJFDTOTAL-ZHXT202002003.htm
    [2]
    Rajiv S, Ashish K. Multiscale Medical image fusion in wavelet domain[J]. The Scientific World Journal, 2013, 2013: 521034. http://www.scienceopen.com/document_file/6e3eb747-a10e-42b1-8a95-0a0060e9b4b5/PubMedCentral/6e3eb747-a10e-42b1-8a95-0a0060e9b4b5.pdf
    [3]
    Padma Ganasala, Achanta Durga Prasad. Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain[J]. International Journal of Imaging Systems and Technology, 2020, 30(3): 544-557. DOI: 10.1002/ima.22393
    [4]
    Do Minh N, Vetterli Martin. The contourlet transform: an efficient directional multiresolution image representation[J]. IEEE Transactions on Image Processing, 2005, 14(12): 1-16. DOI: 10.1109/TIP.2005.861050
    [5]
    Mertens T, Kaut Z J, Van Reeth F. Exposure fusion: a simple and practical alternative to high dynamic range photography[J]. Computer Graphics Forum, 2009, 28(1): 161-171. DOI: 10.1111/j.1467-8659.2008.01171.x
    [6]
    Da Cunha A L, Zhou J, Do M N. The nonsubsampled contourlet transform: theory, design, and applications[J]. IEEE Transactions on Image Processing, 2006, 15: 3089-3101. DOI: 10.1109/TIP.2006.877507
    [7]
    XING Xiaoxue, LIU Cheng, LUO Cong, et al. Infrared and visible image fusion based on nonlinear enhancement and NSST decomposition[J]. EURASIP Journal on Wireless Communications and Networking, 2020, 2020(1): 694-700. DOI: 10.1186/s13638-020-01774-6
    [8]
    WANG Z, LI X, DUAN H, et al. Multifocus image fusion using convolutional neural networks in the discrete wavelet transform domain[J]. Multimedia Tools and Applications, 2019, 78(24): 34483-34512. DOI: 10.1007/s11042-019-08070-6
    [9]
    杨艳春, 王艳, 党建武, 等. 基于RGF和改进自适应Unit-Linking PCNN的红外与可见光图像融合[J]. 光电子·激光, 2020, 31(4): 401-410. https://www.cnki.com.cn/Article/CJFDTOTAL-GDZJ202004010.htm

    YANG Yanchun, WANG Yan, DANG Jianwu, et al. Infrared and visible image fusion based on RGF and improved adaptive Unit-Linking PCNN[J]. Journal of Optoelectronics·Laser, 2020, 31(4): 401-410. https://www.cnki.com.cn/Article/CJFDTOTAL-GDZJ202004010.htm
    [10]
    林玉池, 周欣, 宋乐, 等. 基于NSCT变换的红外与可见光图像融合技术研究[J]. 传感器与微系统, 2008, 27(12): 45-47. DOI: 10.3969/j.issn.1000-9787.2008.12.015

    LIN Yuchi, ZHOU Xin, SONG Le, et al. Infrared and visible image fusion technology based on non subsampled contourlet transform[J]. Transducer and Microsystem Technologies, 2008, 27(12): 45-47. DOI: 10.3969/j.issn.1000-9787.2008.12.015
    [11]
    程永翔, 刘坤, 贺钰博. 基于卷积神经网络与视觉显著性的图像融合[J]. 计算机应用与软件, 2020, 37(3): 225-230. DOI: 10.3969/j.issn.1000-386x.2020.03.038

    CHENG Yongxiang, LIU Kun, HE Yubo. Image fusion with convolutional neural network and visual saliency[J]. Computer Applications and Software, 2020, 37(3): 225-230. DOI: 10.3969/j.issn.1000-386x.2020.03.038
    [12]
    巩稼民, 刘爱萍, 马豆豆, 等. 结合邻域特征与IDCSCM的红外与可见光图像融合[J]. 激光与红外, 2020, 50(7): 889-896. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202007020.htm

    GONG Jiamin, LIU Aiping, MA Doudou, et al. Infrared and visible image fusion combining neighborhood features with IDCSCM[J]. Laser & Infrared, 2020, 50(7): 889-896. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202007020.htm
    [13]
    孙英慧, 蒲东兵. 基于拉普拉斯算子的边缘检测研究[J]. 长春师范学院学报: 人文社会科学版, 2009, 28(12): 4-6. https://www.cnki.com.cn/Article/CJFDTOTAL-CCSS200912002.htm

    SUN Yinghui, PU Dongbing. Edge Detection Research on Laplace Operator[J]. Journal of Changchun Normal University: Humanities and Social Sciences Edition, 2009, 28(12): 4-6. https://www.cnki.com.cn/Article/CJFDTOTAL-CCSS200912002.htm
    [14]
    彭土有, 吴洁, 彭俊. 拉普拉斯边缘检测算法的改进及其在探地雷达中的应用[J]. 现代雷达, 2020, 42(8): 41-45. https://www.cnki.com.cn/Article/CJFDTOTAL-XDLD202008008.htm

    PENG Tuyou, WU Jie, PENG Jun. Improvement of Laplacian edge detection algorithm and its application on GPR[J]. Modern Radar, 2020, 42(8): 41-45. https://www.cnki.com.cn/Article/CJFDTOTAL-XDLD202008008.htm
    [15]
    Xydeas C S, Petrovi V. Objective image fusion performance measure[J]. Electronics Letters, 2000, 36(4): 308-309. DOI: 10.1049/el:20000267
  • Related Articles

    [1]XU Guangxian, ZHOU Weijie, MA Fei. Fusion of Hyperspectral and Multispectral Images Using a CNN Joint Multi-Scale Transformer[J]. Infrared Technology , 2025, 47(1): 52-62.
    [2]CHEN Chaoyang, JIANG Yuanyuan. Infrared and Visible Image Fusion Based on Deep Image Decomposition[J]. Infrared Technology , 2024, 46(12): 1362-1370.
    [3]CHEN Yanlin, WANG Zhishe, SHAO Wenyu, YANG Fan, SUN Jing. Multi-scale Transformer Fusion Method for Infrared and Visible Images[J]. Infrared Technology , 2023, 45(3): 266-275.
    [4]LI Yongping, YANG Yanchun, DANG Jianwu, WANG Yangping. Infrared and Visible Image Fusion Based on Transform Domain VGGNet19[J]. Infrared Technology , 2022, 44(12): 1293-1300.
    [5]SHEN Xuechen, LIU Jun, GAO Ming. Polarizing Image Fusion Algorithm Based on Wavelet-Contourlet Transform[J]. Infrared Technology , 2020, 42(2): 182-189.
    [6]HUANG Fusheng, LIN Suzhen. Multi-Band Image Fusion Rules Comparison Based on the Laplace Pyramid Transformation Method[J]. Infrared Technology , 2019, 41(1): 64-71.
    [7]GE Man-ling, WEI Meng-jia, YANG Hao-yu, SHI Peng-fei, CHEN Ying, FU Xiao-xuan, ZHANG Ji-chang, CHEN Yu-min. Simulation and Real-time Application of Infrared Thermal Image Rectification Technology of Rectification Algorithm of Double Threshold Segmentation in Pseudo-color Conversion[J]. Infrared Technology , 2015, (4): 272-276.
    [8]LI Wei-wei, YANG Feng-bao, LIN Su-zhen, HE Dong. Study on Pseudo-color Fusion of Infrared Polarization and Intensity Image[J]. Infrared Technology , 2012, 34(2): 109-113. DOI: 10.3969/j.issn.1001-8891.2012.02.010
    [9]LUO Shao-peng, LU Xun. A Self-feedback Multi-focus Color Image Fusion Based on Lifting Wavelet Transform And Features of Human Vision System[J]. Infrared Technology , 2008, 30(1): 31-34,38. DOI: 10.3969/j.issn.1001-8891.2008.01.008
    [10]XU Kai-yu, LI Shuang-yi. A Images Fusion Algorithm Based on Wavelet Transform[J]. Infrared Technology , 2007, 29(8): 455-458. DOI: 10.3969/j.issn.1001-8891.2007.08.006
  • Cited by

    Periodical cited type(0)

    Other cited types(1)

Catalog

    Article views (195) PDF downloads (42) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return