Image Fusion of Infrared and Visible Images Based on Residual Significance

LI Chenyang; DING Kun; WENG Shuai; WANG Li

Volume 42 Issue 11

Nov. 2020

Turn off MathJax

Article Contents

Article Navigation > Infrared Technology > 2020 > 42(11): 1042-1047

LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.

Citation:

LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.

LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.

Citation:

LI Chenyang, DING Kun, WENG Shuai, WANG Li. Image Fusion of Infrared and Visible Images Based on Residual Significance[J]. Infrared Technology , 2020, 42(11): 1042-1047.

PDF( 1119 KB)

Image Fusion of Infrared and Visible Images Based on Residual Significance

LI Chenyang^1
,,
DING Kun^{1, 2},
WENG Shuai¹,
WANG Li¹

1.
Hohai University, Changzhou 213022, China
2.
Photovoltaic Key Laboratory of Jiangsu Province, Changzhou 213022, China

Received Date: 2019-12-15
Rev Recd Date: 2020-09-07
Publish Date: 2020-11-20

Abstract

Abstract

To make the fusion image show more image details and to obtain a better image visual effect, a fusion method based on residual significance is proposed. First, the infrared image is analyzed using residual significance to obtain its significance coefficients. Then, the source images are decomposed using a dual-tree complex wavelet transform, and the low- and high-frequency components are fused according to different fusion rules. Finally, the fusion image is reconstructed using the inverse transformation of a dual-tree complex wavelet. Experimental results showed that the fusion method proposed in this paper produced higher quality images and better visual effects than those of the traditional fusion method.
- spectral residual significance,
- image fusion,
- dual-tree complex wavelet transform,
- fusion rules

FullText(HTML)

References(14)

References

[1]	敬忠良, 肖刚, 李振华.图像融合——理论与应用[M].北京:高等教育出版社, 2007. JING Zhongliang, XIAO Gang, LI Zhenhua. Image Fusion—Theory and Application[M]. Beijing: Higher Education Press, 2007.
[2]	刘信乐.热红外图像与可见光图像融合方法研究[D].成都: 电子科技大学, 2013. LIU Xinle. Research on Fusion Method of infrared image and visible image[D]. Chengdu: University of Electronic Science and Technology of China, 2013.
[3]	余美晨, 孙玉秋, 王超.基于拉普拉斯金字塔的图像融合算法研究[J].长江大学学报:自然科学版, 2016, 13(34): 770-776. http://www.cnki.com.cn/Article/CJFDTOTAL-CJDL201634005.htm YU Meichen, SUN Yuqiu, WANG Chao. Image fusion algorithm based on Laplacian pyramid[J]. Journal of Yangtze University: Natural Science, 2016, 13(34): 770-776. http://www.cnki.com.cn/Article/CJFDTOTAL-CJDL201634005.htm
[4]	Ashish V Vanmali, Vikram M Gadre. Visible and NIR image fusion using weight-map-guided Laplacian–Gaussian pyramid for improving scene visibility[J]. Springer Nature, 2017(6): 1063-1082.
[5]	Gonzalo P, Jesus M A wavelet-based image fusion tutorial[J]. Pattern Recognition, 2004, 37(9): 1855-1872.
[6]	Seal Ayan, Bhattacharjee Debotosh, NasipuriMita. A trous wavelet transform based hybrid image fusion for face recognition using region classifiers[J]. Expert Systems, 2018(12): 2185-2188.
[7]	王少杰, 潘晋孝, 陈平.基于双树复小波变换的图像融合[J].核电子学与探测技术, 2015, 35(7): 726-728. WANG Shaojie, PAN Jinxiao, CHEN Ping. Image fusion based on DT-CWT[J]. Nuclear Electronics & Detection Technology, 2015, 35(7): 726-728.
[8]	林子慧, 魏宇星, 张建林, 等.基于显著性图的红外与可见光图像融合[J].红外技术, 2019, 41(7): 640-645. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201810021 LIN Zihui, WEI Yuxing, ZHANG Jianglin, et al. Image fusion of infrared image and visible image based on saliency map[J]. Infrared Technology, 2019, 41(7): 640-645. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201810021
[9]	TIAN Huawei, FANG Yuming. Salient region detection by fusing bottom-up and top-down features extracted from single image[J]. IEEE Transaction on Image Processing, 2014, 23(10): 4389-4397. doi: 10.1109/TIP.2014.2350914
[10]	HOU X, ZHANG L. Salient detection: A spectral residual approach[C]//IEEE Conference on Computer Vison and Pattern Recognition, 2007: 18-23.
[11]	郭玲, 杨斌.基于视觉显著性的红外与可见光图像融合[J].计算机科学, 2015, 42(6): 211-214. http://www.cnki.com.cn/Article/CJFDTotal-GXYQ201604005.htm GUO Ling, YANG Bin. Image fusion of infrared image and visible image based on visual saliency[J]. Computer Science, 2015, 42(6): 211-214. http://www.cnki.com.cn/Article/CJFDTotal-GXYQ201604005.htm
[12]	张承鸿, 李范鸣, 吴滢跃.基于视觉显著性与对比度增强的红外图像融合[J].红外技术, 2017, 39(5): 421-426. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201612035 ZHANG Chenghong, LI Fanming, WU Yingyue. Image fusion of infrared image and visible image based onvisual saliency and contrast enhancement[J]. Infrared Technology, 2017, 39(5): 421-426. http://hwjs.nvir.cn/oa/DArticle.aspx?type=view&id=201612035
[13]	ZHENG Y F, Essock E. A new metric based on extended spatial frequency and its application to DWT based fusion algorithms[J]. Information Fusion, 2007, 8(2): 177-192. doi: 10.1016/j.inffus.2005.04.003
[14]	QU G, ZHANG D, YAN P. Information measure for performance of image fusion[J]. Electron Lett, 2002, 38(7): 313-315. doi: 10.1049/el:20020212