Infrared and Visible Image Fusion Based on a Rolling Guidance Filter

ZHANG Hui; HAN Xinning; HAN Huili

Volume 44 Issue 6

Jun. 2022

Turn off MathJax

Article Contents

Article Navigation > Infrared Technology > 2022 > 44(6): 598-603

ZHANG Hui, HAN Xinning, HAN Huili. Infrared and Visible Image Fusion Based on a Rolling Guidance Filter[J]. Infrared Technology , 2022, 44(6): 598-603.

Citation:

ZHANG Hui, HAN Xinning, HAN Huili. Infrared and Visible Image Fusion Based on a Rolling Guidance Filter[J]. Infrared Technology , 2022, 44(6): 598-603.

ZHANG Hui, HAN Xinning, HAN Huili. Infrared and Visible Image Fusion Based on a Rolling Guidance Filter[J]. Infrared Technology , 2022, 44(6): 598-603.

Citation:

ZHANG Hui, HAN Xinning, HAN Huili. Infrared and Visible Image Fusion Based on a Rolling Guidance Filter[J]. Infrared Technology , 2022, 44(6): 598-603.

PDF( 2118 KB)

Infrared and Visible Image Fusion Based on a Rolling Guidance Filter

1.
School of Mathematics and Computer Science, Ningxia Normal University, Guyuan 756000, China
2.
College of Chemistry and Chemical Engineering, Ningxia Normal University, Guyuan 756000, China

Received Date: 2021-03-11
Rev Recd Date: 2021-04-12
Publish Date: 2022-06-20

Abstract

Abstract

The fusion image must be made more suitable for human visual perception and the problem of a poor fusion effect caused by light and weather must be solved. Therefore, this study proposes a fusion method of visible and infrared images based on a rolling guidance filter. First, guided filtering is used to enhance the content of the visible image. Then, a rolling guidance filter is used to decompose the visible and infrared images into small-scale, large-scale, and base layers. In the process of information synthesis of large-scale layers, the weighted least square fusion rule is used to solve the problem caused by different features of visible and infrared images, and to improve the visual effect of fusion images. In the process of fusion of the base layer, the optimized fusion rule of the visual saliency map is used to reduce the loss of contrast. Finally, the large-scale, small-scale, and base layers are merged into a fused image. The experimental results show that the proposed method improves the visual effect, detail processing, and edge protection.
- image fusion,
- rolling guidance filter,
- enhancement,
- weighted least square,
- visual saliency map

FullText(HTML)

References(18)

References

[1]	ZHANG H, MA X, TIAN Y S. An image fusion method based on Curvelet transform and guided filter enhancement[J]. Mathematical Problems in Engineering, 2020(4): 1-8(DOI: 10.1155/2020/9821715)
[2]	张慧, 常莉红, 马旭, 等. 一种基于曲波变换与引导滤波增强的图像融合方法[J]. 吉林大学学报: 理学版, 2020, 58(1): 113-119. https://www.cnki.com.cn/Article/CJFDTOTAL-JLDX202001018.htm ZHANG H, CHANG L H, MA X. An image fusion method based on Curvelet transform and guide filtering enhancement[J]. Journal of Jilin University: Science Edition, 2020, 58(1): 113-119. https://www.cnki.com.cn/Article/CJFDTOTAL-JLDX202001018.htm
[3]	张慧, 常莉红. 基于方向导波增强的红外与可见光图像融合[J]. 激光与红外, 2020, 50(4): 508-512. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202004021.htm ZHANG H, CHANG L H. Infrared and visible image fusion based on guided filtering enhancement[J]. Laser & Infrared, 2020, 50(4): 508-512. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202004021.htm
[4]	LIU Y, LIU S, WANG Z. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 2015, 24: 147-164. doi: 10.1016/j.inffus.2014.09.004
[5]	LI Shutao, KANG Xudong, HU Jianwen. Image fusion with guided ﬁltering[J]. IEEE Trans. Image Process, 2013, 22(7): 2864-2875. doi: 10.1109/TIP.2013.2244222
[6]	Bavirisetti D P, XIAO G, ZHAO H, et al. Multi-scale guided image and video fusion: a fast and efficient approach[J]. Circuits System Signal Process, 2019, 38: 5576-5605. doi: 10.1007/s00034-019-01131-z
[7]	GAN W, WU X, WU W, et al. Infrared and visible image fusion with the use of multi-scale edge-preserving decomposition and guided image ﬁlter[J]. Infrared Physics & Technology, 2015, 72: 37-51.
[8]	ZHANG Q, SHEN X, XU L, et al. Rolling guidance ﬁlter[C]//European Conference on Computer Vision, Springer, 2014: 815-830.
[9]	MA J, ZHOU Z, WANG B, et al. Infrared and visible image fusion based on visual saliency map and weighted least square optimization[J]. Infrared Physics & Technology, 2017, 82: 8-17.
[10]	ZHAI Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues[C]//Proceedings of the 14th ACM International Conference on Multimedia, ACM, 2006: 815-824.
[11]	Stark J A. Adaptive image contrast enhancement using generalizations of histogram equalization[J]. IEEE Transactions on Image Processing, 2000, 9(5): 889-896. doi: 10.1109/83.841534
[12]	Rizzi A, Gatta C, Marini D. A new algorithm for unsupervised global and local color correction[J]. Pattern Recognition Letters, 2003, 24: 1663-1677. doi: 10.1016/S0167-8655(02)00323-9
[13]	ZHOU Z, WANG B, LI S, et al. Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with gaussian and bilateral ﬁlters[J]. Information Fusion, 2016, 30: 15-26. doi: 10.1016/j.inffus.2015.11.003
[14]	DONG Z, LAI C, QI D, et al. A general memristor-based Pulse coupled neural network with variable linking coeﬃcient for multi-focus image fusion[J]. Neurocomputing, 2018, 308: 172-183. doi: 10.1016/j.neucom.2018.04.066
[15]	ZHOU Z, DONG M, XIE X, et al. Fusion of infrared and visible images for night-vision context enhancement[J]. Applied Optics, 2016, 55(23): 6480-6489. doi: 10.1364/AO.55.006480
[16]	ZHAI Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues[C]//Proceedings of the 14th ACM International Conference on Multimedia, ACM, 2006: 815-824.
[17]	Nava R, Cristo´bal G, Escalante-Ramırez B. Mutual information improves image fusion quality assessments[EB/OL][2007-09-04]. https://spie.org/news/0824-mutual-information-improves-image-fusion-quality-assessments?SSO=1
[18]	WANG Q, SHEN Y, JIN J. Performance evaluation of image fusion techniques[J]. Image Fusion: Algorithms and Applications, 2008, 9(10): 469-492.