Asymmetric Infrared and Visible Image Fusion Based on Contrast Pyramid and Bilateral Filtering
-
摘要: 为了同时保留红外图像的特征信息和可见光图像的细节信息，提出了一种基于对比度金字塔的非对称红外与可见光图像融合方法。首先，使用对比度金字塔对红外与可见光图像进行高频与低频信息分解，然后对高频部分采用绝对值取大方法进行融合，对于低频部分采用基于双边滤波的方法对红外与可见光图像进行非对称的处理；其次，使用对比度金字塔的逆变换得到融合后图像。对融合图像进行主观视觉和客观指标评价，结果表明该算法在突出目标特征信息和保留细节特征方面表现优异。Abstract: This study proposes an asymmetric infrared and visible image fusion method based on a contrast pyramid to save the feature information of infrared image and the detail information of visible image simultaneously. First, the contrast pyramid is used to decompose the high-frequency and low-frequency information of the infrared and visible images; then, the high-frequency part is fused by taking the largest absolute value, and the low-frequency part is processed differently by the method based on bilateral filtering. Second, the inverse transform of the contrast pyramid was used to obtain the fused image. Subjective visual and objective index evaluations were conducted on the fused image. The results show that the algorithm performs well in highlighting the target feature information and retaining detailed feature information.
-
Key words:
- image fusion /
- infrared image /
- visible image /
- contrast pyramid /
- bilateral filter
-
表 1 不同融合方法的客观指标对比
Table 1. Comparison of objective indicators between different fusion methods
Image Object indicators LP Wavelet DTCWT Proposed method House AG 0.0190 0.0174 0.0176 0.0220 IE 7.11 6.55 6.65 7.14 EI 0.192 0.173 0.178 0.225 Road AG 0.0190 0.0167 0.0163 0.0198 IE 7.17 6.36 6.48 7.12 EI 0.196 0.170 0.171 0.206 Ship AG 0.00830 0.00750 0.00770 0.0105 IE 6.02 5.02 5.14 6.30 EI 0.0850 0.0761 0.0789 0.108 
下载: 导出CSV
-
[1] Waxman A M, Gove A N, Fay D A, et al. Color night vision: opponent processing in the fusion of visible and IR imagery[J]. Neural Networks, 1997, 10(1): 1-6. http://www.onacademic.com/detail/journal_1000034198621910_6953.html [2] XIANG T, YAN L, GAO R. A fusion algorithm for infrared and visible images based on adaptive dual-channel unit-linking PCNN in NSCT domain[J]. Infrared Physics & Technology, 2015, 69: 53-61. http://www.onacademic.com/detail/journal_1000037435766010_b6cd.html [3] ZHAO J, GAO X, CHEN Y, et al. Multi-window visual saliency extraction for fusion of visible and infrared images[J]. Infrared Physics & Technology, 2016, 76: 295-302. http://smartsearch.nstl.gov.cn/paper_detail.html?id=4f0b14c597a48653341d44502ab3dc75 [4] YAN L, CAO J, Rizvi S, et al. Improving the performance of image fusion based on visual saliency weight map combined with CNN[J]. IEEE Access, 2020, 8(99): 59976-59986. http://ieeexplore.ieee.org/document/9044861 [5] Lewis J J, Robert J. O'Callaghan, Nikolov S G, et al. Pixel- and region-based image fusion with complex wavelets[J]. Information Fusion, 2007, 8(2): 119-130. doi: 10.1016/j.inffus.2005.09.006 [6] 赵立昌, 张宝辉, 吴杰, 等. 基于灰度能量差异性的红外与可见光图像融合[J]. 红外技术, 2020, 42(8): 775-782. http://hwjs.nvir.cn/article/id/hwjs202008012ZHAO Lichang, ZHANG Baohui, WU Jie, et al. Fusion of infrared and visible images based on gray energy difference[J]. Infrared Technology, 2020, 42(8): 775-782. http://hwjs.nvir.cn/article/id/hwjs202008012 [7] 崔晓荣, 沈涛, 黄建鲁, 等. 基于BEMD改进的视觉显著性红外和可见光图像融合[J]. 红外技术, 2020, 42(11): 1061-1071. http://hwjs.nvir.cn/article/id/c89c0447-6d07-4a75-99f6-1bf8681cf588CUI Xiaorong, SHEN Tao, HUANG Jianlu, et al. Infrared and visible image fusion based on bemd and improved visual saliency[J]. Infrared Technology, 2020, 42(11): 1061-1071. http://hwjs.nvir.cn/article/id/c89c0447-6d07-4a75-99f6-1bf8681cf588 [8] 李辰阳, 丁坤, 翁帅, 等. 基于改进谱残差显著性图的红外与可见光图像融合[J]. 红外技术, 2020, 42(11): 1042-1047. http://hwjs.nvir.cn/article/id/6e57a6fb-ba92-49d9-a000-c00e7a933365LI Chenyang, DING Kun, WENG Shuai, et al. Image fusion of infrared and visible images based on residual significance[J]. Infrared Technology, 2020, 42(11): 1042-1047. http://hwjs.nvir.cn/article/id/6e57a6fb-ba92-49d9-a000-c00e7a933365 [9] ZHOU Z, WANG B, LI S, et al. Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters[J]. Information Fusion, 2016, 30: 1-13. doi: 10.1016/j.inffus.2015.11.002 [10] Toet A. Image fusion by a ratio of low-pass pyramid[J]. Pattern Recognition Letters, 1989, 9: 245-253. doi: 10.1016/0167-8655(89)90003-2 [11] Akerman A. Pyramidal techniques for multisensor fusion[C]// Proceedings of SPIE the International Society for Optical Engineering, 1992, 1828: 124-131. [12] LI Huafeng, QIU Hongmei, YU Zhengtao, et al. Infrared and visible image fusion scheme based on NSCT and low-level visual features[J]. Infrared Physics and Technology, 2016, 76: 174-184. doi: 10.1016/j.infrared.2016.02.005 [13] 彭进业, 王珺, 何贵青, 等. 基于非下采样Contourlet变换和稀疏表示的红外与可见光图像融合方法[J]. 兵工学报, 2013, 34(7): 815-820. https://www.cnki.com.cn/Article/CJFDTOTAL-BIGO201307003.htmPENG Jinye, WANG Jun, HE Guiqing, et al. Fusion method for visible and infrared images based on non-subsampled Contourlet transform and sparse representation[J]. Acta Armamentarii, 2013, 34(7): 815-820. https://www.cnki.com.cn/Article/CJFDTOTAL-BIGO201307003.htm [14] Pajares G, Jesús Manuel de la Cruz. A wavelet-based image fusion tutorial[J]. Pattern Recognition, 2004, 37(9): 1855-1872. doi: 10.1016/j.patcog.2004.03.010 [15] 朱攀, 刘泽阳, 黄战华. 基于DTCWT和稀疏表示的红外偏振与光强图像融合[J]. 光子学报, 2017, 46(12): 213-221. https://www.cnki.com.cn/Article/CJFDTOTAL-GZXB201712028.htmZHU Pan, LIU Zeyang, HUANG Zhanhua. Infrared polarization and intensity image fusion based on dual-tree complex wavelet transform and sparse representation[J]. Acta Photonica Sinica, 2013, 34(7): 815-820. https://www.cnki.com.cn/Article/CJFDTOTAL-GZXB201712028.htm -
点击查看大图
图(3) / 表(1)
计量
- 文章访问数: 33
- HTML全文浏览量: 18
- PDF下载量: 19
- 被引次数: 0
