[1]林子慧,魏宇星,张建林,等.基于显著性图的红外与可见光图像融合[J].红外技术,2019,41(7):640-645.[doi:10.11846/j.issn.1001_8891.201907008]
 LIN Zihui,WEI Yuxing,ZHANG Jianlin,et al.Image Fusion of Infrared and Visible Images Based on Saliency Map[J].Infrared Technology,2019,41(7):640-645.[doi:10.11846/j.issn.1001_8891.201907008]
点击复制

基于显著性图的红外与可见光图像融合
分享到:

《红外技术》[ISSN:1001-8891/CN:CN 53-1053/TN]

卷:
41卷
期数:
2019年第7期
页码:
640-645
栏目:
出版日期:
2019-07-20

文章信息/Info

Title:
Image Fusion of Infrared and Visible Images Based on Saliency Map
文章编号:
1001-8891(2019)07-0640-06
作者:
林子慧12魏宇星1张建林1徐智勇1
1. 中国科学院光电技术研究所;2. 中国科学院大学
Author(s):
LIN Zihui12WEI Yuxing1ZHANG Jianlin1XU Zhiyong1
1. Institute of Optics and Electronics of the Chinese Academy of Sciences;
2. University of Chinese Academy of Sciences

关键词:
图像融合显著性图NSCT红外图像可见光图像
Keywords:
image fusionsaliency mapNSCTinfrared imagevisible image
分类号:
TP751.1
DOI:
10.11846/j.issn.1001_8891.201907008
文献标志码:
A
摘要:
为使红外图像与可见光图像融合后的图像能获得更多目标信息和细节信息,本文提出了一种基于显著性图的图像融合方法。使用改进的Frequency Tuned(FT)算法提取红外图像的显著性图,并使用对比度受限的自适应直方图均衡化(Contrast Limited Adaptive Histgram Equalization,CLAHE)算法增强可见光图像的对比度。将红外图像与增强后的可见光图像进行非下采样轮廓波变换(Nonsubsampled Contourlet Transform,NSCT)后,根据所设定的融合规则分别对红外与可见光图像的低频部分与高频部分进行融合,最后对融合系数进行NSCT逆变换操作后获到融合图像。实验表明,该融合方法相较于其他方法而言,保留了更多的目标信息和细节信息,可以取得更好的视觉效果。
Abstract:
To obtain more details and target information from fused infrared and visible images, an image fusion method based on saliency map is proposed. First, the frequency-tuned algorithm is improved to extract the saliency map of the infrared image, and the contrast of visible image is enhanced by contrast limited adaptive histogram equalization. Then, the infrared and enhanced visible images are decomposed by nonsubsampled contourlet transform, and the low and high frequency coefficients are fused according to the fusion rules. Finally, the fusion image is obtained by the inverse transformation of the low and high frequency fusion coefficients. Experimental results show that compared to the other methods, this fusion method retains more details and target information with good visual effects.

参考文献/References:

[1]? 陈天明, 王俊琦, 张星祥, 等. 基于特征提取的红外与可见光图像融合[J]. 激光与红外, 2016, 46(3): 357-362.
CHEN Tianming, WANG Junqi, ZHANG Xingxiang, et al. Fusion of infrared and visible images based on feature extraction[J]. Laser and Infrared, 2016, 46(3): 357-362.
[2]? 刘信乐. 热红外图像与可见光图像融合方法研究[D]. 成都: 电子科技大学, 2013.
LIU Xinle. Research of thermal infrared and visible image fusion[D]. Chengdu: University Of Electronic Science And Technology of China, 2013.
[3]? 方辉, 尹忠科. 一种基于NSCT的区域能量图像融合算法[J]. 通信技术, 2010, 43(3): 137-138+141.
FANG Hui, YIN Zhongke. An image fusion algorithm based on local energy using NSCT[J]. Communications Technology, 2010, 43(3): 137-138+141.
[4]? 王晓文, 赵宗贵, 庞秀梅, 等. 基于视觉显著图的图像融合方法[J]. 吉林大学学报: 工学版, 2014, 44(4): 1203-1208.
WANG Xiaowen, ZHAO Zonggui, PANG Xiumei, et al. Image fusion method based on visual saliency maps[J]. Journal of Jilin University (Engineering and Technology Edition), 2010, 43(3): 137-138+141.
[5]? 钱晓亮, 郭雷, 韩军伟, 等. 视觉显著性检测:一种融合长期和短期特征的信息论算法[J]. 电子与信息学报, 2013, 35(7): 1636-1643.
QIAN Xiaoliang, GUO Lei, HAN Junwei, et al. Visual saliency detection: An information theoretic algorithm combined long-term with short-term features[J]. Journal of Electronics and Information Technology, 2013, 35(7): 1636-1643.
[6]? Achanta R, Hemami S, Estrada F, SusstrunkS. Frequency-tuned salient region detection[C]//Computer Vision and Pattern Recognition, IEEE, 2009.?
[7]? XU L, LU C, XU Y, et al. Image smoothing via L0 gradient minimization[J]. ACM Transactions on Graphics (TOG), 2011, 30(6): 174-185.
[8]? 庞学舜, 王怀彬. 基于改进的L0梯度最小化的图像平滑[J]. 天津理工大学学报, 2016, 32(1): 35-39.
PANG Xueshun, WANG Huaibin. Improved L0 gradient minimization for image smoothing[J]. Journal of Tianjin University of Technology, 2016, 32(1): 35-39.
[9]? Gonzalez R C, Woods R E, Eddins S L. 数字图像处理(MATLAB版)[M]. 北京: 电子工业出版社, 2009.
Gonzalez R C, Woods R E, Eddins S L. Digital Image Processing Using MATLAB[M]. Beijing: Publishing House of Electronic Industry, 2009.
[10]? 刘玉婷, 陈峥, 付占方, 等. 基于CLAHE的红外图像增强算法[J]. 激光与红外, 2016, 46(10): 1290-1294.
LIU Yuting, CHEN Zheng, FU Zhanfang, et al. Infrared image enhancement algorithm based on CLAHE[J]. Laser and Infrared, 2016, 46(10): 1290-1294.
[11]? 张丽. 对比度受限自适应直方图均衡方法[J]. 电脑知识与技术, 2010, 6(9): 2238-2241.
ZHANG Li. Contrast limited adaptive histogram equalization[J]. Computer Knowledge and Technology, 2010, 6(9): 2238-2241.
[12]? 王烈, 罗文, 陈俊鸿, 等. 自适应PCNN与信息提取的红外与可见光图像融合[J]. 计算机工程与应用, 2018, 54(4): 192-198.
WANG Lie, LUO Wen, CHEN Junhong, et al. Fusion of infrared and visible images based on adaptive PCNN and information extraction[J]. Computer Engineering and Applications, 2018, 54(4): 192-198.
[13]? 王跃华, 陶忠祥. 红外与可见光图像融合质量评价方法综述[J]. 红外, 2012, 33(6): 7-11.
WANG Yuehua, TAO Zhongxiang. Overview of quality evaluation methods of fused infrared and visible images[J]. Infrared, 2012, 33(6): 7-11.
[14]? 杨桄, 童涛, 陆松岩, 等. 基于多特征的红外与可见光图像融合[J]. 光学精密工程, 2014, 22(2): 489-496.
YANG Guang, TONG Tao, LU Songyan, et al. Fusion of infrared and visible images based on multi-features[J]. Optics and Precision Engineering, 2014, 22(2): 489-496.

相似文献/References:

[1]周萧,杨风暴,蔺素珍,等. 基于自适应滑动窗口的双色中波红外图像融合方法研究[J].红外技术,2013,35(04):227.
 ZHOU Xiao,YANG Feng-bao,LIN Su-zhen,et al.The Study on Fusion Method of Dual-color MWIR Images Based on Adaptive Sliding Window[J].Infrared Technology,2013,35(7):227.
[2]安富,杨风暴,蔺素珍,等. 基于局部能量与模糊逻辑的红外偏振图像融合[J].红外技术,2012,34(10):573.
 AN Fu,YANG Feng-bao,LIN Su-zhen,et al.Infrared Polarization Images Fusion Based on Local Energy and Fuzzy Logic[J].Infrared Technology,2012,34(7):573.
[3]杨 锋,张俊举,许 辉,等.一种图像融合算法硬件实现[J].红外技术,2013,35(09):541.[doi:10.11846/j.issn.1001_8891.201309003]
 YANG Feng,ZHANG Jun-ju,XU Hui,et al.Hardware Implementation of an Image Fusion Method[J].Infrared Technology,2013,35(7):541.[doi:10.11846/j.issn.1001_8891.201309003]
[4]韩 博,张鹏辉,许 辉,等.基于区域的二维经验模式分解的图像融合算法[J].红外技术,2013,35(09):546.[doi:10.11846/j.issn.1001_8891.201309004]
 HAN Bo,ZHANG Peng-hui,XU Hui,et al.Region-based image fusion algorithm using bidimensional empirical mode decomposition[J].Infrared Technology,2013,35(7):546.[doi:10.11846/j.issn.1001_8891.201309004]
[5]何永强,王群,王国培,等.基于融合和色彩传递的灰度图像彩色化技术[J].红外技术,2012,34(05):276.
 HE Yong-qiang,WANG Qun,WANG Guo-pe,et al.Gray Image Colorization Based on Fusion and Color Transfer[J].Infrared Technology,2012,34(7):276.
[6]李伟伟,杨风暴,蔺素珍,等.红外偏振与红外光强图像的伪彩色融合研究[J].红外技术,2012,34(02):109.
 LI Wei-wei,YANG Feng-bao,LIN Su-zhen,et al.Study on Pseudo-color Fusion of Infrared Polarization and Intensity Image[J].Infrared Technology,2012,34(7):109.
[7]徐中中,曲仕茹.新型可见光和红外图像融合综合评价方法[J].红外技术,2011,33(10):568.
 XU Zhong-zhong,QU Shi-ru.A New Comprehensive Evaluation of Visible and Infrared Image Fusion[J].Infrared Technology,2011,33(7):568.
[8]薛模根,刘存超,徐国明,等.基于多尺度字典的红外与微光图像融合[J].红外技术,2013,35(11):696.[doi:10.11846/j.issn.1001_8891.201311005]
 XUE Mo-gen,LIU Cun-chao,XU Guo-ming,et al.Infrared and Low Light Level Image Fusion Based on Multi-scale Dictionary[J].Infrared Technology,2013,35(7):696.[doi:10.11846/j.issn.1001_8891.201311005]
[9]孙爱平,龚杨云,朱尤攀,等.微光与红外图像融合手持观察镜光学系统设计[J].红外技术,2013,35(11):712.[doi:10.11846/j.issn.1001_8891.201311008]
 SUN Ai-ping,GONG Yang-yun,ZHU You-pan,et al.Optical System Design of Low-light-level and Infrared Image Fusion Hand-held Viewer[J].Infrared Technology,2013,35(7):712.[doi:10.11846/j.issn.1001_8891.201311008]
[10]何永强,周云川,仝红玉,等.基于YCBCR空间颜色传递的融合图像目标检测算法[J].红外技术,2011,33(06):349.
 HE Yong-qiang,ZHOU Yun-chuan,TONG Hong-yu,et al.A Target Detection Method Based on Color Transferin YCBCR Space for Fused Image[J].Infrared Technology,2011,33(7):349.
[11]吴冬鹏,毕笃彦,马时平,等.边缘和对比度增强的NSST域红外与可见光图像融合[J].红外技术,2017,39(4):358.[doi:10.11846/j.issn.1001_8891.201704011]
 WU Dongpeng,BI Duyan,MA Shiping,et al.Infrared and Visible Image Fusion Based on Improved Saliency Map in NSST Domain [J].Infrared Technology,2017,39(7):358.[doi:10.11846/j.issn.1001_8891.201704011]

备注/Memo

备注/Memo:
收稿日期:2018-10-24;修订日期:2019-05-15.
作者简介:林子慧(1995-),女,硕士研究生,主要从事图像处理方面的研究。E-mail:linzihui16@mails.ucas.ac.cn。

更新日期/Last Update: 2019-07-12