Advanced Search
中文
Volume 45 Issue 3
Mar.  2023
Turn off MathJax
Article Contents
Abstract
References
Related Articles
NING Dahai, ZHENG Sheng. An Object Detection Algorithm Based on Decision-Level Fusion of Visible and Infrared Images[J]. Infrared Technology , 2023, 45(3): 282-291.
Citation: NING Dahai, ZHENG Sheng. An Object Detection Algorithm Based on Decision-Level Fusion of Visible and Infrared Images[J]. Infrared Technology , 2023, 45(3): 282-291.
shu

An Object Detection Algorithm Based on Decision-Level Fusion of Visible and Infrared Images

  • College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan 030000, China

More Information
  • Received Date: July 31, 2022
  • Revised Date: September 12, 2022
    Graphical Abstract
    • Abstract
  • To improve the performance of visible and infrared image decision-making-level fusion target detection algorithms, a decision-level fusion strategy based on model reliability was proposed. First, image preprocessing technology was adopted to improve the overall quality of an infrared image, and then visible and thermal infrared target detection models were trained and tested. The parameters required for the fusion strategy were obtained based on the model test results. The model detection results were fused according to the proposed fusion strategy, and the final fusion detection results were obtained. The experimental results showed that compared with the detection results of a single-target detection model, the missed detection rate of the fusion algorithm used in the daytime was 8.16% lower than that of the visible detection model, and the missed detection rate at night was 9.85% lower than that of the infrared detection model.
    • FullText(HTML)
    • References (20)
  • [1]
    LIN C, LU J, WANG G, et al. Graininess-aware deep feature learning for robust pedestrian detection[J]. IEEE Transactions on Image Processing, 2020, 29: 3820-3834. DOI: 10.1109/TIP.2020.2966371
    [2]
    ZHANG X, YE P, LEUNG H, et al. Object fusion tracking based on visible and infrared images: a comprehensive review[J]. Information Fusion, 2020, 63: 166-187. DOI: 10.1016/j.inffus.2020.05.002
    [3]
    唐聪, 凌永顺, 杨华, 等. 基于深度学习的红外与可见光决策级融合跟踪[J]. 激光与光电子学进展, 2019, 56(7): 217-224. https://www.cnki.com.cn/Article/CJFDTOTAL-JGDJ201907023.htm

    TANG Cong, LING Yongshun, YANG Hua, et al. Decision-Level fusion tracking for infrared and visible spectra based on deep learning[J]. Laser & Optoelectronics Progress, 2019, 56(7): 217-224. https://www.cnki.com.cn/Article/CJFDTOTAL-JGDJ201907023.htm
    [4]
    张芳芳. 红外和可见光图像融合算法的研究[D]. 洛阳: 河南科技大学, 2011.

    ZHANG Fangfang. The Study of Infrared and Visible Light Image Fusion Algorithm[D]. Luoyang: Henan University of Science and Technology, 2011.
    [5]
    Schnelle S R, Chan A L. Enhanced target tracking through infrared-visible image fusion[C]//14th International Conference on Information Fusion, IEEE, 2011: 1-8.
    [6]
    刘明君, 董增寿. 基于多特征的红外与可见光图像融合[J]. 激光杂志, 2019, 40(10): 81-85. https://www.cnki.com.cn/Article/CJFDTOTAL-JGZZ201910017.htm

    LIU Mingjun, DONG Zengshou. Infrared and visible light image fusion based on multiple features[J]. Laser Journal, 2019, 40(10): 81-85. https://www.cnki.com.cn/Article/CJFDTOTAL-JGZZ201910017.htm
    [7]
    白玉, 侯志强, 刘晓义, 等. 基于可见光图像和红外图像决策级融合的目标检测算法[J]. 空军工程大学学报: 自然科学版, 2020, 21(6): 53-59, 100. DOI: 10.3969/j.issn.1009-3516.2020.06.009

    BAI Yu, HOU Zhiqiang, LIU Xiaoyi, et al. An object detection algorithm based on decision-level fusion of visible light image and infrared image[J]. Journal of Air Force Engineering University, 2020, 21(6): 53-59, 100. DOI: 10.3969/j.issn.1009-3516.2020.06.009
    [8]
    Manpreet Kaur, Jasdeep Kaur, Jappreet Kaur. Survey of contrast enhancement techniques based on histogram equalization[J]. International Journal of Advanced Computer Science and Applications, 2011, 2(7): 137-141.
    [9]
    Stark J Alex. Adaptive image contrast enhancement using generalizations of histogram equalization[J]. IEEE Transactions on Image Processing, 2000, 9(5): 889-889. DOI: 10.1109/83.841534
    [10]
    张丽. 对比度受限自适应直方图均衡方法[J]. 电脑知识与技术, 2010, 6(9): 2238-2241. DOI: 10.3969/j.issn.1009-3044.2010.09.082

    ZHANG Li. Contrast limited adaptive histogram equalization[J]. Computer Knowledge and Technology, 2010, 6(9): 2238-2241. DOI: 10.3969/j.issn.1009-3044.2010.09.082
    [11]
    王加, 周永康, 李泽民, 等. 非制冷红外图像降噪算法综述[J]. 红外技术, 2021, 43(6): 557-565. http://hwjs.nvir.cn/article/id/380dcf6e-de3d-4411-ab70-e246d5c8ea27

    WANG Jia, ZHOU Yongkan, LI Zemin, et al. A survey of uncooled infrared image denoising algorithms[J]. Infrared Technology, 2021, 43(6): 557-565. http://hwjs.nvir.cn/article/id/380dcf6e-de3d-4411-ab70-e246d5c8ea27
    [12]
    Tomasi C, Manduchi R. Bilateral filtering for gray and color images[C]//6th International Conference on Computer Vision, IEEE, 1998: 839-846.
    [13]
    HE K, SUN J, TANG X. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 33(12): 2341-2353.
    [14]
    唐聪, 凌永顺, 杨华, 等. 基于深度学习的红外与可见光决策级融合检测(英文)[J]. 红外与激光工程, 2019, 48(6): 456-470. https://www.cnki.com.cn/Article/CJFDTOTAL-HWYJ201906045.htm

    TANG Cong, LING Yongshun, YANG Hua, et al. Decision-level fusion detection for infrared and visible spectra based on deep learning[J]. Infrared and Laser Engineering, 2019, 48(6): 456-470. https://www.cnki.com.cn/Article/CJFDTOTAL-HWYJ201906045.htm
    [15]
    Paddle Paddle. Paddle Detection, Object detection and instance segmentation toolkit based on PaddlePaddle[EB/OL]. [2022-08-01]. https://github.com/PaddlePaddle/PaddleDetection.
    [16]
    XU S, WANG X, LV W, et al. PP-YOLOE: An evolved version of YOLO[J/OL]. arXiv preprint arXiv: 2203.16250, https://arxiv.org/p-df/2203.16250.pdf.
    [17]
    ZHENG Z, WANG P, LIU W, et al. Distance-IoU loss: Faster and better learning for bounding box regression[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(7): 12993-13000.
    [18]
    Hwang S, Park J, Kim N, et al. Multispectral pedestrian detection: Benchmark dataset and baseline[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015: 1037-1045.
    [19]
    LI C, SONG D, TONG R, et al. Illumination-aware faster R-CNN for robust multispectral pedestrian detection[J]. Pattern Recognition, 2019, 85: 161-171.
    [20]
    LI C, SONG D, TONG R, et al. Multispectral pedestrian detection via simultaneous detection and segmentation[J/OL]. arXiv preprint arXiv: 1808.04818, https://arxiv.org/pdf/1808.04818.pdf.
    • Related Articles

  • Related Articles

    [1]LYU Yonglin, ZHENG Wanxiang, LI Rujie, ZHANG Youliang, TANG Yingjuan, ZHANG Weitao, CHEN Yijun, WANG Guiquan, LI Yansheng, WANG Qiaofang. Optical Constants and Thickness Testing of Films Based on Reflection Spectroscopy[J]. Infrared Technology , 2024, 46(8): 965-973.
    [2]MAO Jingxiang, KONG Jincheng, KONG Linglei, GONG Xiaodan, HUANG Junbo, MA Yingting. Theoretical Calculation and Test Analysis of Noise Equivalent Temperature Difference of Photovoltaic Infrared FPA Detectors[J]. Infrared Technology , 2024, 46(8): 872-878.
    [3]YANG Shuning, BAI Xiaofeng, HE Yingping, YAO Ze, YUAN Yuan. The Research of Low-Light-Level Image Intensifier of SNR Calibrate Test Resolution[J]. Infrared Technology , 2018, 40(10): 1019-1022.
    [4]JI Yulong, MAO Jingxiang, LI Wenxia, YANG Pengwei, HUANG Junbo, SHU Chang, LI Hongfu, XIE Gang. Research on Spectral Response Test System of Digitalization Infrared Detector[J]. Infrared Technology , 2017, 39(10): 897-902.
    [5]ZHANG Peng, DONG Jie, HAN Shunli, WU Bin, CAO Qiantao. High Responsivity Terahertz Detector Based on Seebeck Effect[J]. Infrared Technology , 2017, 39(8): 761-765.
    [6]YONG Chao-Liang, DUAN Dong, XU Chun, CHEN Fan-Sheng. The Study on the Dark Current of the Infrared Detector Measuring Method[J]. Infrared Technology , 2012, 34(4): 196-199. DOI: 10.3969/j.issn.1001-8891.2012.04.003
    [7]ZHAO Peng, ZHOU Xu-chang, HONG Yan, TANG Li-bin, PENG Man-zhe. Fabrication and Testing of Bulk ZnO Photoconductive Detector[J]. Infrared Technology , 2007, 29(10): 567-569. DOI: 10.3969/j.issn.1001-8891.2007.10.003
    [8]WANG Qun, ZHU Mu-dan, ZHAO Liang. Parameter Test of Infrared Detectors[J]. Infrared Technology , 2006, 28(10): 599-601. DOI: 10.3969/j.issn.1001-8891.2006.10.010
    [9]A New Method for CO2 Laser Quick Detecting by Pyroelectric Detector[J]. Infrared Technology , 2001, 23(5): 41-44. DOI: 10.3969/j.issn.1001-8891.2001.05.013
    [10]LIU Bin, LIU Yu-feng, ZHAN GBoo-min. A Research on Modulation-Transfer-Function Measurement of SPRITE Detector[J]. Infrared Technology , 2000, 22(3): 39-43. DOI: 10.3969/j.issn.1001-8891.2000.03.011

Catalog

    Get Citation
    PDF
    XML
    Article views (613) PDF downloads (156) Cited by()
    Related

    Copyright © 《Infrared Technology》Editorial Office滇ICP备12000354号-3

    Supported by: Beijing Renhe Information Technology Co., Ltd.  Baidu Analytics

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return