Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images

LI Chuandong; XU Wangming; WU Shiqian

Volume 43 Issue 7

Jul. 2021

Turn off MathJax

Article Contents

Abstract

References

Infrared Technology > 2021 > 43(7): 658-664.

LI Chuandong, XU Wangming, WU Shiqian. Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images[J]. Infrared Technology , 2021, 43(7): 658-664.

Citation:

LI Chuandong, XU Wangming, WU Shiqian. Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images[J]. Infrared Technology , 2021, 43(7): 658-664.

Citation:

LI Chuandong, XU Wangming, WU Shiqian. Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images[J]. Infrared Technology , 2021, 43(7): 658-664.

PDF (642 KB)

Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images

LI Chuandong^{1, 2},
XU Wangming^{1, 2, 3, ,},
WU Shiqian^{1, 2}

1.
School of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China
2.
Institute of Robotics and Intelligent Systems, Wuhan University of Science and Technology, Wuhan 430081, China
3.
Engineering Research Center for Metallurgical Automation and Detecting Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China

More Information

Received Date: September 23, 2020
Revised Date: November 02, 2020

Graphical Abstract

Abstract

Abstract

To address the low precision and speed of existing pedestrian detection methods for thermal infrared images, a real-time pedestrian detection method based on a weak saliency map is herein proposed. The proposed method comprises two improved networks, namely, SD-LFFD and SF-LFFD, which use lightweight LFFD as the basic network. First, the thermal infrared image is input into the SD-LFFD to produce the preliminary pedestrian detection results and a weak saliency map indicating the pedestrian regions. Then, the weak saliency map and the original thermal infrared image are combined to highlight the potential pedestrian regions and generate new results using the SF-LFFD. Finally, the pedestrian detection results obtained by the two improved networks are integrated to obtain the final results. The experimental results on the CVC-09 and CVC-14 datasets indicate that the proposed method significantly improves the average precision (AP) of pedestrian detection compared with that of existing lightweight neural networks, and that it achieves real-time detection with limited hardware resources.
- thermal infrared image,
- pedestrian detection,
- saliency detection,
- real-time detection

FullText(HTML)

References (14)

References

[1]	刘峰, 王思博, 王向军, 等. 多特征级联的低能见度环境红外行人检测方法[J]. 红外与激光工程, 2018, 47(6): 137-144. LIU Feng, WANG Sibo, WANG Xiangjun, et al. Infrared pedestrian detection method in low visibility environment based on multi feature association[J]. Infrared and Laser Engineering, 2018, 47(6): 137-144.
[2]	CAI Y, LIU Z, WANG H, et al. Saliency-based pedestrian detection in far infrared images[J]. IEEE Access, 2017, 5: 5013-5019. http://ieeexplore.ieee.org/document/7904724
[3]	Ko B C, Kim D Y, Nam J Y. Detecting humans using luminance saliency in thermal images[J]. Optics Letters, 2012, 37(20): 4350-4352. DOI: 10.1364/OL.37.004350
[4]	MA Y, WU X, YU G, et al. Pedestrian detection and tracking from low-resolution unmanned aerial vehicle thermal imagery[J]. Sensors, 2016, 16(4): 446. DOI: 10.3390/s16040446
[5]	Jeon E S, Choi J S, Lee J H, et al. Human detection based on the generation of a background image by using a far-infrared light camera[J]. Sensors, 2015, 15(3): 6763-6788. DOI: 10.3390/s150306763
[6]	李慕锴, 张涛, 崔文楠. 基于YOLOv3的红外行人小目标检测技术研究[J]. 红外技术, 2020, 42(2): 176-181. https://www.cnki.com.cn/Article/CJFDTOTAL-HWJS202002014.htm LI Mukai, ZHANG Tao, CUI Wennan. Research of Infrared Small Pedestrian Target Detection Based on YOLOv3[J]. Infrared Technology, 2020, 42(2): 176-181. https://www.cnki.com.cn/Article/CJFDTOTAL-HWJS202002014.htm
[7]	LIU J, ZHANG S, WANG S, et al. Multispectral deep neural networks for pedestrian detection[J/OL]. arXiv preprint, 2016, https://arxiv.org/pdf/1611.02644.pdf.
[8]	Wagner J, Fischer V, Herman M, et al. Multispectral pedestrian detection using deep fusion convolutional neural networks[C]//24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), 2016: 509-514.
[9]	Ghose D, Desai S M, Bhattacharya S, et al. Pedestrian Detection in Thermal Images using Saliency Maps[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019: 988-997.
[10]	HE Y, XU D, WU L, et al. LFFD: A Light and Fast Face Detector for Edge Devices[J/OL]. arXiv preprint, 2019, https://arxiv.org/abs/1904.10633v1.
[11]	HOU Q, CHENG M M, HU X, et al. Deeply supervised salient object detection with short connections[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 3203-3212.
[12]	Socarrás Y, Ramos S, Vázquez D, et al. Adapting pedestrian detection from synthetic to far infrared images[C]//ICCV–Workshop Visual Domain Adaptation and Dataset Bias, 2013: 1-3.
[13]	González A, Fang Z, Socarras Y, et al. Pedestrian detection at day/night time with visible and fir cameras: A comparison[J]. Sensors, 2016, 16(6): 820. DOI: 10.3390/s16060820
[14]	Redmon J, Farhadi A. Yolov3: An incremental improvement[J/OL]. arXiv preprint, 2018, https://arxiv.org/pdf/1804.02767.pdf.

[1]	ZHANG Fei, WANG Jian, ZHANG Yuesong. Lightweight Infrared Small Target Detection Algorithm under Oblique View Based on YOLOv5[J]. Infrared Technology , 2025, 47(2): 217-225.
[2]	ZHANG Xingping, SHAO Yanhua, MEI Yanying, ZHANG Xiaoqiang, CHU Hongyu. Aerial Infrared Pedestrian Detection with Saliency Map Fusion[J]. Infrared Technology , 2024, 46(9): 1043-1050.
[3]	CHEN Sijing, FU Zhitao, LI Ziqian, NIE Han, SONG Jiawen. A Visible and Infrared Image Fusion Algorithm Based on Adaptive Enhancement and Saliency Detection[J]. Infrared Technology , 2023, 45(9): 907-914.
[4]	LONG Zhiliang, DENG Yueming, WANG Runmin, DONG Jun. Infrared and Visible Image Fusion Based on Saliency Detection and Latent Low-Rank Representation[J]. Infrared Technology , 2023, 45(7): 705-713.
[5]	LI Shiji, LI Zhongmin, LI Wei. Pedestrian Detection Method Based on Improved ViBe and YOLO v3 Algorithms[J]. Infrared Technology , 2023, 45(2): 137-142.
[6]	LAI Benlin, ZHANG Yongan, ZHANG Yaping, TIAN Li, ZHAO Danlu, HUANG Junhao, WANG Gang, ZHAO Hang. Research on Stress Field Detection of Building Blasting Environment Based on Infrared Digital Holography[J]. Infrared Technology , 2023, 45(1): 102-109.
[7]	YE Kuntao, LI Wen, SHU Leilei, LI Sheng. Infrared and Visible Image Fusion Method Based on Improved Saliency Detection and Non-subsampled Shearlet Transform[J]. Infrared Technology , 2021, 43(12): 1212-1221.
[8]	ZHAO Shuang, CHEN Shuyue, WANG Qiaoyue. Infrared Pedestrian Detection in Complex Night Scenes[J]. Infrared Technology , 2021, 43(6): 575-582.
[9]	CHE Kai, XIANG Zhengtao, CHEN Yufeng, LYU Jian, ZHOU Yun. Research on Infrared Image Pedestrian Detection Based on Improved Fast R-CNN[J]. Infrared Technology , 2018, 40(6): 578-584.
[10]	WEI Li, DING Meng, ZENG Lijun. Pedestrian Detection Based on Objectness and Sparse Coding in a Single Infrared Image[J]. Infrared Technology , 2016, 38(9): 752-757.

Cited By

Cited by

Periodical cited type(1)

相敏月，涂振宇，孙逸飞，方强，马飞. 基于ECA和BIFPN的低照度环境下的行人目标检测算法. 智能计算机与应用. 2023(09): 189-193 .

Other cited types(2)

Get Citation

PDF

XML

Article views (280) PDF downloads (42) Cited by(3)

Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images

Abstract

References

Related Articles

Cited by

Periodical cited type(1)

Other cited types(2)

Catalog

Related

Real-Time Pedestrian Detection Based on the Weak Saliency Map in Thermal Infrared Images

Abstract

References

Related Articles

Cited by

Periodical cited type(1)

Other cited types(2)

Catalog

Related

Export File

Citation

Format

Content