| Citation: |
QIU Gang, ZHANG Nailong, BAI Cang, TAN Xiao, CHEN Jie, GAO Song. Inspection Robot Obstacle Recognition and Classification Based on Infrared and Visible Light Image Matching[J]. Infrared Technology , 2025, 47(1): 81-88.
|
In complex environments such as power grids and bridges, inspection robots can effectively replace manual inspections and equipment maintenance. To achieve autonomous obstacle avoidance for inspection robots in complex environments, this study proposes an image-matching recognition technique based on the YOLOv5 deep-learning network model, which utilizes both IR and visible-light images. This enables the robot to identify and classify various obstacles, including living and nonliving obstacles. During the inspection operations, the robot is equipped with an IR camera and a regular camera to monitor its environment in real time. With the YOLOv5 network model trained on a large dataset, the robot can quickly and accurately identify and categorize obstacles along its path. The robot not only identifies the nature of obstacles but also performs appropriate proactive actions to address different situations. The average recognition accuracy is approximately 99.2%. Experimental results demonstrate the effectiveness of the comprehensive obstacle avoidance method based on multiple-image information. The robot can detect, classify, and navigate obstacles under various scenarios, thereby enhancing their autonomy and adaptability. This technology has wide applications in areas such as automated inspections, safety monitoring, and rescue missions, providing strong support for the continuous development of robotic technologies.
| [1] |
赵涛, 张翼, 赵贤文, 等. 基于视觉的巡检机器人环境感知和导航避障研究[J]. 无线电工程, 2023, 53(8): 1883-1890. DOI: 10.3969/j.issn.1003-3106.2023.08.019
ZHAO T, ZHANG Y, ZHAO X, et al. Research on environment perception and navigation obstacle avoidance of inspection robot based on vision [J]. Radio Engineering, 2023, 53(8): 1883-1890. DOI: 10.3969/j.issn.1003-3106.2023.08.019
|
| [2] |
LI Y, LIU Y. Vision-based obstacle avoidance algorithm for mobile robot[C]//2020 Chinese Automation Congress (CAC), 2020: 1273-1278, doi: 10.1109/CAC51589.2020.9326906.
|
| [3] |
Kim D H, Kim G W. Dual Expanded Guide Circle (Dual-EGC) algorithm for obstacle avoidance of remotely operated mobile robot[C]//2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 2017: 226-227, doi: 10.1109/URAI.2017.7992718.
|
| [4] |
罗建军, 刘振声, 龚翔, 等. 基于无人机图像与迁移学习的线路绝缘子状态评价方法[J]. 电力工程技术, 2019, 38(5): 30-36.
LUO J, LIU Z, GONG X, et al. Insulator state evaluation method based on UAV image and migration learning[J]. Electric Power Engineering Technology, 2019, 38(5): 30-36.
|
| [5] |
WANG Z, ZHAN J, DUAN C, et al. A review of vehicle detection techniques for intelligent vehicles[J]. IEEE Transactions on Neural Networks and Learning Systems, 2023, 34(8): 3811-3831. DOI: 10.1109/TNNLS.2021.3128968
|
| [6] |
WANG L, GAO C, ZHAO Y, et al. Infrared and visible image registration using transformer adversarial network[C]//25th IEEE International Conference on Image Processing. IEEE, 2018: 1248-1252.
|
| [7] |
Carion N, Massa F, Synnaeve G, et al. End-to-end object detection with transformers[C]//Proc. of the European Conference on Computer Vision, 2020: 213-229.
|
| [8] |
Ross Girshick. Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision, 2015: 1440-1448.
|
| [9] |
Redmon J, Divvala S, Girshick R et al. You only look once: unified, real-time object detection[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 779-788.
|
| [10] |
刘成民, 戴中坚, 陈轩. 基于TensorFlow框架的有源配电网深度学习故障定位方法[J]. 电力工程技术, 2019, 38(5): 8-15.
LIU C, DAI Z, CHEN X. A fault location method for active distribution network based on Tensorflow deep learning[J]. Electric Power Engineering Technology, 2019, 38(5): 8-15.
|
| [11] |
徐海洋, 赵伟, 刘建业. 基于边缘结构特征的红外与可见光图像配准算法[J]. 红外技术, 2023, 45(8): 858-862. http://hwjs.nvir.cn/cn/article/id/99918810-4d08-4553-8dc2-f4eb2ccd117f
XU H, ZHAO W, LIU J. Infrared and visible image registration algorithm based on edge structure features[J]. Infrared Technology, 2023, 45(8): 858-862. http://hwjs.nvir.cn/cn/article/id/99918810-4d08-4553-8dc2-f4eb2ccd117f
|
| [12] |
谢林枫, 蒋超, 孙秋芹, 等. 基于AMC算法的变电站巡检机器人地图创建与定位[J]. 电力工程技术, 2019, 38(5): 16-23.
XIE L, JIANG C, SUN Q, et al. The global map's creating and positioning of substation inspection robot based on adaptive Monte Carlo particle filter algorithm[J]. Electric Power Engineering Technology, 2019, 38(5): 16-23.
|
| [13] |
李易达, 汪刘洋, 韩雨晓, 等. 基于ROS系统的作物图像自主采集系统[J]. 智能化农业装备学报, 2023, 4(2): 53-62.
LI Y, WANG L, HAN Y, et al. Crop image autonomous acquisition system based on ROS system[J]. Journal of Intelligent Agricultural Mechanization, 2023, 4(2). 53-62
|
| [14] |
李淑菲, 李凯雨, 乔岩, 等. 基于可见光光谱和改进YOLOv5的自然场景下黄瓜病害检测方法[J]. 光谱学与光谱分析, 2023, 43(8): 2596-2600.
LI S, LI K, QIAO Y, et al. Cucumber disease detection method based on visible light spectrum and improved YOLOv5 in natural scenes[J]. Spectroscopy and Spectral Analysis, 2023, 43(8): 2596-2600.
|
| [15] |
CHEN S, LI X, ZHAO L, et al. Medium-low resolution multisource remote sensing image registration based on SIFT and robust regional mutual information[J]. International Journal of Remote Sensing, 2018, 39(10): 3215-3242.
|
| [16] |
CHEN Yanjia. Visible and infrared image registration based on region features and edginess[J]. Machine Vision and Applications, 2018, 29(1): 113-123.
|
| [17] |
ZENG Qiang. Real-time adaptive visible and infrared image registration based on morphological gradient and C_SIFT[J]. Journal of Real-Time Image Processing, 2020, 5(17): 1103-1115.
|
| [18] |
REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Trans. on Pattern Analysis & Machine Intelligence, 2017, 39(6): 1137-1149.
|
| [19] |
Farooq M A, Shariff W, O'callaghan D, et al. On the role of thermal imaging in automotive applications: a critical review[J]. IEEE Access, 2023, 11: 25152-25173.
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: