| Citation: |
SU Jianbin, SHEN Ying, HUANG Lei, SHEN Yuanxing. Automotive Infrared and Visible Light Image Registration Method[J]. Infrared Technology , 2024, 46(10): 1209-1217.
|
To enhance the visual perception of vehicles, an improved contour angle orientation (CAO) algorithm is proposed for the registration of infrared and visible light images in traffic scenes. By simulating different traffic scenarios, a performance comparison was conducted among mature algorithms to select the superior CAO algorithm. Subsequently, improvements were made to the coarse matching parameters and image preprocessing scaling procedure. Experiments demonstrate that the refined CAO algorithm achieves more precise fine matching, thus resulting in mosaic stitching with smoother transitions and lines and yielding better results. Compared with the original CAO algorithm, the improved version reduces the RMSE value by 3.29%, increases the precision value by 2.13%, and decreases the average computation time by 0.11 s, thereby demonstrating improvements in both registration accuracy and real-time performance.
| [1] |
HONG R, XIANG C L, LIU H, et al. Visualizing the knowledge structure and research evolution of infrared detection technology studies[J]. Information, 2019, 10(7): 227. DOI: 10.3390/info10070227
|
| [2] |
LI S T, KANG X D, FANG L Y, et al. Pixel-level image fusion: a survey of the state of the art [J]. Information Fusion, 2017, 33: 100-112. DOI: 10.1016/j.inffus.2016.05.004
|
| [3] |
MA J Y, MA Y, LI C. Infrared and visible image fusion methods and applications: a survey[J]. Information Fusion, 2019, 45: 153-178. DOI: 10.1016/j.inffus.2018.02.004
|
| [4] |
Castillo J C, Fernandez-Caballero A, Serrano-Cuerda J, et al. Smart environment architecture for robust people detection by infrared and visible video fusion[J]. Journal of Ambient Intelligence and Humanized Computing, 2017, 8(2): 223-237. DOI: 10.1007/s12652-016-0429-5
|
| [5] |
Fendri E, Boukhriss R R, Hammami M. Fusion of thermal infrared and visible spectra for robust moving object detection[J]. Pattern Analysis and Applications, 2017, 20(4): 907-926. DOI: 10.1007/s10044-017-0621-z
|
| [6] |
Apatean A, Rogozan A, Bensrhair A. Visible-infrared fusion schemes for road obstacle classification[J]. Transportation Research Part C-Emerging Technologies, 2013, 35: 180-192. DOI: 10.1016/j.trc.2013.07.003
|
| [7] |
DONG Yakui, FEI Cheng, ZHAO Guopeng, et al. Registration method for infrared and visible image of sea surface vessels based on contour feature[J]. Heliyon, 2023, 9(3): 14166-14176. DOI: 10.1016/j.heliyon.2023.e14166
|
| [8] |
Kumar K S, Kavitha G, Subramanian R, et al. MATLAB-A Ubiquitous Tool for the Practical Engineer[M]. Croatia: InTech, 2011: 307-326.
|
| [9] |
李大华, 郑文鹏, 李璇, 等. 基于局部归一化的电力设备红外与可见光图像配准[J/OL]. 激光与光电子学进展, 2025, 62(6): 0637007.
LI Dahua, ZHENG Wengpeng, LI Xuan, et al. Infrared and visible image registration of power equipment based on local normalization[J]. Laser & Optoelectronics Progress, 2025, 62(6) : 0637007.
|
| [10] |
程国华, 王阿川, 陈舒畅, 等. 多源遥感影像高精度自动配准方法研究[J]. 液晶与显示, 2016, 31(6): 604-612.
CHEN Guohua, WANG Achuan, CHEN Shuchang, et al. High accuracy-automatic registration method research on multi-source remote sensing image[J]. Liquid Crystals and Displays, 2016, 31(6): 604-612.
|
| [11] |
谭东杰, 张安. 方向相关与互信息加权组合多模图像配准方法[J]. 红外与激光工程, 2013, 42(3): 836-841. DOI: 10.3969/j.issn.1007-2276.2013.03.067
TAN Dongjie, ZHANG an, Multi-model image registration based on weighted orientation correlation and mutual information[J]. Infrared and Laser Engineering, 2013, 42(3): 836-841. DOI: 10.3969/j.issn.1007-2276.2013.03.067
|
| [12] |
李云红, 刘宇栋, 苏雪平, 等. 红外与可见光图像配准技术研究综述[J]. 红外技术, 2022, 44(7): 641-651. http://hwjs.nvir.cn/article/id/77ef812e-5018-435f-a023-771b550bedc7
LI Yunhong, LIU Yudong, SU Xueping, et al. Review of infrared and visible image registration[J]. Infrared Technology, 2022, 44(7): 641-651. http://hwjs.nvir.cn/article/id/77ef812e-5018-435f-a023-771b550bedc7
|
| [13] |
吴延海, 张程, 张烨. 基于梯度信息和区域互信息的图像配准[J]. 广西大学学报: 自然科学版, 2017, 42(2): 720-727.
WU Yanhai, ZHANG Cheng, ZHANG Ye. Image registration based on gradient and regional mutual information[J]. Journal of Guangxi University(Natural Science Edition), 2017, 42(2): 720-727.
|
| [14] |
孙凤杰, 赵孟丹, 刘威, 等. 基于方向场的输电线路间隔棒匹配定位算法[J]. 中国电机工程学报, 2014, 34(1): 206-213.
SUN Fengjie, ZHAO Mengdan, LIU Wei, et al. Spacer matching and localization algorithm for transmission line video images based on directional field[J]. Proceedings of the CSEE, 2014, 34(1): 206-213.
|
| [15] |
刘刚, 周珩, 梁晓庚, 等. 非下采样轮廓波域红外与可见光图像配准算法[J]. 计算机科学, 2016, 43(11): 313-316. DOI: 10.11896/j.issn.1002-137X.2016.11.061
LIU Gang, ZHOU Heng, LIANG Xiaogeng, et al. Image registration algorithm for infrared and visible light based on non-subsampled contourlet transform[J]. Computer Science, 2016, 43(11): 313-316. DOI: 10.11896/j.issn.1002-137X.2016.11.061
|
| [16] |
MA J, JIANG X, FAN A, et al. Image matching from handcrafted to deep features: a survey[J]. International Journal of Computer Vision, 2021, 129(1): 23-79. DOI: 10.1007/s11263-020-01359-2
|
| [17] |
MOREL J M, YU G. ASIFT: A new framework for fully affine invariant image comparison[J]. SIAM Journal on Imaging Sciences, 2009, 2(2): 438-469. DOI: 10.1137/080732730
|
| [18] |
YANG N, YANG Y, LI P, et al. Research on infrared and visible image registration of substation equipment based on multi-scale Retinex and ASIFT features[C]//Sixth International Workshop on Pattern Recognition. International Society for Optics and Photonics, 2021, 11913: 1191303.
|
| [19] |
BAY H, ESS A, TUYTELAARS T, et al. Speeded-up robust features (SURF)[C]//European Conference on Computer Vision(ECCV), 2006, 3951(1): 404-417.
|
| [20] |
JIANG Q, LIU Y, YAN Y, et al. A contour angle orientation for power equipment infrared and visible image registration[J]. IEEE Transactions on Power Delivery, 2021, 36(4): 2559-2569. DOI: 10.1109/TPWRD.2020.3011962
|
| [21] |
李云红, 罗雪敏, 苏雪平, 等. 基于改进曲率尺度空间算法的电力设备红外与可见光图像配准[J]. 激光与光电子学进展, 2022, 59(12): 138-145.
LI Yunhong, LUO Xuemin, SU Xueping, et al. Registration method for power equipment infrared and visible images based on improved curvature scale space algorithm[J]. Progress in Laser and Optoelectronics, 2022, 59(12): 138-145.
|
| [22] |
CHENG T, GU J, ZHANG X, et al. Multimodal image registration for power equipment using clifford algebraic geometric invariance[J]. Energy Reports, 2022, 8: 1078-1086. DOI: 10.1016/j.egyr.2022.02.192
|
| [23] |
陈亮, 周孟哲, 陈禾. 一种结合边缘区域和互相关的图像配准方法[J]. 北京理工大学学报, 2016, 36(3): 320-325.
CHEN Liang, ZHOU Mengzhe, CHEN He, A method for image registration combined by edge region and cross correlation[J]. Transactions of Beijing Institute of Technology, 2016, 36(3): 320-325.
|
| [24] |
付添, 邓长征, 韩欣月, 等. 基于深度学习的电力设备红外与可见光图像配准[J]. 红外技术, 2022, 44(9): 936-943. http://hwjs.nvir.cn/article/id/1f007d8f-ee0d-4cd3-b609-1084e911d70a
FU Tian, DENG Changzheng, HAN Xinyue, et al. Infrared and visible image registration for power equipment based on deep learning[J]. Infrared Technology, 2022, 44(9): 936-943. http://hwjs.nvir.cn/article/id/1f007d8f-ee0d-4cd3-b609-1084e911d70a
|
| [25] |
赵俊梅, 张利平. 复杂天气和环境下交通标志图像特征匹配技术的研究[J]. 车辆与动力技术, 2022(4): 38-43.
ZHAO Junmin, ZHANG Liping. Research on image feature matching technology of traffic signs in complex weather and environment[J]. Vehicle & Power Technology, 2022(4): 38-43.
|
| [26] |
姜骞, 刘亚东, 方健, 等. 基于轮廓特征的电力设备红外和可见光图像配准方法[J]. 仪器仪表学报, 2020, 41(11): 252-260.
JIANG Qian, LIU Yadong, FANG Jian, et al. Registration method for power equipment infrared and visible images based on contour feature[J]. Chinese Journal of Scientific Instrument, 2020, 41(11): 252-260.
|
| [27] |
徐伯庆, 孙国强, 陈离. 数字图像缩放的原理与硬件实现[J]. 上海理工大学学报, 2002, 24(3): 222-225. DOI: 10.3969/j.issn.1007-6735.2002.03.005
XU Boqing, SUN Guoqiang, CHEN Li. The principle and hardware implementation of digital image scaling[J]. Journal of University of Shanghai for Science and Technology, 2002, 24(3): 222-225. DOI: 10.3969/j.issn.1007-6735.2002.03.005
|
| [28] |
余先川, 吕中华, 胡丹. 遥感图像配准技术综述[J]. 光学精密工程, 2013, 21(11): 2960-2972.
YU Xianchuan, LV Zhonghua, HU Dan. Review of remote sensing image registration techniques[J]. Optics and Precision Engineering, 2013, 21(11): 2960-2972.
|
| [29] |
陈勇, 皮德富, 周士源, 等. 基于小波变换的红外图像融合技术研究[J]. 红外与激光工程, 2001, 30(1): 3.
CHEN Yong, PI Defu, ZHOU Shiyuan, et al. Study for infrared image fusion based on wavelet transform[J]. Infrared and Laser Engineering, 2001, 30(1): 3.
|
| [30] |
Rublee E, Rabaud V, Konolige K, et al. ORB: an efficient alternative to SIFT or SURF[C]//International Conference on Computer Vision, 2011, 2564-2571(DOI: 10.1109/ICCV.2011.6126544).
|
| [1] | DENG Changzheng, LIU Mingze, FU Tian, GONG Mengqing, LUO Bingjie. Infrared Image Recognition of Substation Equipment Based on Improved YOLOv7-Tiny Algorithm[J]. Infrared Technology , 2025, 47(1): 44-51. |
| [2] | WANG Chongwen, PENG Tinghai, LUO Rui, LIU Jian, YANG Yuping, WANG Shijin, YAN Tingyu, GE Fan, LIU Yanfang, LIU Yunhong. Tropical Marine Environmental Adaptability of Germanium Coated Infrared Antireflection Film[J]. Infrared Technology , 2024, 46(8): 957-964. |
| [3] | ZHOU Huikui, ZHANG Li, HU Sujuan. Underwater Image Enhancement Based on Improved Histogram Matching and Adaptive Equalization[J]. Infrared Technology , 2024, 46(5): 532-538. |
| [4] | YANG Yuping, LIU Jian, ZHOU Xiaoyu, ZHAO Hongkun, LIU Yanfang, WANG Chongwen, ZHAO Yuanrong, GE Fan, XIAO Jianjun, LUO Rui, YANG Pinjie. Environmental Adaptability of Infrared Antireflection Films in Humid Hot Rain Forest[J]. Infrared Technology , 2021, 43(12): 1197-1201. |
| [5] | TANG Changming, ZHONG Jianfeng, ZHONG Shuncong, CHEN Man, FU Xibin, HUANG Xuebin. Ultrasound Infrared Thermography Defect Recognition Based on Improved Adaptive Genetic Algorithm with Two-Dimensional Maximum Entropy[J]. Infrared Technology , 2020, 42(8): 801-808. |
| [6] | WANG Chongwen, ZHAO Hongkun, LIU Jian, WANG Qiaofang, ZHU Guangyu, YANG Yuping, LUO Rui, ZHAO Yuanrong, LI Wei, LIU Yanfang, GE Fan. Dissecting the Adaptability of OLED Displays in Tropical Rainforest[J]. Infrared Technology , 2020, 42(6): 542-546. |
| [7] | JING Weiguo, SUN Mingzhao, LI Yongtao. Novel Experimental Method of Intense Light Adaptability of Night Vision Systems with Large Dynamic Range[J]. Infrared Technology , 2019, 41(7): 689-692. |
| [8] | LIU Hui, SHI Xiaolong. Improved GrabCut Segmentation Based on Salience and Superpixels[J]. Infrared Technology , 2018, 40(1): 55-61. |
| [9] | Improved Adaptive Segmentation Non-uniformity Correction Method for IRFPA[J]. Infrared Technology , 2017, 39(3): 209-213. |
| [10] | ZHANG Jin-cheng, LIAO Shou-yi, ZHANG Zuo-yu, SU De-lun, YAN Xun-liang. Real-time Improvement for Resistor Array Nonuniformity Correction[J]. Infrared Technology , 2015, 37(11): 921-925. |
| 1. |
田超华，赵欢，黄鸿基，孙伟可，王学峰. 基于深度学习的配电网开关柜电晕放电检测设计. 电子设计工程. 2025(01): 51-54+60 .
| |
| 2. |
韩勇勇. 基于小波变换的PSO优化紫外双通道图像融合研究. 中国照明电器. 2025(02): 95-102 .
| |
| 3. |
刘俊，王鲸，周炎生. 综合消磁工作线圈电缆接头击穿故障分析及应对策略. 广东造船. 2025(01): 59-62 .
| |
| 4. |
朱杰，冯新颖，许网俊，范佳佳，杨赟. 基于YOLOV3神经网络的轨道车辆局部放电缺陷检测方法. 电工技术. 2025(03): 194-196 .
| |
| 5. |
江澎，康正军，陈涛，冯一飞，吴琼. 融合人工智能与无线通信的热成像局放检测技术研究. 长江信息通信. 2024(01): 152-154 .
| |
| 6. |
赵昊然，陆智勇，江明，刘立石. 小波包能量谱和神经网络的开关柜局部放电自动检测方法. 自动化与仪表. 2024(02): 92-96 .
| |
| 7. |
汪可夫，胡志祥. 预制舱式变电站负荷支路漏电监测方法设计. 自动化仪表. 2024(07): 55-59+69 .
| |
| 8. |
江熠，金坤鹏，钱锡颖，任一舟. 基于局部放电测试技术的避雷器状态诊断方法研究. 计算机测量与控制. 2024(07): 36-43 .
| |
| 9. |
章铖. 基于红外热成像的变电站支柱绝缘子缺陷自动检测方法. 自动化技术与应用. 2024(08): 16-19+45 .
| |
| 10. |
邵钦禹. 电力电缆的带电诊断与故障处理技术分析. 集成电路应用. 2024(09): 368-369 .
| |
| 11. |
刘秀婷，李烨，高峰，马味敏. 高压电缆局部放电检测及识别系统研究. 电子测量技术. 2024(17): 97-107 .
| |
| 12. |
胡梦捷. 基于非接触式测温技术的光伏直流侧拉弧线缆发热监测. 电线电缆. 2024(06): 31-34 .
| |
| 13. |
韩勇勇，宋鹏，刘成涛. 基于ZYNQ 7020的双通道紫外放电检测系统设计. 国外电子测量技术. 2024(12): 115-120 .
| |
| 14. |
苗堃，陈垒，李沛东，赵亚军，李健，郑城市，张胜利. 基于涡流技术的高压电缆铅封缺陷识别仿真研究. 环境技术. 2023(02): 139-145 .
| |
| 15. |
龙丽名. 低压电线电缆检测手段及质量控制研究. 科技资讯. 2023(11): 42-45 .
| |
| 16. |
何维晟，吴照国，徐扬，杜茂春，王谦，李勇，石钧仁. 高压电缆终端局部放电超声信号传输特性仿真分析. 高压电器. 2023(11): 48-55+64 .
| |
| 17. |
刘杰，夏彦卫，贾伯岩，吴国强，殷庆栋. 基于高精度温度传感器的多股碳纤维导线潜伏性缺陷检测方法. 电子测量与仪器学报. 2023(11): 65-71 .
| |
| 18. |
焦宇阳，段海南，张宏军，郑福建，朱进，刘新. 一种基于相关性分析和模糊规则的高压电缆状态评价方法. 电力大数据. 2022(10): 53-61 .
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: