ZHOU Dengke, GUO Xingchen, SHI Kaite, TANG Peng, ZHENG Kaiyuan, MA Pengge. Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection[J]. Infrared Technology , 2023, 45(11): 1161-1168.
Citation: ZHOU Dengke, GUO Xingchen, SHI Kaite, TANG Peng, ZHENG Kaiyuan, MA Pengge. Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection[J]. Infrared Technology , 2023, 45(11): 1161-1168.

Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection

More Information
  • Received Date: September 25, 2022
  • Revised Date: December 12, 2022
  • Aiming at more redundant background information and low stitching accuracy of the infrared images of the blades taken by UAV (Unmanned Aerial Vehicle), In this study, we proposed a stitching algorithm for infrared wind turbine blade images combining the Chan-Vese model and morphology. First, we subjected the image to median filtering and noise reduction, and a morphological operation improved a level-set algorithm based on the Chan-Vese model to generate the mask of the expression subject. We extracted Harris feature points by removing redundant backgrounds based on the mask. We performed morphological etching on the mask to suppress the pseudo-feature points on the boundary-jagged pixels. We used violent matching and the RANSAC algorithm to screen out effective matching point pairs and calculate the homography matrix to realize matching and splicing. Compared with the Harris stitching algorithm under traditional image segmentation, the stitching accuracy of the improved algorithm significantly improved, and it showed strong robustness in different test scenarios.
  • [1]
    李禹桥. 基于旋翼无人机的风电叶片自主巡检系统研究[D]. 徐州: 中国矿业大学, 2021.

    LI Yuqiao. Research on Wind Turbine Blade Autonomous Inspection System based on Rotorcraft UAV[D]. Xuzhou: China University of Mining and Technology, 2021.
    [2]
    张明辉. 风力发电机故障检修与处理[J]. 科技创新导报, 2019, 16(10): 132-133. https://www.cnki.com.cn/Article/CJFDTOTAL-ZXDB201910075.htm

    ZHANG Minghui. Wind turbine fault repair and treatment[J]. Science and Technology Innovation Herald, 2019, 16(10): 132-133. https://www.cnki.com.cn/Article/CJFDTOTAL-ZXDB201910075.htm
    [3]
    王蔚, 刘丹. 我国风电市场: 前景一路看好[N]. 经济参考报, [2006-06-15].

    WANG Wei, LIU Dan. China's wind power market: prospects all the way bright[N]. Economic Information Daily, [2006-06-15].
    [4]
    王浩, 闫号, 叶海瑞, 等. 基于无人机的光伏电站智能巡检[J]. 红外技术, 2022, 44(5): 537-542. http://hwjs.nvir.cn/article/id/9b100b0a-485a-47dd-bc1a-357a9bc0091f

    WANG Hao, YAN Hao, YE Hairui, et al. Intelligent patrol inspection of photovoltaic power station based on UAVs[J]. Infrared Technology, 2022, 44(5): 537-542. http://hwjs.nvir.cn/article/id/9b100b0a-485a-47dd-bc1a-357a9bc0091f
    [5]
    宫妍, 位冲冲. 图像拼接关键技术研究综述[J]. 电脑知识与技术, 2021, 17(30): 106-108. Doi: 10.14004/j.cnki.ckt.2021.2895.

    GONG Yan, WEI Chongchong. Review on key techniques of image stitching[J]. Computer Knowledge and Technology, 2021, 17(30): 106-108. Doi: 10.14004/j.cnki.ckt.2021.2895.
    [6]
    CUI Z, QI W, LIU Y. A fast image template matching algo-rithm based on normalized cross correlation[J]. Journal of Physics Conference Series, 2020, 1693: 012163. DOI: 10.1088/1742-6596/1693/1/012163
    [7]
    马宝琰, 汤磊, 赵晶, 等. 风电叶片图像直线特征检测与拼接方法[J]. 哈尔滨理工大学学报, 2020, 25(5): 83-92. Doi: 10.15938/j.jhust.2020.05.012.

    MA Baoyan, TANG Lei, ZHAO Jing, et al. Straight line features detection and mosaic of wind power blades image[J]. Journal of Harbin University of Science and Technology, 2020, 25(5): 83-92. Doi: 10.15938/j.jhust.2020.05.012.
    [8]
    卢泉, 杨振华, 黄粒峰. 改进最佳缝合线的红外图像拼接方法[J]. 红外技术, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b

    LU Quan, YANG Zhenhua, HUANG Lifeng. Infrared image mosaic method for improving the best seam-line[J]. Infrared Technology, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b
    [9]
    傅子秋, 张晓龙, 余成, 等. 多场景下基于快速相机标定的柱面图像拼接方法[J]. 光电工程, 2020, 47(4): 74-86. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202004008.htm

    FU Ziqiu, ZHANG Xiaolong, YU Cheng, et al. Cylindrical image mosaic method based on fast camera calibration in multi-scene[J]. Opto-Electronic Engineering, 2020, 47(4): 74-86. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202004008.htm
    [10]
    何赟泽, 张帆, 刘昊, 等. 风机叶片无人机红外热图像拼接方法[J]. 电子测量与仪器学报, 2022, 36(7): 44-53. Doi: 10.13382/j.jemi.B2105058.

    HE Yunze, ZHANG Fan, LIU Hao, et al. Infrared image stitch method of wind turbine blade based on UAV[J]. Journal of Electronic Measurement and Instrument, 2022, 36(7): 44-53. Doi: 10.13382/j.jemi.B2105058.
    [11]
    方喜波. 光电侦察吊舱对海广域搜索方法[J]. 红外技术, 2021, 43(11): 1055-1060. http://hwjs.nvir.cn/article/id/9db773d6-e53b-4486-a8ca-f32834bc9f13

    FANG Xibo. Searching method of the wide area of optical recon pod for sea targets[J]. Infrared Technology, 2021, 43(11): 1055-1060. http://hwjs.nvir.cn/article/id/9db773d6-e53b-4486-a8ca-f32834bc9f13
    [12]
    Osher S, Sethian J A. Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations[J]. Journal of Computational Physics, 1988, 79(1): 12-49.
    [13]
    Ghaili A M, Mashohor S, Ramli A R. Vertical-edge-based car-license-plate detection method[J]. IEEE Transactions on Vehicular Technology, 2013, 62(1): 26-38.
    [14]
    张见双, 张红民, 罗永涛, 等. 一种改进的Harris角点检测的图像配准方法[J]. 激光与红外, 2017, 47(2): 230-233. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW201702021.htm

    ZHANG Jianshuang, ZHANG Hongmin, LUO Yongtao, et al. Image registration method based on improved Harris corner detection algorithm[J]. Laser & Infrared, 2017, 47(2): 230-233. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW201702021.htm
  • Related Articles

    [1]ZHANG Yu, XU Yongsen, WANG Fuchao, XU Yulei, ZHOU Pingwei. Electromechanical Co-simulation Technology of Fast Steering Mirror Driven by Voice Coil Motor[J]. Infrared Technology , 2023, 45(8): 814-821.
    [2]LI Fenhong, LU Jing, ZHANG Zhiguang. Fast Image Segmentation with Multilevel Threshold Based on Tsallis Relative Entropy and Wind-Driven Optimization Algorithm[J]. Infrared Technology , 2020, 42(10): 994-1000.
    [3]LU Xiao-fei, ZHAN Wu-ping, CAI Xin-tian. Method of Modifying Infrared Data by Using Radar Data[J]. Infrared Technology , 2015, (6): 472-474.
    [4]DONG Wei-ke, ZHANG Jian-qi, Wang Lin, XU Yin. Detection of Dim Small Target Based on Homogeneous Model of Background Prediction[J]. Infrared Technology , 2009, 31(6): 354-358. DOI: 10.3969/j.issn.1001-8891.2009.06.011
    [5]DONG Wei-ke, ZHANG Jian-qi, LIU De-lian, WANG Lin. Anisotropic Background Prediction for Detection of Dim Small Target[J]. Infrared Technology , 2008, 30(7): 387-390. DOI: 10.3969/j.issn.1001-8891.2008.07.005
    [6]YANG Li-ping, FENG Xiao-yi. Weak and Small Infrared Targets Detection Based on Background Prediction[J]. Infrared Technology , 2007, 29(7): 404-408. DOI: 10.3969/j.issn.1001-8891.2007.07.008
    [7]WANG Gou-you, CHEN Zhen-xue, LI Qiao-liang. A Review of Infrared Weak and Small Targets Detection under Complicated Background[J]. Infrared Technology , 2006, 28(5): 287-292. DOI: 10.3969/j.issn.1001-8891.2006.05.010
    [8]Small Target Detection Based on Mean Background Model in IR Images[J]. Infrared Technology , 2004, 26(6): 62-65. DOI: 10.3969/j.issn.1001-8891.2004.06.017
    [9]Excitation of a Magnetic Granular Film by an Injected Electric Current-Driven[J]. Infrared Technology , 2004, 26(6): 48-50. DOI: 10.3969/j.issn.1001-8891.2004.06.013
    [10]Study of Strong Pulsed IR Source Driven by MFCG[J]. Infrared Technology , 2002, 24(4): 4-7. DOI: 10.3969/j.issn.1001-8891.2002.04.002

Catalog

    Article views PDF downloads Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return