ZHOU Dengke, GUO Xingchen, SHI Kaite, TANG Peng, ZHENG Kaiyuan, MA Pengge. Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection[J]. Infrared Technology , 2023, 45(11): 1161-1168.
Citation: ZHOU Dengke, GUO Xingchen, SHI Kaite, TANG Peng, ZHENG Kaiyuan, MA Pengge. Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection[J]. Infrared Technology , 2023, 45(11): 1161-1168.

Infrared Blade Image Stitching Algorithm for Wind Farm UAV Inspection

More Information
  • Received Date: September 25, 2022
  • Revised Date: December 12, 2022
  • Aiming at more redundant background information and low stitching accuracy of the infrared images of the blades taken by UAV (Unmanned Aerial Vehicle), In this study, we proposed a stitching algorithm for infrared wind turbine blade images combining the Chan-Vese model and morphology. First, we subjected the image to median filtering and noise reduction, and a morphological operation improved a level-set algorithm based on the Chan-Vese model to generate the mask of the expression subject. We extracted Harris feature points by removing redundant backgrounds based on the mask. We performed morphological etching on the mask to suppress the pseudo-feature points on the boundary-jagged pixels. We used violent matching and the RANSAC algorithm to screen out effective matching point pairs and calculate the homography matrix to realize matching and splicing. Compared with the Harris stitching algorithm under traditional image segmentation, the stitching accuracy of the improved algorithm significantly improved, and it showed strong robustness in different test scenarios.
  • [1]
    李禹桥. 基于旋翼无人机的风电叶片自主巡检系统研究[D]. 徐州: 中国矿业大学, 2021.

    LI Yuqiao. Research on Wind Turbine Blade Autonomous Inspection System based on Rotorcraft UAV[D]. Xuzhou: China University of Mining and Technology, 2021.
    [2]
    张明辉. 风力发电机故障检修与处理[J]. 科技创新导报, 2019, 16(10): 132-133. https://www.cnki.com.cn/Article/CJFDTOTAL-ZXDB201910075.htm

    ZHANG Minghui. Wind turbine fault repair and treatment[J]. Science and Technology Innovation Herald, 2019, 16(10): 132-133. https://www.cnki.com.cn/Article/CJFDTOTAL-ZXDB201910075.htm
    [3]
    王蔚, 刘丹. 我国风电市场: 前景一路看好[N]. 经济参考报, [2006-06-15].

    WANG Wei, LIU Dan. China's wind power market: prospects all the way bright[N]. Economic Information Daily, [2006-06-15].
    [4]
    王浩, 闫号, 叶海瑞, 等. 基于无人机的光伏电站智能巡检[J]. 红外技术, 2022, 44(5): 537-542. http://hwjs.nvir.cn/article/id/9b100b0a-485a-47dd-bc1a-357a9bc0091f

    WANG Hao, YAN Hao, YE Hairui, et al. Intelligent patrol inspection of photovoltaic power station based on UAVs[J]. Infrared Technology, 2022, 44(5): 537-542. http://hwjs.nvir.cn/article/id/9b100b0a-485a-47dd-bc1a-357a9bc0091f
    [5]
    宫妍, 位冲冲. 图像拼接关键技术研究综述[J]. 电脑知识与技术, 2021, 17(30): 106-108. Doi: 10.14004/j.cnki.ckt.2021.2895.

    GONG Yan, WEI Chongchong. Review on key techniques of image stitching[J]. Computer Knowledge and Technology, 2021, 17(30): 106-108. Doi: 10.14004/j.cnki.ckt.2021.2895.
    [6]
    CUI Z, QI W, LIU Y. A fast image template matching algo-rithm based on normalized cross correlation[J]. Journal of Physics Conference Series, 2020, 1693: 012163. DOI: 10.1088/1742-6596/1693/1/012163
    [7]
    马宝琰, 汤磊, 赵晶, 等. 风电叶片图像直线特征检测与拼接方法[J]. 哈尔滨理工大学学报, 2020, 25(5): 83-92. Doi: 10.15938/j.jhust.2020.05.012.

    MA Baoyan, TANG Lei, ZHAO Jing, et al. Straight line features detection and mosaic of wind power blades image[J]. Journal of Harbin University of Science and Technology, 2020, 25(5): 83-92. Doi: 10.15938/j.jhust.2020.05.012.
    [8]
    卢泉, 杨振华, 黄粒峰. 改进最佳缝合线的红外图像拼接方法[J]. 红外技术, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b

    LU Quan, YANG Zhenhua, HUANG Lifeng. Infrared image mosaic method for improving the best seam-line[J]. Infrared Technology, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b
    [9]
    傅子秋, 张晓龙, 余成, 等. 多场景下基于快速相机标定的柱面图像拼接方法[J]. 光电工程, 2020, 47(4): 74-86. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202004008.htm

    FU Ziqiu, ZHANG Xiaolong, YU Cheng, et al. Cylindrical image mosaic method based on fast camera calibration in multi-scene[J]. Opto-Electronic Engineering, 2020, 47(4): 74-86. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202004008.htm
    [10]
    何赟泽, 张帆, 刘昊, 等. 风机叶片无人机红外热图像拼接方法[J]. 电子测量与仪器学报, 2022, 36(7): 44-53. Doi: 10.13382/j.jemi.B2105058.

    HE Yunze, ZHANG Fan, LIU Hao, et al. Infrared image stitch method of wind turbine blade based on UAV[J]. Journal of Electronic Measurement and Instrument, 2022, 36(7): 44-53. Doi: 10.13382/j.jemi.B2105058.
    [11]
    方喜波. 光电侦察吊舱对海广域搜索方法[J]. 红外技术, 2021, 43(11): 1055-1060. http://hwjs.nvir.cn/article/id/9db773d6-e53b-4486-a8ca-f32834bc9f13

    FANG Xibo. Searching method of the wide area of optical recon pod for sea targets[J]. Infrared Technology, 2021, 43(11): 1055-1060. http://hwjs.nvir.cn/article/id/9db773d6-e53b-4486-a8ca-f32834bc9f13
    [12]
    Osher S, Sethian J A. Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations[J]. Journal of Computational Physics, 1988, 79(1): 12-49.
    [13]
    Ghaili A M, Mashohor S, Ramli A R. Vertical-edge-based car-license-plate detection method[J]. IEEE Transactions on Vehicular Technology, 2013, 62(1): 26-38.
    [14]
    张见双, 张红民, 罗永涛, 等. 一种改进的Harris角点检测的图像配准方法[J]. 激光与红外, 2017, 47(2): 230-233. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW201702021.htm

    ZHANG Jianshuang, ZHANG Hongmin, LUO Yongtao, et al. Image registration method based on improved Harris corner detection algorithm[J]. Laser & Infrared, 2017, 47(2): 230-233. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW201702021.htm
  • Related Articles

    [1]ZHOU Huikui, ZHANG Li, HU Sujuan. Underwater Image Enhancement Based on Improved Histogram Matching and Adaptive Equalization[J]. Infrared Technology , 2024, 46(5): 532-538.
    [2]MA Qun, ZHAO Meirong, ZHENG Yelong, SUN Lin, NI Feng. Infrared Image Detail Enhancement Based on Adaptive Conditional Histogram Equalization[J]. Infrared Technology , 2024, 46(1): 52-60.
    [3]LIU He, ZHAO Tiancheng, LI Jiashuai, YANG Daiyong, YUAN Xiaocui, XU Zhihao. Contrast Enhancement Method of SF6 Infrared Image Based on Tri-histogram Equalization Algorithm[J]. Infrared Technology , 2023, 45(10): 1118-1125.
    [4]HE Zhibo, ZENG Xiangjin, DENG Chen, SONG Pengpeng. Infrared Image Enhancement Based on Local Entropy-Local Contrast and Dual-area Histogram Equalization[J]. Infrared Technology , 2023, 45(6): 598-604.
    [5]HU Xuekai, LUO Peng, LI Tiecheng, CAI Yuru, MA Na, ZHOU Xueqing. Multi-scale Image Fusion Based on Adaptive Weighting[J]. Infrared Technology , 2022, 44(4): 404-409.
    [6]CHEN Zhiheng, YAN Limin, ZHANG Jingyang. Nighttime Dehazing Algorithm with Adaptive Global Brightness Compensation[J]. Infrared Technology , 2021, 43(10): 954-959.
    [7]ZHEN Mei, WANG Shupeng. An Adaptive Weighted Average Fusion Method for Visible and Infrared Images[J]. Infrared Technology , 2019, 41(4): 341-346.
    [8]A New Multi-direction Adaptive Weighted Pseudo Median Filtering Algorithm Based on Wavelet Domain[J]. Infrared Technology , 2014, (9): 737-742.
    [9]JIANG Xiao Hui, ZHAO Xun-jie, LI Cheng-jin, ZHANG Xue-song. A Super-Resolution Algorithm Based on Adaptive Weighted Total Variation[J]. Infrared Technology , 2014, (4): 290-293.
    [10]A FCM Segmentation Method of Measurement of Image Based on Adaptive Coefficient of Fuzzy Weight[J]. Infrared Technology , 2013, (3): 146-149.
  • Cited by

    Periodical cited type(0)

    Other cited types(3)

Catalog

    Article views PDF downloads Cited by(3)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return