Citation: | WANG Yong, YANG Yu, LIU Jinshuo, YU Haibo, LIU Bo. Insulator Fault Recognition Based on Fusion of Infrared and Visible Light Images[J]. Infrared Technology , 2025, 47(5): 648-655. |
To address the limitations of traditional insulator fault detection methods: specifically the inadequate capture of details and poor performance in identifying small targets, a novel dual-stream attention-based approach is proposed. This method combines a deep supervised attention generative adversarial network (DSAGAN) with the YOLOv8 object detection algorithm. In the proposed DSAGAN, infrared and visible light images of insulators are fused using an attention mechanism embedded within the generator of the generative adversarial network (GAN) to enhance fusion quality. The generator and discriminator form an adversarial network, where the least squares (LS) loss function is employed instead of the conventional cross-entropy loss. This substitution helps preserve finer image details and improves the stability of the DSAGAN. The fused images are then subjected to fault detection using the YOLOv8 object detection algorithm. Experimental results demonstrate that the five evaluation indexes of the insulator images fused by DSAGAN outperform those of seven other fusion methods. YOLOv8 object detection algorithm achieves a mean average precision (mAP) of 0.917 and 0.639 for detecting insulator damages, flashovers, glass losses, and polymer contaminations at thresholds of 0.5 and 0.5 to 0.95, respectively, representing improvements of 0.026 and 0.08 compared to YOLOv5. Furthermore, the fault recognition rates of fused images for different types of insulator faults surpass those of single infrared or visible light images. The average recognition rate reaches 93%, marking improvements of 6.25% and 4.5% over infrared and visible light images, respectively.
[1] |
LIU J, LIU C, WU Y, et al. An improved method based on deep learning for insulator fault detection in diverse aerial images[J]. Energies, 2021, 14(14): 4365. DOI: 10.3390/en14144365
|
[2] |
WANG B, DONG M, REN M, et al. Automatic fault diagnosis of infrared insulator images based on image instance segmentation and temperature analysis[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(8): 5345-5355. DOI: 10.1109/TIM.2020.2965635
|
[3] |
LIU Y, JI X, PEI S, et al. Research on automatic location and recognition of insulators in substation based on YOLOv3[J]. High Voltage, 2020, 5(1): 62-68. DOI: 10.1049/hve.2019.0091
|
[4] |
ZHOU M, WANG J, LI B. ARG-Mask RCNN: an infrared insulator fault-detection network based on improved mask RCNN[J]. Sensors, 2022, 22(13): 4720. DOI: 10.3390/s22134720
|
[5] |
ZHAO Z, XU G, QI Y. Representation of binary feature pooling for detection of insulator strings in infrared images[J]. IEEE Transactions on Dielectrics and Electrical Insulation, 2016, 23(5): 2858-2866. DOI: 10.1109/TDEI.2016.7736846
|
[6] |
Zaripova A D. Convolutional neural network to detect support and suspend insulators on infrared images[C]//2023 5th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE). IEEE, 2023, 5: 1-5.
|
[7] |
ZHANG Z, HUANG S, LI Y, et al. Image detection of insulator defects based on morphological processing and deep learning[J]. Energies, 2022, 15(7): 2465. DOI: 10.3390/en15072465
|
[8] |
XIA H, YANG B, LI Y, et al. An improved CenterNet model for insulator defect detection using aerial imagery[J]. Sensors, 2022, 22(8): 2850. DOI: 10.3390/s22082850
|
[9] |
TANG Xiaoyu, HUANG Jinbo, FENG Jiewen, et al. Image segmentation and defect detection of insulators based on U-net and YOLOv4[J]. Journal of South China Normal University (Natural Science Edition), 2020, 52(6): 15-21.
|
[10] |
Gupta G. Algorithm for image processing using improved median filter and comparison of mean, median and improved median filter[J]. International Journal of Soft Computing and Engineering (IJSCE), 2011, 1(5): 304-311.
|
[11] |
LIU Y, TIAN J, HU R, et al. Improved feature point pair purification algorithm based on SIFT during endoscope image stitching[J]. Frontiers in Neurorobotics, 2022, 16: 840594. DOI: 10.3389/fnbot.2022.840594
|
[12] |
YOU A, KIM J K, Ryu I H, et al. Application of generative adversarial networks (GAN) for ophthalmology image domains: a survey[J]. Eye and Vision, 2022, 9(1): 1-19. DOI: 10.1186/s40662-021-00274-y
|
[13] |
HU Y, XU S, CHENG X, et al. AFSFusion: an adjacent feature shuffle combination network for infrared and visible image fusion[J]. Applied Sciences, 2023, 13(9): 5640. DOI: 10.3390/app13095640
|
[14] |
Khachumov V M, Emelyanova G Y. Parabola as an activation function of artificial neural networks[J]. Scientific and Technical Information Processing, 2025, 51(5): 471-477.
|
[15] |
Katzer J, Skoratko A, SeitlS. Properties of steel fiber reinforced mortar‐plastic columns with the cross‐section in a form of a Cesaro fractal[J]. Structural Concrete, 2023, 25(2): 904-915.
|
[16] |
Esplen M J, WONG J, LS V M. Supporting resilience and the management of grief and loss among nurses: qualitative themes from a continuing education program[J]. Journal of Hospice and Palliative Care, 2022, 25(2): 55.
|
[17] |
Hashim F, Dibs H, Jaber H S. Adopting Gram-Schmidt and Brovey methods for estimating land use and land cover using remote sensing and satellite images[J]. Nature Environment and Pollution Technology, 2022, 21(2): 867-881.
|
[18] |
Ahmed S J F, Salih D M. IHS image fusion based on gray wolf optimizer (GWO)[J]. Anbar Journal for Engineering Sciences, 2022, 13(1): 65-75.
|
[19] |
TIAN C, ZHENG M, ZUO W, et al. Multi-stage image denoising with the wavelet transform[J]. Pattern Recognition, 2023, 134: 109050.
|
[20] |
Mishra D, Palkar B. Image fusion techniques: a review[J]. International Journal of Computer Applications, 2015, 130(9): 7-13.
|
[21] |
SONG L, LIN Y, FENG W, et al. A novel automatic weighted image fusion algorithm[C]//2009 International Workshop on Intelligent Systems and Applications. IEEE, 2009: 1-4.
|
[22] |
Polinati S, Bavirisetti D P, Rajesh K N, et al. Multimodal medical image fusion based on content-based and PCA-sigmoid[J]. Current Medical Imaging, 2022, 18(5): 546-562.
|
[23] |
WANG G, CHEN Y, AN P, et al. UAV-YOLOv8: a small-object-detection model based on improved YOLOv8 for UAV aerial photography scenarios[J]. Sensors, 2023, 23(16): 7190.
|
[24] |
LU L. Improved YOLOv8 detection algorithm in security inspection image[J]. arXiv preprint arXiv: 2308.06452, 2023.
|
[25] |
Sary I P, Andromeda S, Armin E U. Performance comparison of YOLOv5 and YOLOv8 architectures in human detection using aerial images[J]. Ultima Computing: Jurnal Sistem Komputer, 2023, 15(1): 8-13.
|
[26] |
Deshpande M, Agarwal A, Kamathe R. Development of an energy-efficient cctv camera system for real-time human detection using YOLOv8 model[J]. Eastern-European Journal of Enterprise Technologies, 2024, 6(9): 47-59.
|
[27] |
LAN Y, CHEN M, LI C, et al. Research on small target detection method for industrial safety helmets based on improved YOLOv8[J]. Journal of Computing and Information Technology, 2023, 31(2): 123-133.
|
[1] | HONG Li, ZENG Xiangjin. Infrared Target Detection Algorithm Based on Improved YOLOv8 in Complex Street Scenes[J]. Infrared Technology , 2025, 47(5): 591-600. |
[2] | DENG Changzheng, LIU Mingze, FU Tian, GONG Mengqing, LUO Bingjie. Infrared Image Recognition of Substation Equipment Based on Improved YOLOv7-Tiny Algorithm[J]. Infrared Technology , 2025, 47(1): 44-51. |
[3] | LI Xu, XIAO Zhiyun, JIANG Yedong, WANG Yazhou, SU Yu. Fault Detection and Identification of Multi-Source Insulators Based on Improved YOLOv7[J]. Infrared Technology , 2024, 46(11): 1325-1333. |
[4] | YUE Mingkai, QUAN Kangnan, ZHANG Cong, HAN Ziqiang. Research on Infrared Small Target Detection Algorithm Based on Improved YOLOv8[J]. Infrared Technology , 2024, 46(11): 1286-1292. |
[5] | LIANG Xiuman, ZHAO Jiayang, YU Haifeng. Lightweight Underwater Target Detection Algorithm Based on YOLOv8[J]. Infrared Technology , 2024, 46(9): 1015-1024. |
[6] | LIU Fukuan, LUO Suyun, HE Jia, ZHA Chaoneng. FVIT-YOLO v8: Improved YOLO v8 Small Object Detection Based on Multi-scale Fusion Attention Mechanism[J]. Infrared Technology , 2024, 46(8): 912-922. |
[7] | SHEN Lingyun, LANG Baihe, SONG Zhengxun, WEN Zhitao. Infrared Image Object Detection Method Based on DCS-YOLOv8 Model[J]. Infrared Technology , 2024, 46(5): 565-575. |
[8] | HU Taishan, LIU Hao, LIU Gang, MEI Qi, MA Yutang, LIAO Minchuan. Infrared Image Fault Detection Method of Arrester Based on Improved YOLOv3[J]. Infrared Technology , 2023, 45(11): 1256-1261. |
[9] | SHEN Lingyun, LANG Baihe, SONG Zhengxun, WEN Zhitao. Remote Sensing Image Target Detection Method Based on CSE-YOLOv5[J]. Infrared Technology , 2023, 45(11): 1187-1197. |
[10] | YI Shi, NIE Yan, ZHANG Yangyi, ZHAO Qianqian, ZHUANG Yitong. Nighttime Target Recognition Method Based on Infrared Thermal Imaging and YOLOv3[J]. Infrared Technology , 2019, 41(10): 970-975. |