Research Status of Local Defect Detection Technology of Ultraviolet Image Intensifier Field of View
-
摘要: 紫外像增强器是一种对紫外辐射敏感的成像器件,视场瑕疵是其成像效果的主要制约因素。目前,视场瑕疵检测技术主要分为人工和机器视觉两种方法。本文首先阐述了视场瑕疵的定义和检测标准。接着从瑕疵交叠靠近、大小和数量特性的角度,分析了视场瑕疵检测的难点。随后,重点介绍了紫外像增强器视场瑕疵检测技术的研究现状。结合当前的检测需求和不足,调研了深度学习技术在其他领域的瑕疵检测效果。最后,从理论上进行了可行性分析,并提出了基于深度学习视场瑕疵检测的思路,旨在为紫外像增强器视场瑕疵检测提供一种新的解决方案,推动其向着更加实用、智能化的方向发展。Abstract: Ultraviolet image intensifiers are imaging devices that are sensitive to ultraviolet radiation. Defects in the field of view are the main factors restricting the imaging effect of ultraviolet image intensifiers. Currently, the field-of-view defect detection technology is mainly divided into artificial and machine vision. This paper explains the definitions and detection standards for field defects. Subsequently, the difficulties in field defect detection are analyzed from the perspectives of defect-overlapping proximity, size, and quantity. Next, the research status of the field-of-view defect detection technology of ultraviolet image intensifiers is introduced. Combined with the current detection requirements and deficiencies, the defect detection effect of deep-learning technology in other fields was investigated. Finally, a theoretical feasibility analysis is presented, and the concept of field defect detection based on deep learning is proposed. The purpose is to provide a new solution for field defect detection of ultraviolet image intensifiers and promote their development in a practical and intelligent direction.
-
Keywords:
- image intensifier /
- flaw detection in field of view /
- machine vision /
- deep learning
-
-
图 9 海康威视Vision Master算法平台的检测效果:(a) 表面亮斑;(b) 表面划痕;(c) 形状异常;(d) 轮廓残缺;(e) 划痕检测;(f) 字符缺陷;(g) 崩边检测;(h) 污渍检测;(e) 划痕检测;(f) 字符缺陷;(g) 崩边检测;(h) 污渍检测
Figure 9. The detection results of Hikvision's Vision Master algorithm platform: (a) Surface speck; (b) Surface scratch; (c) Shape anomaly; (d) Contour incomplete; (e) Scratch detection; (f) Character defect; (g) Edge collapse detection; (h) Stain detection
表 1 视场中各分区允许不同大小暗点存在的数量
Table 1 The allowed number of scotoma of different sizes in each zone of the FOV
Size of the scotoma /mm Different zones of the FOV ϕ5.6 mm ϕ5.6 mm to ϕ14.7 mm ϕ14.7 mm to ϕ18 mm ≥0.457 0 0 0 0.381 to 0.457 0 0 2 0.305 to 0.381 0 5 8 0.229 to 0.305 1 9 23 0.152 to 0.229 3 35 35 ≤0.152 Sparsely scattered and can be ignored 表 2 样本中各类型瑕疵数量占比情况
Table 2 The proportion of each type of defect in the samples
Defect types Scotoma Bright spot Macula Speck Stripe Number 2692 369 435 172 481 Percentage 64.98% 8.89% 10.48% 4.15% 11.59% 表 3 不同机器视觉视场瑕疵检测方法的对比
Table 3 Comparison of different machine vision field of view defect detection methods
Detection algorithm Key technical features Advantages Limitation Literature reference Threshold segmentation-based algorithm Using a fixed threshold method Compared to manual detection, it improves the efficiency of field defect detection Prone to interference from external factors, requiring manual assistance in discrimination Reference [4] Employing a multi-region thresholding method Further enhancing the detection accuracy of field defects Prone to interference from external factors, requiring manual assistance in discrimination Reference [5] Manually adjusting the threshold based on the actual field conditions Designed two detection modes, 'full-screen' and 'half-screen', to meet different detection needs The detection speed of defects is relatively slow Reference [6] Edge-based segmentation algorithm Employed a simplified Robert edge operator Simpler and faster defect detection The detection performance is not satisfactory for complex and irregular field defects Reference [7] Utilized the Canny edge operator More accurate localization with the design of an automatic method for selecting specific detection areas, thereby improving defect detection speed There is a certain deviation in selecting the detection area, leading to the omission of defects along the edges of the region Reference [8] Based on signal-to-noise ratio (SNR) theory Utilizing spatiotemporal signal-to-noise ratio differences in the field defect regions High detection accuracy and not limited by the shape of defects Prone to interference from external factors, unable to determine the shape and size of field defects Reference [9] 表 4 人工检测与机器视觉检测的对比
Table 4 Comparison between manual detection and machine vision detection
Detection method Advantages Shortcomings Detection accuracy Detection speed Manual inspection The method is simple, with relatively good reliability, and flexible operation Low detection efficiency, with relatively high labor costs Relatively high Relatively low Machine vision inspection Fast detection efficiency and speed, with excellent detection results For the detection of complex defects, the performance is not satisfactory, and manual intervention in testing is required Moderate Moderate 表 5 基于深度学习的瑕疵检测的部分研究应用
Table 5 Some research applications of defect detection based on deep learning
Detection method Inspected object Experimental results Literature reference Convolutional neural network (CNN) Currency note image The defect recognition accuracy is 95.6% Reference[13] Cold-rolled steel plate The model achieves a defect detection accuracy of 93% Reference [14] Fabric Defect classification accuracy is over 95% Reference [15] Solar panel Defect detection accuracy is above 88.42% Reference [16] Fully convolutional network (FCN) Crack Addressing the issue of local information loss in detection Reference [17] Concrete The recognition accuracy of surface crack defects can reach 90% Reference [18] TFT-LCD Accurate positioning and recognition of conductive particles can be achieved Reference [19] Steel The classification accuracy of defects is above 91.6% Reference [20] Auto encoder (AE) Fabric The accuracy of defect detection is consistently above 98.75% Reference [21] Rail Achieved excellent defect detection results Reference [22] Steel The defect classification rate is improved by about 16% compared to traditional methods Reference [23] Residual network(ResNet) Corn leaf blade The accuracy of identifying diseases and pests can reach 98.5% Reference [24] Photovoltaic panel The accuracy of recognizing ash accumulation level is 90.7% Reference [25] Deep belief network(DBN) Wooden board Outperforms traditional CNN detection methods in performance Reference [26] Cable tunnel More accurate and versatile compared to existing algorithms Reference [27] Metal Low scratch omission rate, better detection performance Reference [28] Recurrent neural network(RNN) Mobile phone screen The average accuracy for samples with complex sizes and shapes is 90.36% Reference [29] -
[1] 石峰, 程宏昌, 闫磊, 等. 紫外探测技术[M]. 北京: 国防工业出版社, 2017. SHI Feng, CHENG Hongchang, YAN Lei, et al. Ultraviolet Detection Technology[M]. Beijing: National Defense Industry Press, 2017.
[2] 林祖伦, 王小菊. 光电成像导论[M]. 北京: 国防工业出版社, 2016. LIN Zulun, WANG Xiaoju. Introduction to Photoelectric Imaging[M]. Beijing: National Defense Industry Press, 2016.
[3] 汪贵华. 光电子器件[M]. 3版: 北京: 国防工业出版社, 2020. WANG Guihua. Optoelectronic Devices[M]. 3rd edition: Beijing: National Defense Industry Press, 2020.
[4] 许正光, 王霞, 王吉晖, 等. 像增强器视场缺陷检测方法研究[J]. 应用光学, 2005(3): 12-15. DOI: 10.3969/j.issn.1002-2082.2005.03.004 XU Zhengguang, WANG Xia, WANG Jihui, et al. Research of an approach to detect field defects of image intensifier[J]. Application Optics, 2005(3): 12-15. DOI: 10.3969/j.issn.1002-2082.2005.03.004
[5] 王吉晖, 金伟其, 王霞, 等. 基于数学形态学的像增强器缺陷的图像检测方法[J]. 光学技术, 2005(3): 463-464, 467. WANG Jihui, JIN Weiqi, WANG Xia, et al. Flaw inspection method for image tube based on image processing[J]. Optical Technology, 2005(3): 463-464, 467.
[6] 赵清波. 宽光谱像增强器辐射增益和视场缺陷测试技术研究[D]. 南京: 南京理工大学, 2008. ZHAO Qingbo. Research on Radiation Gain and Field Defect Test Technology of Wide Spectrum Image Intensifier[D]. Nanjing: Nanjing University of Science and Technology, 2008.
[7] FU Rongguo, WEI Yifang, YANG Qi, et al. The analysis of the defects of the view field of the UV image intensifier[C]//Sensors and Systems for Space Applications X of SPIE, 2017, 10196: 19-26.
[8] 杨琦. 紫外像增强器视场缺陷检测技术研究[D]. 南京: 南京理工大学, 2011. YANG Qi. Research on Defect Detection Technology of Ultraviolet Image Intensifier[D]. Nanjing: Nanjing University of Science and Technology, 2011.
[9] ZHOU B, LIU B, WU D. Research on testing field flaws of image intensifier based on spatio-temporal SNR[C]//5th International Symposium on Advanced Optical Manufacturing and Testing Technologies: Optoelectronic Materials and Devices for Detector, Imager, Display, and Energy Conversion Technology of SPIE, 2010, 7658: 691-695.
[10] 孙文政. 基于深度学习和机器视觉的手机屏幕瑕疵检测方法研究[D]. 济南: 山东大学, 2019. SUN Wenzheng. Research on Mobile Phone Screen Defect Detection Method Based on Deep Learning and Machine Vision[D]. Jinan: Shandong University, 2019.
[11] 汤勃, 孔建益, 伍世虔. 机器视觉表面缺陷检测综述[J]. 中国图象图形学报, 2017, 22(12): 1640-1663. TANG Bo, KONG Jianyi, WU Shiqian. Review of machine vision surface defect detection[J]. Chinese Journal of Image and Graphics, 2017, 22(12): 1640-1663.
[12] 张涛, 刘玉婷, 杨亚宁, 等. 基于机器视觉的表面缺陷检测研究综述[J]. 科学技术与工程, 2020, 20(35): 14366-14376. DOI: 10.3969/j.issn.1671-1815.2020.35.004 ZHANG Tao, LIU Yuting, YANG Yaning, et al. Review of surface defect detection based on machine vision[J]. Science, Technology and Engineering, 2020, 20(35): 14366-14376. DOI: 10.3969/j.issn.1671-1815.2020.35.004
[13] KE Wang, WANG Huiqin, YUE Shu, et al. Banknote image defect recognition method based on convolution neural network[J]. International Journal of Security and Its Applications, 2016, 10(6): 269-280. DOI: 10.14257/ijsia.2016.10.6.26
[14] 顾佳晨, 高雷, 刘路硌. 基于深度学习的目标检测算法在冷轧表面缺陷检测中的应用[J]. 冶金自动化, 2019, 43(6): 19-22. GU Jiachen, GAO Lei, LIU Luke. Application of object detection algorithm based on deep learning for inspection of surface defect of cold rolled strips[J]. Metallurgical Automation, 2019, 43(6): 19-22.
[15] 景军锋, 刘娆. 基于卷积神经网络的织物表面缺陷分类方法[J]. 测控技术, 2018, 37(9): 20-25. JING Junfeng, LIU Rao. Classification method of fabric surface defects based on convolution neural network[J]. Measurement and Control Technology, 2018, 37(9): 20-25.
[16] Deitsch S, Christlein V, Berger S, et al. Automatic classification of defective photovoltaic module cells in electroluminescence images[J]. Solar Energy, 2019, 185: 455-468. DOI: 10.1016/j.solener.2019.02.067
[17] 王森, 伍星, 张印辉, 等. 基于深度学习的全卷积网络图像裂纹检测[J]. 计算机辅助设计与图形学学报, 2018, 30(5): 859-867. WANG Sen, WU Xing, ZHANG Yinhui, et al. Image crack detection with fully convolutional network based on deep learning[J]. Journal of Computer Aided Design and Graphics, 2018, 30(5): 859-867.
[18] DUNG C V. Autonomous concrete crack detection using deep fully convolutional neural network[J]. Automation in Construction, 2019, 99: 52-58. DOI: 10.1016/j.autcon.2018.11.028
[19] LIU Y, YANG Y, WANG C, et al. Research on surface defect detection based on semantic segmentation[C]//Advanced Science and Industry Research Center Proceedings of 2019 International Conference on Artificial Intelligence, Control and Automation Engineering(AICAE 2019), 2019: 416-420.
[20] DONG Y, WANG J, WANG Z, et al. A deep-learning-based multiple defect detection method for tunnel lining damages[J]. IEEE Access, 2019, 7: 182643-182657. DOI: 10.1109/ACCESS.2019.2931074
[21] TIAN H, LI F. Autoencoder-based fabric defect detection with cross-patch similarity[C]//16th International Conference on Machine Vision Applications (MVA) of IEEE, 2019: 1-6.
[22] WEI Y H, NI Y Q. Variational autoencoder-based approach for rail defect identification[C]//12th International Workshop on Structural Health Monitoring: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT), 2019: 2818-2824.
[23] DI H, KE X, PENG Z, et al. Surface defect classification of steels with a new semi-supervised learning method[J]. Optics and Lasers in Engineering, 2019, 117: 40-48. DOI: 10.1016/j.optlaseng.2019.01.011
[24] 黄英来, 艾昕. 改进残差网络在玉米叶片病害图像的分类研究[J]. 计算机工程与应用, 2021, 57(23): 7. HUANG Yinglai, AI Xin. Research on classification of corn leaf disease image by improved residual network[J]. Computer Engineering and Application, 2021, 57(23): 7.
[25] 孙鹏翔, 毕利, 王俊杰. 基于改进深度残差网络的光伏板积灰程度识别[J]. 计算机应用, 2022, 42(12): 3733-3739. SUN Pengxiang, BI Li, WANG Junjie. Dust accumulation degree recognition of photovoltaic panel based on improved deep residual network[J]. Computer Application, 2022, 42(12): 3733-3739.
[26] 李馥颖, 杨大为, 黄海. 基于改进深度置信网络的木板表面缺陷检测模型[J]. 南京理工大学学报, 2022, 46(6): 728-734. LI Fuying, YANG Dawei, HUANG Hai. Improved deep belief network based detection model for wood surface defects[J]. Journal of Nanjing University of Science and Technology, 2022, 46(6): 728-734.
[27] 黄振宁, 赵永贵, 许志亮, 等. 基于判别式深度置信网络的智能电缆隧道缺陷检测技术研究[J]. 电子设计工程, 2022, 30(20): 103-107. HUANG Zhenning, ZHAO Yonggui, XU Zhiliang, et al. Fault detection technology for smart cable tunnel based on discriminant deep belief network[J]. Electronic Design Engineering, 2022, 30(20): 103-107.
[28] 李文俊, 陈斌, 李建明, 等. 基于深度神经网络的表面划痕识别方法[J]. 计算机应用, 2019, 39(7): 2103-2108. LI Wenjun, CHEN Bin, LI Jianming, et al. Surface scratch recognition method based on deep neural network[J]. Computer Application, 2019, 39(7): 2103-2108.
[29] LEI J, GAO X, FENG Z, et al. Scale insensitive and focus driven mobile screen defect detection in industry[J]. Neurocomputing, 2018, 294: 72-81. DOI: 10.1016/j.neucom.2018.03.013
-
期刊类型引用(2)
1. 肖文健,王彦斌,蒋成龙,周旋风,张德锋. 复杂场景下红外探测系统性能分析与建模. 红外技术. 2025(01): 29-35+43 . 本站查看
2. 徐振亚,付奎生,祁鸣,李丽娟. 一种用于发射后截获的红外导引头探测距离估算方法. 红外技术. 2020(11): 1095-1102 . 本站查看
其他类型引用(5)