Infrared Image Mosaic Method for Improving the Best Seam-line
-
摘要: 变电站场景的红外图像受噪声干扰大、纹理信息不明显,拼接过程中易出现拼接痕迹或重影现象。针对上述问题,本文提出一种改进最佳缝合线的红外图像拼接方法。该方法首先采用SIFT算法提取图像区域特征,实现图像配准;然后在两幅图像的重合区域上引入局部权重系数,并对图像颜色差异强度进行形态学操作,减少红外图像的噪声干扰,以此改善能量函数图的纹理信息。最后,利用动态规划改进缝合线搜索准则,在图像重叠区域搜索出最佳缝合线。实验结果表明,与渐入渐出法和最佳缝合线法比较,本文方法在拼接后图像的平均梯度、图像清晰度和图像边缘强度均有所提高,融合区域过渡更平滑自然,拼接痕迹明显减少。Abstract: The infrared image of a substation is significantly disturbed by noise and the texture information is unclear. Therefore, stitching traces or the ghosting phenomenon may appear in the process of stitching. To overcome these challenges, this study proposes an infrared image splicing method that improves the best seam-line. First, this method uses the SIFT algorithm to extract the image area features to achieve image registration, then introduces local weight coefficients in the overlapping area of the two images. Subsequently, morphological operations are performed on the intensity of the image color difference, which reduces the noise interference of the infrared image and improves the texture information of the energy function graph. Finally, dynamic programming is used to improve the seam-line search criteria and search for the best seam-line in the image overlapping area. The experimental results show that compared with the gradual fusion method and the best seam-line method, the average gradient, image clarity and image edge strength of the stitched image are improved, the transition of the fusion region is smoother and more natural, and the stitching trace is significantly reduced.
-
Key words:
- best seam-line /
- image mosaic /
- infrared image /
- energy function
-
表 1 拼接效果性能评价指标
Table 1. Performance evaluation of image fusion algorithms
Experiment Algorithm AG FD EI Insulator image Fade in and fade out algorithm 7.0990 9.5881 70.8824 Image stitching based on ORB algorithm 6.6598 8.4017 68.6762 Fast Panorama Stitching method based on color correction 7.0382 9.4342 70.6413 The traditional best seam-line method 7.1702 9.6849 71.4189 The improved best seam-line method 7.1971 9.7345 71.6704 The transformer image Fade in and fade out algorithm 5.9331 6.8986 63.6720 Image stitching based on ORB algorithm 5.0789 5.7405 61.6745 Fast Panorama Stitching method based on color correction 5.3790 6.3366 65.7563 The traditional best seam-line method 6.0560 7.0687 64.8862 The improved best seam-line method 6.1768 7.2439 66.0150 -
[1] WANG B. Automatic fault diagnosis of infrared insulator images based on image instance segmentation and temperature analysis[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(8): 5345-5355. doi: 10.1109/TIM.2020.2965635 [2] 宋振坤, 徐超, 王霞, 等. 应用于无人机平台的红外图像拼接技术研究[J]. 红外技术, 2018, 40(4): 355-361. http://hwjs.nvir.cn/article/id/hwjs201804009SONG Zhenkun, XU Chao, WANG Xia, et al. Study of infrared image mosaic technology applied to a UAV platform[J]. Infrared Technology, 2018, 40(4): 355-361. http://hwjs.nvir.cn/article/id/hwjs201804009 [3] 代少升, 姚俐. 基于ROI的高精度红外全景拼接算法研究[J]. 半导体光电, 2020, 41(4): 572-577. https://www.cnki.com.cn/Article/CJFDTOTAL-BDTG202004023.htmDAI Shaosheng, YAO Li. Research on the method of infrared panoramic image mosaic based on ROI[J]. Semiconductor Optoelectronics, 2020, 41(4): 572-577. https://www.cnki.com.cn/Article/CJFDTOTAL-BDTG202004023.htm [4] 秦绪佳, 王琪, 王慧玲, 等. 基于最佳缝合线的序列遥感图像拼接融合方法[J]. 计算机科学, 2015, 42(10): 306-310. https://www.cnki.com.cn/Article/CJFDTOTAL-JSJA201510063.htmQIN Xujia, WANG Qi, WANG Huiling, et al. Image fusion method based on best seam-line for serial remote sensing images mosaic[J]. Computer Science, 2015, 42(10): 306-310. https://www.cnki.com.cn/Article/CJFDTOTAL-JSJA201510063.htm [5] 张翔, 王伟, 肖迪. 基于改进最佳缝合线的图像拼接方法[J]. 计算机工程与设计, 2018, 39(7): 1964-1970. https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201807028.htmZHANG Xiang, WANG Wei, XIAO Di. Image mosaic method based on improved best seam-line[J]. Computer Engineering and Design, 2018, 39(7): 1964-1970. https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201807028.htm [6] Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. doi: 10.1023/B:VISI.0000029664.99615.94 [7] 谷雨, 周阳, 任刚, 等. 结合最佳缝合线和多分辨率融合的图像拼接[J]. 中国图象图形学报, 2017, 22(6): 842-851. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGTB201706014.htmGU Yu, ZHOU Yang, REN Gang, et al. Image stitching by combining optimal seam and multi-resolution fusion[J]. Journal of Image and Graphics, 2017, 22(6): 842-851. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGTB201706014.htm [8] XIONG Yingen, Kari Pulli. Fast panorama stitching for high-quality panoramic images on mobile phones[J]. IEEE Transactions on Consumer Electronics, 2010, 56(2): 298-306. [9] 谢颖贤, 武迎春, 王玉梅, 等. 基于小波域清晰度评价的光场全聚焦图像融合[J]. 北京航空航天大学学报, 2019, 45(9): 1848-1854. https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK201909018.htmXIE Yinxian, WU Yingchun, WANG Yumei, et al. Light field all-in-focus image fusion based on wavelet domain sharpness evaluation[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(9): 1848-1854. https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK201909018.htm