改进最佳缝合线的红外图像拼接方法

卢泉; 杨振华; 黄粒峰

改进最佳缝合线的红外图像拼接方法

广西大学电气工程学院, 广西南宁 530004

基金项目:

国家自然科学基金资助项目 61863002

详细信息

作者简介:
卢泉（1982-），男，副教授，博士，主要研究方向：智能电力检测技术。E-mail：luquan@gxu.edu.cn

中图分类号: TP391
计量
- 文章访问数: 160
- HTML全文浏览量: 31
- PDF下载量: 34
- 被引次数: 0
出版历程
- 收稿日期: 2020-12-11
- 修回日期: 2021-03-22
- 刊出日期: 2022-06-20

Infrared Image Mosaic Method for Improving the Best Seam-line

School of Electrical Engineering, Guangxi University, Nanning 530004, China

摘要

摘要: 变电站场景的红外图像受噪声干扰大、纹理信息不明显，拼接过程中易出现拼接痕迹或重影现象。针对上述问题，本文提出一种改进最佳缝合线的红外图像拼接方法。该方法首先采用SIFT算法提取图像区域特征，实现图像配准；然后在两幅图像的重合区域上引入局部权重系数，并对图像颜色差异强度进行形态学操作，减少红外图像的噪声干扰，以此改善能量函数图的纹理信息。最后，利用动态规划改进缝合线搜索准则，在图像重叠区域搜索出最佳缝合线。实验结果表明，与渐入渐出法和最佳缝合线法比较，本文方法在拼接后图像的平均梯度、图像清晰度和图像边缘强度均有所提高，融合区域过渡更平滑自然，拼接痕迹明显减少。
- 最佳缝合线 /
- 图像拼接 /
- 红外图像 /
- 能量函数
Abstract: The infrared image of a substation is significantly disturbed by noise and the texture information is unclear. Therefore, stitching traces or the ghosting phenomenon may appear in the process of stitching. To overcome these challenges, this study proposes an infrared image splicing method that improves the best seam-line. First, this method uses the SIFT algorithm to extract the image area features to achieve image registration, then introduces local weight coefficients in the overlapping area of the two images. Subsequently, morphological operations are performed on the intensity of the image color difference, which reduces the noise interference of the infrared image and improves the texture information of the energy function graph. Finally, dynamic programming is used to improve the seam-line search criteria and search for the best seam-line in the image overlapping area. The experimental results show that compared with the gradual fusion method and the best seam-line method, the average gradient, image clarity and image edge strength of the stitched image are improved, the transition of the fusion region is smoother and more natural, and the stitching trace is significantly reduced.
- best seam-line /
- image mosaic /
- infrared image /
- energy function

HTML全文

图 1 能量函数图

Figure 1. Energy function diagram

下载: 全尺寸图片幻灯片

图 2 基于动态规划搜索准则的改进搜索流程图

Figure 2. Improved search flow chart is based on dynamic programming search criteria

下载: 全尺寸图片幻灯片

图 3 改进最佳缝合线的红外图像拼接方法流程

Figure 3. Improved infrared image Mosaic algorithm flow of the best seam-line

下载: 全尺寸图片幻灯片

图 4 绝缘子图像

Figure 4. Two insulator images

下载: 全尺寸图片幻灯片

图 5 绝缘子图像的能量函数图

Figure 5. Energy function diagram of insulator image

下载: 全尺寸图片幻灯片

图 6 绝缘子图像拼接效果

Figure 6. Insulator image stitching effect

下载: 全尺寸图片幻灯片

图 7 变压器图像

Figure 7. Transformer image

下载: 全尺寸图片幻灯片

图 8 变压器图像的能量函数图

Figure 8. Energy function diagrams of the transformer images

下载: 全尺寸图片幻灯片

图 9 变压器图像拼接效果

Figure 9. Transformer image stitching effect

下载: 全尺寸图片幻灯片

表 1 拼接效果性能评价指标

Table 1. Performance evaluation of image fusion algorithms

Experiment	Algorithm	A_G	F_D	E_I
Insulator image	Fade in and fade out algorithm	7.0990	9.5881	70.8824
	Image stitching based on ORB algorithm	6.6598	8.4017	68.6762
	Fast Panorama Stitching method based on color correction	7.0382	9.4342	70.6413
	The traditional best seam-line method	7.1702	9.6849	71.4189
	The improved best seam-line method	7.1971	9.7345	71.6704
The transformer image	Fade in and fade out algorithm	5.9331	6.8986	63.6720
	Image stitching based on ORB algorithm	5.0789	5.7405	61.6745
	Fast Panorama Stitching method based on color correction	5.3790	6.3366	65.7563
	The traditional best seam-line method	6.0560	7.0687	64.8862
	The improved best seam-line method	6.1768	7.2439	66.0150

下载: 导出CSV

参考文献(9)

[1]	WANG B. Automatic fault diagnosis of infrared insulator images based on image instance segmentation and temperature analysis[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(8): 5345-5355. doi: 10.1109/TIM.2020.2965635
[2]	宋振坤, 徐超, 王霞, 等. 应用于无人机平台的红外图像拼接技术研究[J]. 红外技术, 2018, 40(4): 355-361. http://hwjs.nvir.cn/article/id/hwjs201804009 SONG Zhenkun, XU Chao, WANG Xia, et al. Study of infrared image mosaic technology applied to a UAV platform[J]. Infrared Technology, 2018, 40(4): 355-361. http://hwjs.nvir.cn/article/id/hwjs201804009
[3]	代少升, 姚俐. 基于ROI的高精度红外全景拼接算法研究[J]. 半导体光电, 2020, 41(4): 572-577. https://www.cnki.com.cn/Article/CJFDTOTAL-BDTG202004023.htm DAI Shaosheng, YAO Li. Research on the method of infrared panoramic image mosaic based on ROI[J]. Semiconductor Optoelectronics, 2020, 41(4): 572-577. https://www.cnki.com.cn/Article/CJFDTOTAL-BDTG202004023.htm
[4]	秦绪佳, 王琪, 王慧玲, 等. 基于最佳缝合线的序列遥感图像拼接融合方法[J]. 计算机科学, 2015, 42(10): 306-310. https://www.cnki.com.cn/Article/CJFDTOTAL-JSJA201510063.htm QIN Xujia, WANG Qi, WANG Huiling, et al. Image fusion method based on best seam-line for serial remote sensing images mosaic[J]. Computer Science, 2015, 42(10): 306-310. https://www.cnki.com.cn/Article/CJFDTOTAL-JSJA201510063.htm
[5]	张翔, 王伟, 肖迪. 基于改进最佳缝合线的图像拼接方法[J]. 计算机工程与设计, 2018, 39(7): 1964-1970. https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201807028.htm ZHANG Xiang, WANG Wei, XIAO Di. Image mosaic method based on improved best seam-line[J]. Computer Engineering and Design, 2018, 39(7): 1964-1970. https://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ201807028.htm
[6]	Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. doi: 10.1023/B:VISI.0000029664.99615.94
[7]	谷雨, 周阳, 任刚, 等. 结合最佳缝合线和多分辨率融合的图像拼接[J]. 中国图象图形学报, 2017, 22(6): 842-851. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGTB201706014.htm GU Yu, ZHOU Yang, REN Gang, et al. Image stitching by combining optimal seam and multi-resolution fusion[J]. Journal of Image and Graphics, 2017, 22(6): 842-851. https://www.cnki.com.cn/Article/CJFDTOTAL-ZGTB201706014.htm
[8]	XIONG Yingen, Kari Pulli. Fast panorama stitching for high-quality panoramic images on mobile phones[J]. IEEE Transactions on Consumer Electronics, 2010, 56(2): 298-306.
[9]	谢颖贤, 武迎春, 王玉梅, 等. 基于小波域清晰度评价的光场全聚焦图像融合[J]. 北京航空航天大学学报, 2019, 45(9): 1848-1854. https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK201909018.htm XIE Yinxian, WU Yingchun, WANG Yumei, et al. Light field all-in-focus image fusion based on wavelet domain sharpness evaluation[J]. Journal of Beijing University of Aeronautics and Astronautics, 2019, 45(9): 1848-1854. https://www.cnki.com.cn/Article/CJFDTOTAL-BJHK201909018.htm