| Citation: |
HU Junwei, WANG Shiwei, YANG Moyuan. Sparse Depth Feature Infrared Image Stitching Algorithm[J]. Infrared Technology , 2025, 47(5): 584-590.
|
To solve the problems of limited infrared features and poor feature matching in the process of infrared image stitching, this paper proposes an algorithm called sparse depth feature infrared image stitching (SDFS). The algorithm first extracts a dense depth feature map using a convolutional neural network, then calculates and describes sparse feature points from the feature map to enhance the quality of feature point extraction. Next, the K-nearest neighbor search method is used to perform coarse matching of sparse feature points, followed by the application of a dynamic distance ratio strategy to refine the matching results and improve matching accuracy. Finally, based on the matching results, a homography matrix is calculated for image projection transformation, and adaptive factor-weighted fusion is used to achieve seamless fusion and splicing of the image. Experimental results show that the algorithm exhibits high robustness and can effectively adapt to infrared image stitching in different scenes. The stitching accuracy and display effect outperform commonly used stitching algorithms based on SIFT or SURF feature extraction.
| [1] |
李相迪, 黄英, 张培晴, 等. 红外成像系统及其应用[J]. 激光与红外, 2014, 44(3): 229-234.
LI Xiangdi, HUANG Ying, ZHANG Peiqing, et al. Infrared imaging system and applications[J]. Infrared Technology, 2014, 44(3): 229-234.
|
| [2] |
王向军, 张嘉豪, 王越. 基于位姿数据校正的遥感红外图像相似性先验拼接[J]. 红外技术, 2019, 41(12): 1091-1099. http://hwjs.nvir.cn/article/id/hwjs201912001
WANG Xiangjun, ZHANG Jiahao, WANG Yue. Image stitching of remote sensing infrared images with similarity prior based on correction of pose data [J]. Infrared Technology, 2019, 41(12): 1091-1099. http://hwjs.nvir.cn/article/id/hwjs201912001
|
| [3] |
周登科, 郭星辰, 史凯特, 等. 风电场无人机巡检红外叶片图像拼接算法[J]. 红外技术, 2023, 45(11): 1161-1168. http://hwjs.nvir.cn/article/id/d993d1a1-2555-46b6-a75b-8f0c155cc9fb
ZHOU Dengke, GUO Xingchen, SHI Kaite, et al. Infrared blade image stitching algorithm for unmanned aerial vehicle inspection in wind farms[J]. Infrared Technology, 2023, 45(11): 1161-1168. http://hwjs.nvir.cn/article/id/d993d1a1-2555-46b6-a75b-8f0c155cc9fb
|
| [4] |
Lowe D G. Distinctive Image features from scale-invariant key points[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. DOI: 10.1023/B:VISI.0000029664.99615.94
|
| [5] |
卢泉, 杨振华, 黄粒峰. 改进最佳缝合线的红外图像拼接方法[J]. 红外技术, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b
LU Quan, YANG Zhenhua, HUANG Lifeng. Improved infrared image stitching method for optimal suture [J]. Infrared Technology, 2022, 44(6): 580-586. http://hwjs.nvir.cn/article/id/ff102dc9-5b92-41f9-8a8f-813d8d5f0c8b
|
| [6] |
王昕平, 张森林, 刘妹琴, 等. 基于多尺度图像融合和SIFT特征的水下图像拼接研究[J]. 计算机应用与软件, 2021, 38(5): 213-217, 230. DOI: 10.3969/j.issn.1000-386x.2021.05.034
WANG Xinping, ZHANG Senlin, LIU Meiqin, et al. Research on underwater image stitching based on multi-scale image fusion and SIFT features[J]. Computer Applications and Software, 2021, 38(5): 213-217, 230. DOI: 10.3969/j.issn.1000-386x.2021.05.034
|
| [7] |
Rosten E, Porter R, Drummond T. Faster and better: a machine learning approach to corner detection[J]. IEEE Trans Pattern Anal Mach Intell, 2008, 32(1): 105-119.
|
| [8] |
邓秋菊, 王宁, 陆阳. 基于全局和局部特征的红外图像快速拼接研究[J]. 激光杂志, 2023, 44(10): 84-88.
DENG Qiuju, WANG Ning, LU Yang. Research on fast infrared image stitching based on global and local features[J]. Laser Journal, 2023, 44(10): 84-88
|
| [9] |
Rublee E, Rabaud V, Konolige K, et al. ORB: An efficient alternative to SIFT or SURF[C]//ICCV, 2011, 11(1): 2564-2571.
|
| [10] |
彭畅, 李广泽, 张晓阳, 等. 基于改进的ORB算法的红外遥感图像拼接研究[J]. 控制工程, 2020, 27(8): 1332-1336.
PENG Chang, LI Guangze, ZHANG Xiaoyang, et al. Research on infrared remote sensing image stitching based on improved ORB algorithm [J]. Control Engineering, 2020, 27(8): 1332-1336
|
| [11] |
Bay H, Tuytelaars T, Gool L V. SURF: speeded up robust features[C]//European Conference on Computer Vision, 2006: 404-417.
|
| [12] |
车畅, 兰文宝. Canny算法和中值滤波法的红外全景图像拼接[J]. 激光杂志, 2020, 41(5): 109-113.
CHE Chang, LAN Wenbao. Canny algorithm and median filtering method for infrared panoramic image stitching [J]. Laser Journal, 2020, 41(5): 109-113
|
| [13] |
蒋敏, 蒋品群, 宋树祥, 等. 基于点线配准和超像素分割的图像拼接算法[J]. 计算机应用与软件, 2023, 40(10): 250-254, 267.
JIANG Min, JIANG Pinqun, SONG Shuxiang, et al. Image stitching algorithm based on point line registration and superpixel segmentation[J]. Computer Applications and Software, 2023, 40(10): 250-254, 267.
|
| [14] |
杨利春, 田彬, 党建武. 基于深度学习的图像拼接算法研究综述[J]. 计算机应用研究, 2024, 41(7): 1-11.
YANG Lichun, TIAN Bin, DANG Jianwu. A review of image stitching algorithms based on deep learning [J]. Computer Application Research, 2024: 1-11.
|
| [15] |
YAN Ni, MEI Yupeng, XU Ling, et al. Deep learning on image stitching with multi-viewpoint images: a survey[J]. Neural Processing Letters, 2023, 55(4): 3863-3898.
|
| [16] |
LE Hoang, LIU Feng, ZHANG Shu, et al. Deep homography estimation for dynamic scenes[C]// Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2020, 7649-7658.
|
| [17] |
郭璠, 李小虎, 刘文韬, 等. 基于参数回归的快速全景图像拼接算法[J]. 通信学报, 2023, 44(9): 36-47.
GUO Fan, LI Xiaohu, LIU Wentao, et al. A fast panoramic image stitching algorithm based on parameter regression [J]. Journal of Communications, 2023, 44(9): 36-47.
|
| [18] |
HONG Mingbo, LU Yuhang, YE Nianjin, et al. Unsupervised homography estimation with coplanarity-aware gan[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2022: 17642-17651.
|
| [19] |
ZHOU Hongfei, ZHU Yuhe, LV Xiaoqian, et al. Rectangular-output image stitching[C]//2023 IEEE International Conference on Image Processing (ICIP), 2023: 2800-2804.
|
| [20] |
蓝朝桢, 卢万杰, 于君明, 等. 异源遥感影像特征匹配的深度学习算法[J]. 测绘学报, 2021, 50(2): 189-202.
LAN Chaozhen, LU Wanjie, YU Junming, et al. Deep learning algorithm for feature matching of heterogeneous remote sensing images[J]. Journal of Surveying and Mapping, 2021, 50(2): 189-202
|
| [21] |
Dusmanu M, Rocco I, Pajdla T, et al. D2-Net: a trainable CNN for joint detection and description of local features[J]. CoRR, 2019, abs/1905.03561.
|
| [22] |
Cover Thomas M, Peter E. Hart. Nearest neighbor pattern classification[J]. IEEE Trans. Inf. Theory, 1967(13): 21-27。
|
| [23] |
LI Feifei, JIA Deng, KAI Li. ImageNet: constructing a large-scale image database[J]. Journal of Vision, 2010, 9(8): 1037-1037.
|
| [24] |
Christopher W, Omar A, N D B, et al. Megadepth: efficient coverage quantification for BigWigs and BAMs[J]. Bioinformatics, 2021, 37(18): 3014-3016.
|
| [25] |
Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM, 1981, 24(6): 381-395.
|
| [1] | LI Ziqian, BAN Yanwameng, LIU Yun, HE Dong, DU Rucai. Visible and Infrared Image Matching Method Based on Multi-Scale Feature Point Extraction[J]. Infrared Technology , 2025, 47(3): 351-357. |
| [2] | WU Lang, YI Shi, CHEN Mengting, LI Li. Heterogeneous Image Registration Algorithm Based on Fusion PC-ORB[J]. Infrared Technology , 2024, 46(4): 419-426. |
| [3] | ZHANG Hao, LI Na, WANG Lu. Fast Multi-sensor Image Matching Algorithm Based on a Multi-scale Dense Structure Feature[J]. Infrared Technology , 2020, 42(5): 420-425. |
| [4] | XI Shaoli, LI Wei, XIE Junfeng, MO Fan. Feature Point Matching Between Infrared Image and Visible Light Image Based on SIFT and ORB Operators[J]. Infrared Technology , 2020, 42(2): 168-175. |
| [5] | WANG Yibo, LIU Yunmeng. Image Stitching Based on a Microcamera Array Imaging System[J]. Infrared Technology , 2019, 41(4): 317-322. |
| [6] | A Method of Object Tracking Based on Feature Point Matching[J]. Infrared Technology , 2016, 38(7): 597-601. |
| [7] | LIU Huan, GU Xiaojing, GU Xingsheng. Thermal Image Stitching Based on Robust Feature Matching[J]. Infrared Technology , 2016, 38(1): 10-20. |
| [8] | HU Dou-ming, ZHAO Hai-sheng, LI Yun-chuan, CHEN Ying-yan, PAN Chao, LIU Ji-yong. A New Approach to Infrared Image Adaptive Matching Enhancement Based on Characteristics Classification[J]. Infrared Technology , 2014, (3): 205-209. |
| [9] | CHEN Gang, TANG Biao, ZUO Zhen-rong. Multiple Subimage Matching Algorithm Based on Correlation Plane Feature[J]. Infrared Technology , 2012, 34(4): 229-236,242. DOI: 10.3969/j.issn.1001-8891.2012.04.010 |
| [10] | YAO Wei, HU Mao-hai, QIN Xuan, ZHAO Qin-jun. Improved Image Mosaic Algorithm Based on Feature Point Matching[J]. Infrared Technology , 2010, 32(5): 288-290. DOI: 10.3969/j.issn.1001-8891.2010.05.009 |
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: