基于改进SuperPoint-LightGlue的可见光红外图像匹配算法

A Visible Light Infrared Image Matching Algorithm Based on Improved SuperPoint-LightGlue

  • 摘要: 针对光伏电站巡检机器人的可见光和红外图像在光照、形变差异较大的图像匹配难度大、误匹配率高的问题,提出一种基于改进SuperPoint与LightGlue的可见光红外图像匹配算法。首先,对于原生SuperPoint特征点提取网络参数量较大且全局特征提取能力较弱的缺陷,采用自注意力机制的Conv2Former结构轻量化SuperPoint编码器,并获得较强的全局特征表达能力。其次,由于原生SuperPoint缺乏对输入数据保持空间不变的能力,因此在SuperPoint编码器交替插入STN模块,使改进SuperPoint具备空间不变性。最后,在特征匹配模块,利用LightGlue对改进SuperPoint提取的特征点进行匹配。实验结果表明,与现有的算法相比,该算法匹配效果更好,匹配效率更高,且对光照和形变具备较好的鲁棒性。

     

    Abstract: A visible light and infrared image-matching algorithm based on improved SuperPoint and LightGlue was proposed to address the difficulty and high mismatch rate of image matching in regions with significant lighting differences and deformation in photovoltaic power station inspection robots. First, owing to the shortcomings of the native SuperPoint feature point extraction network with a large number of parameters and weak global feature extraction ability, a lightweight SuperPoint encoder based on the Conv2Former structure with a self-attention mechanism was adopted, and a strong global feature expression ability was obtained. Second, owing to the inability of native SuperPoint to maintain the spatial invariance of input data, STN modules were alternately inserted into the SuperPoint encoder to provide spatial invariance for the improved SuperPoint. Finally, in the feature-matching module, LightGlue was used to match the feature points extracted by the improved SuperPoint. Experimental results show that, compared with existing algorithms, the proposed algorithm achieves better matching performance, higher matching efficiency, and stronger robustness to lighting variations and deformation.

     

/

返回文章
返回