基于斑块解耦-自协同对齐的可见光-红外行人重识别

Visible-Infrared Person Re-Identification Algorithm Based on Plaque-Decoupling and Self-Collaborative Alignment

  • 摘要: 光谱差异和异质性干扰引入的模态纠缠降低了跨模态行人重识别的准确性。为了抑制模态纠缠所引起的判别特征模糊与异质性干扰,提出了一种斑块解耦-自协同对齐模型(Plaque-Decoupling Self-Collaborative Alignment, PD-SCA),由斑块解耦模块和自协同对齐模块组成。为了挖掘类内特征的判别信息,斑块解耦模块在通道维度分解跨模态特征并提取斑块特征,削弱了可见光和红外图像的成像模态纠缠。自协同对齐模块包括多样性解耦约束和对齐约束,可以过滤光照等因素引起的异常特征,消除类间差异,其中多样性解耦约束可以学习多样化解耦特征,对齐约束利用解耦信息进行对齐匹配。在SYSU-MM01数据集上的实验结果证明了该方法的有效性。

     

    Abstract: Modality entanglement introduced by spectral differences and heterogeneity interference reduces the accuracy of cross-modality person re-identification. To suppress the degradation of discrimination characteristics and heterogeneity interference caused by modality entanglement, a Plaque-Decoupling Self-Collaborative Alignment model is proposed, which consists of a plaque-decoupling and self-collaborative alignment modules. To mine the intra-class feature discrimination information, the plaque-decoupling module decomposes the cross-modality features in the channel dimension and extracts patch features, which can suppress the imaging modality entanglement of the visible and infrared images. The self-collaborative alignment module includes diversity decoupling and alignment constraints that can filter abnormal features caused by lighting factors and eliminate inter-class differences. The diversity-decoupling constraints learn the diversity-decoupling features, and the decoupled information is used by the alignment constraints to match the features. Experimental results on the SYSU-MM01 dataset demonstrate the effectiveness of the method.

     

/

返回文章
返回