正则化约束下的自集成网络模型及其高光谱地物识别研究

Self-Ensembling Network Model and Its Hyperspectral Object Recognition Under Regularization Constraint

  • 摘要: 为了提升高光谱地物识别的精度,提出了一种基于自集成网络(Self-Ensembling Network)的高光谱图像地物识别模型。通过引入正则项约束优化自集成网络,该模型提升了地物识别模型的泛化性能,并构建自集成学习机制,解决有限标记样本下的模型欠拟合问题,降低高光谱图像识别模型的训练对大量标注样本的依赖。该模型包括一个学生网络和一个教师网络,在网络中加入了带梯度算子的密集连接模块,增强网络对边缘和细粒度特征的感知能力,提升高光谱图像的特征提取性能。在监督损失和无监督损失的共同约束下,学生网络和教师网络互相学习,从而建立了模型的自集成机制,保证了模型的分类精度。为了进一步提升模型的泛化性能,模型优化时引入了L2正则化项,用于约束目标函数的训练和优化,从而克服模型的过拟合问题。将所提方法应用于Pavia University、Salinas和WHU-Hi-LongKou三个高光谱数据集,平均分类精度分别为96.91%、96.73%和98.12%,与多种分类算法进行对比,验证了所提方法在有限标记样本下具有更好的分类精度。

     

    Abstract: To enhance the accuracy of hyperspectral object recognition, a hyperspectral image object recognition model based on the self-ensembling network is proposed. By introducing a regularization term to optimize the self-ensemble network, this model improves the generalization performance of the object recognition model and builds a self-ensemble learning mechanism to address the underfitting problem under limited labeled samples, reducing the dependence of the hyperspectral image recognition model training on a large number of labeled samples. The model consists of a student network and a teacher network, with a dense connection module with gradient operators added to the network to enhance the network's perception of edge and fine-grained features and improve the feature extraction performance of hyperspectral images. Under the joint constraints of supervised and unsupervised losses, the student network and the teacher network learn from each other, thereby establishing the model's self-ensemble mechanism and ensuring the model's classification accuracy. To further enhance the model's generalization performance, an L2 regularization term is introduced during model optimization to constrain the training and optimization of the objective function, thereby overcoming the overfitting problem of the model. The proposed method is applied to three hyperspectral datasets, Pavia University, Salinas, and WHU-Hi-LongKou, with average classification accuracies of 96.91%, 96.73%, and 98.12%, respectively. Compared with multiple classification algorithms, it is verified that the proposed method has better classification accuracy under limited labeled samples.

     

/

返回文章
返回