基于小波池化三分支网络的红外图像实时语义分割算法

Real-time Semantic Segmentation Algorithm for Infrared Images Based on Wavelet Pooling Tri-branch Network

  • 摘要: 在红外成像制导的军事应用中,如何快速、准确地分割红外图像中的目标对提高制导精度具有重要意义。针对基于深度学习实时语义分割算法在下采样过程中容易丢失目标的关键信息的问题,本文提出了一种基于小波池化三分支网络WPTNet的红外图像实时语义分割算法。首先,设计Haar小波池化模块在降低特征图分辨率的同时减少下采样过程的信息丢失。该模块先通过二维Haar小波变换将输入特征图分解为一个低频分量和水平、垂直、对角3个高频分量,并将4个分量沿通道方向堆叠以形成一个新的特征图,然后通过卷积、批归一化、激活等处理对小波域特征进行增强。其次,将Haar小波池化模块引入到分别提取空间、语义和边界信息的三分支网络中,构造基于小波池化三分支网络的红外图像实时语义分割算法。在自制的红外干扰飞机数据集上的实验结果表明,提出算法的精度指标MIoU和mPA分别达到90.49%和94.47%,优于PIDNet等实时语义分割算法。在参数量和计算量方面,提出的算法相比PIDNet分别下降了7.6%和4.4%,能够满足红外图像的实时分割需求。

     

    Abstract: In military applications of infrared imaging guidance, the ability to segment targets quickly and accurately in infrared images is of great significance for improving guidance precision. However, a deep learning-based real-time semantic segmentation algorithm can easily lose key information about the target during downsampling. To address this problem, this study developed a real-time semantic segmentation algorithm for infrared images based on a wavelet pooling tri-branch network. First, a Haar wavelet pooling module was designed to reduce the feature-map resolution and information loss during the downsampling process. This module first used a 2D Haar wavelet transform to decompose the input feature map into one low-frequency component and three high-frequency components (horizontal, vertical, and diagonal). These four components were then stacked along the channel dimensions to form a new feature map. Subsequently, the wavelet-domain features were enhanced through operations such as convolution, batch normalization, and activation. Second, the Haar wavelet pooling module was incorporated into a tribranch network designed to extract spatial, semantic, and boundary information. Thus, a real-time semantic segmentation algorithm for infrared images was constructed based on a wavelet-pooling tri-branch network. In an experiment using a self-made infrared interference aircraft dataset, the MIoU and MPA accuracy metrics had values of 90.49% and 94.47%, respectively, which were superior to those of real-time semantic segmentation algorithms such as PIDNet. The proposed algorithm reduced the parameter count and computational cost by 7.6% and 4.4%, respectively, compared to PIDNet, making it capable of meeting the real-time infrared-image-segmentation requirements.

     

/

返回文章
返回