留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于全卷积网络的红外弱小目标检测算法

杨其利 周炳红 郑伟 李明涛

杨其利, 周炳红, 郑伟, 李明涛. 基于全卷积网络的红外弱小目标检测算法[J]. 红外技术, 2021, 43(4): 349-356.
引用本文: 杨其利, 周炳红, 郑伟, 李明涛. 基于全卷积网络的红外弱小目标检测算法[J]. 红外技术, 2021, 43(4): 349-356.
YANG Qili, ZHOU Binghong, ZHENG Wei, LI Mingtao. Small Infrared Target Detection Based on Fully Convolutional Network[J]. Infrared Technology , 2021, 43(4): 349-356.
Citation: YANG Qili, ZHOU Binghong, ZHENG Wei, LI Mingtao. Small Infrared Target Detection Based on Fully Convolutional Network[J]. Infrared Technology , 2021, 43(4): 349-356.

基于全卷积网络的红外弱小目标检测算法

基金项目: 

北京市重大科技专项 Z181100002918004

详细信息
    作者简介:

    杨其利(1992-),男,硕士研究生,从事深度学习/弱小目标检测方面的研究。E-mail:yangqili17@mails.ucas.ac.cn

    通讯作者:

    周炳红(1976-),男,研究员,博士生导师,从事飞行器设计/小天体探测与防御研究。E-mail:bhzhou@nssc.ac.cn

  • 中图分类号: TP391.4

Small Infrared Target Detection Based on Fully Convolutional Network

  • 摘要: 在小天体探测、导弹制导和战场侦察等航空航天领域,由于目标信号较弱,占有像素数少,缺少目标形状和纹理信息,使用手工特征提取的传统算法容易出现大量虚警,而拥有强大特征提取能力的深度学习算法无法对微小且缺乏轮廓信息的目标训练。本文采用了滑动窗口取样训练,它源自基于人类视觉特性的传统目标检测算法中嵌套结构的思想,设计了一种使用递归卷积层的全卷积网络,在不增加额外训练参数的情况下,扩展了模型的网络深度,该网络的并行卷积结构的多个分支网络模拟了传统算法的多尺度操作,有利于在复杂环境中增强目标和背景之间的对比度,并且设计使用了多种损失函数的组合,以对抗正负样本严重不平衡的问题。实验结果表明:该方法实现了比传统方法更好的检测效果,为此领域的研究者们提供了一个新的思路和解决途径。
  • 图  1  滑动窗口为3,滑动步长为2的取样窗口示意图

    Figure  1.  The illustration of sampling window with size 3 and sliding step with 2

    图  2  普通网络(左)和残差块网络[10](右)

    Figure  2.  Left: general network, Right: residual network[10]

    图  3  递归模块的展开结构,相同卷积参数应用不同递归层

    Figure  3.  Unfolding recursive module, the same filter W is applied to feature maps recursively

    图  4  F-CNN网络结构图

    Figure  4.  An illustration of the F-CNN architecture

    图  5  弱小目标仿真数据集

    Figure  5.  Simulated dataset of infrared small targets

    图  6  不同检测方法在5张测试图像上的滤波结果,矩形框表示目标,圆圈表示滤波后的噪声

    Figure  6.  The representative results of different methods on five test images, the rectangles denote the targets and the circles are representative examples of noise

    图  7  不同检测方法在红外图像上的滤波结果,矩形框表示目标,圆圈表示滤波后的噪声

    Figure  7.  Different methods on infrared images, the rectangles denote the targets and the circles are representative examples of noise

    表  1  本文使用的F-CNN网络结构

    Table  1.   F-CNN architecture for semantic segmentation

    Layers Output size Layer configurations
    Feature extraction 48×48 $\begin{gathered} \left[ {\begin{array}{*{20}{c}} {3 \times 3, 32} \\ {3 \times 3, 16} \end{array}} \right] \times 2 \\ \left[ {3 \times 3, 32} \right] \times 1 \\ \end{gathered} $
    Recursive block 48×48 $\left[ {3 \times 3, 32} \right] \times 4$
    Reconstruction module 48×48 $\left[ {\begin{array}{*{20}{c}} {3 \times 3, 32} \\ {3 \times 3, 32} \\ {3 \times 3, 16} \\ {3 \times 3, 2} \end{array}} \right] \times 1$
    下载: 导出CSV

    表  2  无人机测试图像的SCR值和目标像素数

    Table  2.   The SCR and target size of UAV test images.

    Test images Image 1 Image 2 Image 3 Image 4 Image 5
    SCR 4.009 2.337 8.378 4.411 2.976
    Target size/Pixel 15 25 12 13 28
    下载: 导出CSV

    表  3  不同方法对图 6第一列测试图像滤波结果的SCRG和BSF值

    Table  3.   The evaluation results of SCRG and BSF of different methods for images in the first column in Fig. 6

    Methods Image 1 Image 2 Image 3 Image 4 Image 5
    BSF SCRG BSF SCRG BSF SCRG BSF SCRG BSF SCRG
    MS-AAGD 0.596 6.908 0.639 5.272 0.298 3.440 0.690 6.764 0.952 6.178
    LoG 0.193 1.526 0.773 4.517 0.099 1.030 0.243 1.791 0.306 2.379
    MPCM 0.793 8.577 1.395 8.202 0.358 3.547 0.732 7.201 0.985 6.401
    F-CNN 0.875 8.655 1.419 13.684 0.305 3.694 0.764 8.821 1.195 11.137
    下载: 导出CSV

    表  4  不同方法对图 7中红外图像滤波结果的SCRG和BSF值

    Table  4.   The evaluation results of SCRG and BSF of different methods for infrared images in Fig. 7

    Methods Image 1 Image 2 Image 3 Image 4
    BSF SCRG BSF SCRG BSF SCRG BSF SCRG BSF SCRG
    MS-AAGD 2.110 11.483 0.712 18.757 1.872 3.998 2.56 6.298 1.091 16.575
    LoG 0.853 4.967 0.473 15.559 1.279 3.042 1.358 3.408 0.241 4.298
    MPCM 1.758 12.399 2.011 96.279 1.984 4.088 4.142 8.333 0.966 18.781
    F-CNN 2.485 16.337 3.314 63.100 1.710 5.407 2.465 10.528 2.404 15.440
    下载: 导出CSV
  • [1] DESHPANDE S D, ER M H, VENKATESWARLU R, et al. Max-mean and max-median filters for detection of small targets[C]//Proceedings of SPIE, 1999, 3809: 74-83.
    [2] ZENG M, LI J X, PENG Z, et al. The design of top-hat morphoLoGical filter and application to infrared target detection[J]. Infrared Physics and Technology, 2006, 48(1): 67-76. doi:  10.1016/j.infrared.2005.04.006
    [3] YANG L, YANG J, YANG K, et al. Adaptive detection for infrared small target under sea–sky complex background[J]. Electronics Letters, 2004, 40(17): 1083-1085. doi:  10.1049/el:20045204
    [4] HILLIARD C I. Selection of a clutter rejection algorithm for real-time target detection from an airborne platform[C]//Proceedings of SPIE, 2000, 4048: 74-84.
    [5] REED I, GAGLIARDI R, STOTTS L, et al. Optical Moving Target Detection with 3-D Matched Filtering[J]. IEEE Transactions on Aerospace and Electronic Systems, 1988, 24(4): 327–336. doi:  10.1109/7.7174
    [6] WEI Y T, YOU X G, LI H, et al. Multiscale patch-based contrast measure for small infrared target detection[J]. Pattern Recognition, 2016, 58: 216-226. doi:  10.1016/j.patcog.2016.04.002
    [7] DENG H, SUN X P, LIU M L, et al. Infrared small-target detection using multiscale graydifference weighted image entropy[J]. IEEE Transactions on Aerospace and Electronic Systems, 2016, 52(1): 60-72. doi:  10.1109/TAES.2015.140878
    [8] KIM S H, LEE J Y. Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track[J]. Pattern Recognition, 2012, 45: 393-406. doi:  10.1016/j.patcog.2011.06.009
    [9] 沈旭, 程小辉, 王新政. 结合视觉注意力机制基于尺度自适应局部对比度增强的红外弱小目标检测算法[J]. 红外技术, 2019, 41(8): 764-771. http://hwjs.nvir.cn/article/id/hwjs201908012

    SHEN X, CHENG X H, WANG X ZH. Infrared dim-small object detection algorithm based on adaptive scale local constrast enhancement combined with visual attention mechanism[J]. Infrared Technology, 2019, 41(8): 764-771. http://hwjs.nvir.cn/article/id/hwjs201908012
    [10] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, New York: 2016: 770-778.
    [11] KIM J, LEE J K, Lee K M, et al. Deeply-recursive convolutional network for image super-resolution[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition, New York: 2016: 1637-1645.
    [12] LI J, YE D H, CHUNG T, et al. Multi-target detection and tracking from a single camera in unmanned aerial vehicles (UAVs)[C] //Proceedings of 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2016: 4992-4997.
    [13] GAO C, ZHANG T, LI Q, et al. Small infrared target detection using sparsering representation[J]. IEEE Aerospace and Electronic Systems Magazine, 2012, 27(3): 21-30. doi:  10.1109/MAES.2012.6196254
    [14] QU X J, CHEN H, PENG G H, et al. Novel detection method for infrared smalltargets using weighted information entropy[J]. Journal of Systems Engineering and Electronics, 2012, 23(6): 838-842. doi:  10.1109/JSEE.2012.00102
  • 加载中
图(7) / 表(4)
计量
  • 文章访问数:  578
  • HTML全文浏览量:  81
  • PDF下载量:  104
  • 被引次数: 0
出版历程
  • 收稿日期:  2020-02-13
  • 修回日期:  2020-03-26
  • 刊出日期:  2021-04-20

目录

    /

    返回文章
    返回