DU Nini, SHAN Kaidong, WEI Shasha. LPformer: Laplacian Pyramid Multi-Level Transformer for Infrared Small Target Detection[J]. Infrared Technology , 2023, 45(6): 630-638.
Citation: DU Nini, SHAN Kaidong, WEI Shasha. LPformer: Laplacian Pyramid Multi-Level Transformer for Infrared Small Target Detection[J]. Infrared Technology , 2023, 45(6): 630-638.

LPformer: Laplacian Pyramid Multi-Level Transformer for Infrared Small Target Detection

More Information
  • Received Date: January 16, 2023
  • Revised Date: January 31, 2023
  • Infrared small target detection refers to the segmentation of small targets from infrared images. This is of significance in the application of fire detection systems, maritime surveillance, and other rescue systems. However, because of factors such as small target size, inconspicuous features, and complex background environment, the detection performance of current infrared small target detection algorithms is generally limited. To address this issue, an infrared small target detection algorithm based on the Laplacian pyramid multi-level transformer (LPformer) was designed in this study. During network iteration, small infrared targets are prone to losing texture detail information owing to their small size. The Laplacian pyramid was used to extract different levels of high-frequency boundary information from the original input infrared image. A structural information conversion module was then fused with the features of different levels in the backbone network to compensate for the lost texture information. Next, to further improve the discriminative ability of the network and suppress the false alarm rate while improving the detection accuracy, a channel-based transformer structure that takes each channel feature map as tokens was also adopted. This calculated the self-attention map along the channel dimension. Experimental results demonstrated that the detection performance of the proposed algorithm was higher than that of current advanced detection algorithms.
  • [1]
    LI Z M, Mei L F, Song M. A survey on infrared weak small target detection method[C]//Advanced Materials Research, 2014, 945: 1558-1560.
    [2]
    贺顺, 谢永妮, 杨志伟, 等. 基于IHBF的增强局部对比度红外小目标检测方法[J]. 红外技术, 2022, 44(11): 1132-1138. http://hwjs.nvir.cn/article/id/0f2609dc-79df-467e-ac1d-4d5f888850d1

    HE Shun, XIE Yongni, YANG Zhiwei, et al. IHBF-based enhanced local contrast measure method for infrared small target detection[J]. Infrared Technology, 2022, 44(11): 1132-1138. http://hwjs.nvir.cn/article/id/0f2609dc-79df-467e-ac1d-4d5f888850d1
    [3]
    李飚, 徐智勇, 王琛, 等. 基于自适应梯度倒数滤波红外弱小目标场景背景抑制[J]. 光电工程, 2021, 48(8): 47-58. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202108004.htm

    LI B, XU Z Y, WANG C, et al. Background suppression for infrared dim small target scene based on adaptive gradient reciprocal filtering[J]. Opto-Electron Eng. , 2021, 48(8): 47-58. https://www.cnki.com.cn/Article/CJFDTOTAL-GDGC202108004.htm
    [4]
    聂青凤, 刘应杰, 梁赟. 基于稀疏约束神经网络的红外弱小目标检测技术[J]. 电光与控制, 2022, 29(8): 40-44. https://www.cnki.com.cn/Article/CJFDTOTAL-DGKQ202208008.htm

    NEI Qingfeng, LIU Yingjie, LIANG Yun. Infrared dim target detection based on neural network model with sparsity constraint[J]. Electronics Optics & Control, 2022, 29(8): 40-44. https://www.cnki.com.cn/Article/CJFDTOTAL-DGKQ202208008.htm
    [5]
    BAI Xiangzhi, ZHOU Fugen. Analysis of new top-hat transformation and the application for infrared dim small target detection[J]. Pattern Recognition, 2010, 43(6): 2145-2156. DOI: 10.1016/j.patcog.2009.12.023
    [6]
    CL Philip CHEN, LI Hong, WEI Yantao, et al. A local contrast method for small infrared target detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2013, 52(1): 574-581.
    [7]
    HAN Jinhui, Saed Moradi, Iman Faramarzi, et al. Infrared small target detection based on the weighted strengthened local contrast measure[J]. IEEE Geoscience and Remote Sensing Letters, 2020, 18(9): 1670-1674.
    [8]
    HOU X, ZHANG L. Saliency detection: a spectral residual approach[C]//2007 IEEE Conference on Computer Vision and Pattern Recognition of IEEE, 2007: 1-8.
    [9]
    DAI Yimian, WU Yiquan. Reweighted infrared patch-tensor model with both nonlocal and local priors for single-frame small target detection[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 2017, 10(8): 3752-3767. DOI: 10.1109/JSTARS.2017.2700023
    [10]
    GAO Chenqiang, MENG Deyu, YANG Yi, et al. Infrared patch-image model for small target detection in a single image[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4996-5009. DOI: 10.1109/TIP.2013.2281420
    [11]
    ZHANG Landan, PENG Lingbing, ZHANG Tianfang, et al. Infrared small target detection via non-convex rank approximation minimization joint l2, 1 norm[J]. Remote Sensing, 2018, 10(11): 1821 DOI: 10.3390/rs10111821
    [12]
    ZHANG Landan, PENG Zhenming. Infrared small target detection based on partial sum of the tensor nuclear norm[J]. Remote Sensing, 2019, 11(4): 382. DOI: 10.3390/rs11040382
    [13]
    XU Yonghui, ZHANG J A. Real-time detection algorithm for small space targets based on max-median filter[J]. Journal of Information and Computational Science, 2014, 11(4): 1047-1055. DOI: 10.12733/ jics20102961.
    [14]
    谷雨, 张宏宇, 孙仕成. 融合多尺度分形注意力的红外小目标检测模型[J/OL]. 电子与信息学报: 1-10[2023-01-14]. http://kns.cnki.net/kcms/detail/11.4494.TN.20221107.0920.007.html.

    GU Yu, ZHANG Hongyu, SUN Shicheng. Infrared small target detection model with multi-scale fractal attention[J/OL]. Journal of Electronics & Information Technology: 1-10[2023-01-14]. http://kns.cnki.net/kcms/detail/11.4494.TN.20221107.0920.007.html
    [15]
    邵斌, 杨华, 朱斌, 等. 基于实时语义分割的红外小目标检测算法[J/OL]. 激光与光电子学进展: 1-15[2023-01-14]. http://kns.cnki.net/kcms/detail/31.1690.TN.20221031.1649.140.html.

    SHAO Bin, YANG Hua, ZHU Bing, et al. Infrared small target detection algorithm based on real-time semantic segmentation[J/OL]. Laser & Optoelectronics Progress: 1-15[2023-01-14]. http://kns.cnki.net/kcms/detail/31.1690.TN.20221031.1649.140.html
    [16]
    WANG Huan, ZHOU Luping, WANG Lei. Miss detection vs. false alarm: Adversarial learning for small object segmentation in infrared images[C]//Proceedings of 2019 IEEE/CVF International Conference on Computer Vision(ICCV), 2019: 8508-8517. DOI: http://dx.doi.org/10.1109/ICCV.2019.00860.
    [17]
    DAI Y, WU Y, ZHOU F, et al. Asymmetric contextual modulation for infrared small target detection[C]//Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2021: 950-959.
    [18]
    LI Boyang, XIAO Chao, WANG Longguang, et al. Dense nested attention network for infrared small target detection[J]. IEEE Transactions on Image Processing, 2022: DOI: 10.1109/TIP.2022.3199107.
    [19]
    张传聪, 李范鸣, 饶俊民. 基于特征显著性融合的红外小目标检测[J]. 半导体光电, 2022, 43(4): 828-834. DOI:10.16818/j.issn1001-5868. 2022032901.

    ZHANG Chuancong, LI Fanming, RAO Junmin. Infrared small target detection based on feature saliency fusion[J]. Semiconductor Optoelectronics, 2022, 43(4): 828-834. DOI:10.16818/j.issn1001-5868. 2022032901.
    [20]
    王翔. 一种复杂海空背景下的红外小目标检测跟踪算法[J]. 光学与光电技术, 2022, 20(2): 113-119. DOI:10.19519/j.cnki.1672-3392. 2022.02.010.

    WANG Xiang. A detecting and tracking algorithm for the infrared small targets under the complex sea-sky background[J]. Optics & Optoelectronic Technology, 2022, 20(2): 113-119. DOI:10.19519/j.cnki.1672-3392. 2022.02.010.
    [21]
    薛锡瑞, 黄树彩, 马佳顺, 等. 基于局部熵参考预处理的RPCA红外小目标检测[J]. 红外技术, 2021, 43(7): 649-657. http://hwjs.nvir.cn/article/id/e8541151-1530-4561-ad38-42349b5da1b8

    XUE Xirui. HUANG Shucai, MA Jiashun, et al. RPCA infrared small target detection based on local Entropy reference in preprocessing[J]. Infrared Technology, 2021, 43(7): 649-657. http://hwjs.nvir.cn/article/id/e8541151-1530-4561-ad38-42349b5da1b8
    [22]
    朱硕雅, 杨德振, 贾鹏, 等. 时空联合红外小目标检测算法的设计与实现[J]. 激光与红外, 2021, 51(3): 388-392. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202103023.htm

    ZHU Shuoya, YANG Dezhen, JIA Peng, et al. Design and implementation of space-time combined infrared small target detection algorithm[J]. Laser and Infrared, 2021, 51(3): 388-392. https://www.cnki.com.cn/Article/CJFDTOTAL-JGHW202103023.htm
    [23]
    CHEN G, WANG W, TAN S. IRST Former: a hierarchical vision transformer for infrared small target detection[J]. Remote Sensing, 2022, 14(14): 3258.
    [24]
    高峰, 孟德森, 解正源, 等. 基于Transformer和动态3D卷积的多源遥感图像分类[J/OL]. 北京航空航天大学学报: 1-11[2023-01-14]. DOI: 10.13700/j.bh.1001-5965.2022.0397

    GAO Feng, MENG Desen, XIE Zhengyuan, et al. Multi-source remote sensing image joint classification based on transformer and dynamic 3D-convolution[J/OL]. Journal of Beijing University of Aeronautics and Astronautics: 1-11[2023-01-14] (DOI: 10.13700/j.bh.1001-5965.2022).
    [25]
    Jonnalagadda A, WANG W Y, Manjunath B S, et al. Foveater: foveated transformer for image classification[J/OL]. arXiv preprint arXiv: 2105.14173, (https://doi.org/10.48550/arXiv.2105.14173)
    [26]
    HAN K, XIAO A, WU E, et al. Transformer in transformer[J]. Advances in Neural Information Processing Systems, 2021, 34: 15908-15919.
    [27]
    Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image Computing and Computer-assisted Intervention, 2015: 234-241.
    [28]
    WANG X, YU K, DONG C, et al. Recovering realistic texture in image super-resolution by deep spatial feature transform[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018: 606-615.
    [29]
    DAI Y, WU Y, ZHOU F, et al. Attentional local contrast networks for infrared small target detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2021, 59(11): 9813-9824.
    [30]
    HAN J, Moradi S, Faramarzi I, et al. Infrared small target detection based on the weighted strengthened local contrast measure[J]. IEEE Geoscience and Remote Sensing Letters, 2020, 18(9): 1670-1674.
    [31]
    CHEN C L P, LI H, WEI Y, et al. A local contrast method for small infrared target detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2013, 52(1): 574-581.
    [32]
    GAO C, MENG D, YANG Y, et al. Infrared patch-image model for small target detection in a single image[J]. IEEE Transactions on Image Processing, 2013, 22(12): 4996-5009.
    [33]
    ZHANG L, PENG L, ZHANG T, et al. Infrared small target detection via non-convex rank approximation minimization joint l2, 1 norm[J]. Remote Sensing, 2018, 10(11): 1821.
    [34]
    ZHANG L, PENG Z. Infrared small target detection based on partial sum of the tensor nuclear norm[J]. Remote Sensing, 2019, 11(4): 382.
    [35]
    SUN Y, YANG J, An W. Infrared dim and small target detection via multiple subspace learning and spatial-temporal patch-tensor model[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(5): 3737-3752.
  • Related Articles

    [1]JIN Yongwei, LIU Chunlong. Sensitivity Analysis of Thermal Design Parameters of High-Sensitivity Optical Detection Module[J]. Infrared Technology , 2025, 47(2): 141-147.
    [2]ZHANG Jiahong, JIA Zhuohang, GUO Liang, PENG Bo, WANG Weicheng. Thermal Design and Simulation Verification of High-precision Integrated Star Sensor in Near-Earth Orbit[J]. Infrared Technology , 2024, 46(4): 400-405.
    [3]WANG Shang, ZHANG Xingxiang, ZHU Junqing. Design and Analysis of All Aluminum Alloy Optical Mechanical Structure of Space Cameras[J]. Infrared Technology , 2022, 44(4): 364-370.
    [4]DU Yimin, JIA Xuezhi, AN Yuan, KE Shanliang. Design and Analysis of Focusing Mechanism for a High Resolution Space Camera[J]. Infrared Technology , 2019, 41(4): 305-310.
    [5]CHEN Zhizhou, CAO Kaiqin, MIAO Bin, CHAI Mengyang, LIU Shufeng, SUN Dexin, LIU Yinnian. Thermal Design of Electric Cabinet for Space Cameras[J]. Infrared Technology , 2017, 39(10): 880-883.
    [6]ZHU Cheng-xi, LI Yang, SHI Jia-ming. Thermal Design of One Infrared Imaging System Based on the Method of TSO Integrated Analysis[J]. Infrared Technology , 2015, (5): 380-386.
    [7]ZHAO Gao-fei, XIE Rong-jian, PEI Yun-tian. Heat Distortion Analysis of A Reflecting Mirror Used in Space Camera[J]. Infrared Technology , 2012, 34(1): 36-40. DOI: 10.3969/j.issn.1001-8891.2012.01.007
    [8]LIU Bi-liu, WANG Wen-wen, SONG Qing-lei, WANG Yong-qiang, XI Bo. Thermal Design Analysis and Application on the Surface Coating Materials of Spacecraft[J]. Infrared Technology , 2011, 33(5): 305-308. DOI: 10.3969/j.issn.1001-8891.2011.05.014
    [9]CAI Shi-ping, SHEN Guo-tu, CAI Ji-guang, DONG Zhan-hai, GAO Jing. Generation of the Finite Element Model and Its Application on Thermal Analysis[J]. Infrared Technology , 2009, 31(5): 279-282. DOI: 10.3969/j.issn.1001-8891.2009.05.009
    [10]Two-Dimensional Thermal Analysis of Multi-Layer Pyroelectric Thin Film Infrared Detector[J]. Infrared Technology , 2004, 26(1): 60-63,66. DOI: 10.3969/j.issn.1001-8891.2004.01.016
  • Cited by

    Periodical cited type(1)

    1. 刘一帆,周峰,胡斌,晋利兵. 全景环带二次成像红外光学系统设计. 航天返回与遥感. 2024(05): 23-30 .

    Other cited types(1)

Catalog

    Article views PDF downloads Cited by(2)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return