HE Min, HUI Bingwei, YI Mengni, HU Weidong. Infrared Moving-point Target Semi-Automatic Labeling Algorithm Based on Target Enhancement and Visual Tracking[J]. Infrared Technology , 2022, 44(10): 1073-1081.
Citation: HE Min, HUI Bingwei, YI Mengni, HU Weidong. Infrared Moving-point Target Semi-Automatic Labeling Algorithm Based on Target Enhancement and Visual Tracking[J]. Infrared Technology , 2022, 44(10): 1073-1081.

Infrared Moving-point Target Semi-Automatic Labeling Algorithm Based on Target Enhancement and Visual Tracking

More Information
  • Received Date: October 10, 2021
  • Revised Date: December 07, 2021
  • Infrared video data annotation has the problems of low efficiency and poor quality. In this paper, a semi-automatic labeling method for moving point targets in infrared sequence images is proposed based on target enhancement and visual tracking to solve it. First, infrared sequence images in a continuous period of time were registered and fused to enhance the target features. Second, a visual tracking algorithm was utilized to locate the fused features efficiently and automatically. Lastly, a saliency map was obtained through phase spectrum reconstruction, and the exact coordinates of a target were obtained. During automatic annotation, the difference between the annotation results of adjacent frames was used to select key frames, which enabled the annotators to locate the image frames that had errors and manually annotated them quickly. The results of the experiments showed that the algorithm significantly reduced the participation of annotators and effectively solved the problems of long period and poor quality assurance in data annotation.
  • [1]
    Yuen J, Russell B, Liu C, et al. Labelme video: building a video database with human annotations[C]// 12th International Conference on Computer Vision(ICCV), IEEE, 2009: 1451-1458.
    [2]
    Lee J H, Lee K S, Jo G S. Representation method of the moving object trajectories by interpolation with dynamic sampling[C]//2013 International Conference on Information Science and Applications (ICISA), IEEE, 2013: 1-4.
    [3]
    Gil-Jiménez P, Gómez-Moreno H, López-Sastre R, et al. Geometric bounding box interpolation: an alternative for efficient video annotation[J]. EURASIP Journal on Image and Video Processing, 2016, 2016(1): 1-13. DOI: 10.1186/s13640-015-0097-y
    [4]
    Vondrick C, Patterson D, Ramanan D. Efficiently scaling up crowdsourced video annotation[J]. International Journal of Computer Vision, 2013, 101(1): 184-204. DOI: 10.1007/s11263-012-0564-1
    [5]
    Vondrick C, Ramanan D. Video annotation and tracking with active learning[J]. Advances in Neural Information Processing Systems, 2011, 24: 28-36.
    [6]
    Buchanan A, Fitzgibbon A. Interactive feature tracking using K-D trees and dynamic programming[C]// IEEE Conference on Computer Vision & Pattern Recognition (CVPR), IEEE, 2006: 626-633.
    [7]
    Agarwala A, Hertzmann A, Salesin D H, et al. Key frame-based tracking for rotoscoping and animation[J]. ACM Transactions on Graphics, 2004, 23(3): 584-591. DOI: 10.1145/1015706.1015764
    [8]
    Biresaw T A, Nawaz T, Ferryman J, et al. Vitbat: video tracking and behavior annotation tool[C]//13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), IEEE, 2016: 295-301.
    [9]
    Bakliwal P, Hegde G M, Jawahar C V. Collaborative Contributions for Better Annotations[C]//The International Conference on Computer Vision Theory and Applications(VISAPP), Scite Press, 2017: 353-360.
    [10]
    CHEN B, LING H, ZENG X, et al. Scribblebox: interactive annotation framework for video object segmentation[C]//European Conference on Computer Vision (ECCV), Berlin Springer, 2020: 293-310.
    [11]
    Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. DOI: 10.1023/B:VISI.0000029664.99615.94
    [12]
    Henriques J F, Caseiro R, Martins P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(3): 583-596.
    [13]
    WANG M, LIU Y, HUANG Z. Large margin object tracking with circulant feature maps[C]//The IEEE Conference on Computer Vision and Pattern Recognition(CVPR), New York: IEEE, 2017: 4021-4029.
    [14]
    回丙伟, 宋志勇, 范红旗, 等. 地/空背景下红外图像弱小飞机目标检测跟踪数据集[J]. 中国科学数据, 2020, 5(3): 286-297. https://www.cnki.com.cn/Article/CJFDTOTAL-KXGZ202003030.htm

    HUI Bingwei, SONG Zhiyong, FAN Hongqi, et al. A dataset for infrared detection and tracking of dim-small aircraft targets under ground/air background[J]. China Sci. Data, 2020, 5(3): 286-297. https://www.cnki.com.cn/Article/CJFDTOTAL-KXGZ202003030.htm
  • Related Articles

    [1]WANG Pengxiang, GUO Jingbin, TAN Wenbin, LI Xingfei. A Multidomain CNN that Integrates Multiple Models in a Tree Structure for Visual Tracking[J]. Infrared Technology , 2018, 40(1): 47-54.
    [2]ZOU Zhi-yuan, AN Bo-wen, PAN Sheng-da. Key Frame Extraction from Research and Rescue Aerial Image Sequence[J]. Infrared Technology , 2014, (9): 723-727.
    [3]GOU Shu-xin, GU Yu, LIU Jing-hong, XUE An-ke. Multimodal Image Fusion Tracking Algorithm Based on CoUpdate[J]. Infrared Technology , 2014, (9): 705-709.
    [4]LIU Si-ru, YANG Feng-bao, CHEN-Lei. The Fast Fusion for Infrared and Visible Sequences Image Based on Key Frames Extraction[J]. Infrared Technology , 2014, 36(5): 350-354.
    [5]LI Sheng-yong, JIANG Tao, ZHU Qiang-hua. Design and Implement a Real-time System for Small Target Detection in Infrared Image Sequence[J]. Infrared Technology , 2010, 32(8): 471-474. DOI: 10.3969/j.issn.1001-8891.2010.08.009
    [6]FAN Chao, SUN Ning-ning, XIA Xu. Super-resolution Reconstruction Based on Image Sequences[J]. Infrared Technology , 2010, 32(5): 279-282. DOI: 10.3969/j.issn.1001-8891.2010.05.007
    [7]ZHAO Jing-yuan, WANG Li-ming, LIU Bin. The Research of Infrared Image Sequence Enhancement Based on SVD Algorithm[J]. Infrared Technology , 2009, 31(1): 47-50. DOI: 10.3969/j.issn.1001-8891.2009.01.013
    [8]CHENG LAN, WANG Zhi-Jie, JI Xiu-li. An Novel Algorithm for Infrared Small Targets Detection and Tracking Based on Local Image Features[J]. Infrared Technology , 2008, 30(6): 324-326,334. DOI: 10.3969/j.issn.1001-8891.2008.06.004
    [9]YU Su-fen, ZHOU Hong-wu, LIU Yi. Detection Algorithm for Small Moving Targets in Infrared Image Sequences[J]. Infrared Technology , 2005, 27(3): 232-234. DOI: 10.3969/j.issn.1001-8891.2005.03.012
    [10]High Resolution Infrared Image Reconstruction Based on Image Sequence[J]. Infrared Technology , 2002, 24(6): 58-61. DOI: 10.3969/j.issn.1001-8891.2002.06.014
  • Cited by

    Periodical cited type(1)

    1. 肖永平,马世娟,倪晓东. 频率源中关键信号电磁兼容研究. 电子设计工程. 2024(19): 115-118+123 .

    Other cited types(1)

Catalog

    Article views (130) PDF downloads (35) Cited by(2)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return