Fusion detection mechanism of robust correlation filtering visual tracking algorithm

HOU Zhingqiang; WANG Shuai; YU Wangsheng; LI Youmou; MA Sugang

doi:10.5768/JAO201940.0502002

Journal of Applied Optics > 2019 > 40(5): 795-804. > DOI: 10.5768/JAO201940.0502002

HOU Zhingqiang, WANG Shuai, YU Wangsheng, LI Youmou, MA Sugang. Fusion detection mechanism of robust correlation filtering visual tracking algorithm[J]. Journal of Applied Optics, 2019, 40(5): 795-804. DOI: 10.5768/JAO201940.0502002

Citation:

PDF (2207 KB)

Fusion detection mechanism of robust correlation filtering visual tracking algorithm

HOU Zhingqiang^{1, 2,},
WANG Shuai^{1, 2},
YU Wangsheng³,
LI Youmou^{1, 2},
MA Sugang^{1, 2}

1.
School of Computer, Xi'an University of Posts and Telecommunications, Xi'an 710121, China
2.
Shaanxi Provincial Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an University of Posts and Telecommunications, Xi'an 710121, China
3.
Air Force Engineering University, Xi'an 710077, China

More Information

Received Date: January 06, 2019
Revised Date: April 10, 2019

Graphical Abstract

Abstract

Abstract

In order to solve the tracking drift problem caused by the correlation filtering visual tracking algorithm in complex scenes, a correlation filtering tracking framework fused with detection mechanism was proposed.A space-time regularization filter was used as a tracker, and a linear kernel correlation filter was used as a detector.When the response diagram obtained by correlating the tracker with the target was a plurality of peaks, the detector was activated to perform correlation matching on multiple peaks to obtain a retest result; meanwhile, a filter model update strategy using average peak correlation energy was used to obtain a more reliable detector, so as to improve the tracking accuracy and algorithm robustness.The experimental results on the OTB2015, Temple color 128 and VOT2016 data platforms show that compared with the tracking algorithms of better performance proposed in recent years, the proposed algorithm has better robustness and accuracy in complex scenes such as target motion blur, similar background interference and illumination changing, and both of the tracking accuracy and the success rate are improved.
- computer vision,
- target tracking,
- correlation filtering,
- multi-peak detection

FullText(HTML)

References (34)

References

[1]	SMEULDERS A WM, CHU D M, CUCCHIARA R.Visual tracking: an experimental survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36 (7) :1442-1468. doi: 10.1109/TPAMI.2013.230
[2]	侯志强, 韩崇昭.视觉跟踪技术综述[J].自动化学报, 2006, 32(4): 603-617. http://d.old.wanfangdata.com.cn/Periodical/zdhxb200604016 HOU Zhiqiang, HAN Chongzhao. A survey of visual tracking[J]. Acta Automatica Sinica, 2006, 32(4): 603-617. http://d.old.wanfangdata.com.cn/Periodical/zdhxb200604016
[3]	WANG N Y, SHI J P, YEUNG D, et al. Understanding and diagnosing visual tracking systems: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, December 7-13, 2015[C].USA: IEEE, 2015.
[4]	刘威, 赵文杰, 李成.时空上下文学习长时目标跟踪[J].光学学报, 2016, 36(1): 179-186. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201601023 LIU Wei, ZHAO Wenjie, LI Cheng. Long-term visual tracking based on spatio-temporal context[J]. Acta Optica Sinica, 2016, 36(1): 179-186. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=gxxb201601023
[5]	CHENG Y Z. Mean shift, mode seeking, and clustering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17 (8) :790-799. doi: 10.1109/34.400568
[6]	NUMMIARO K, KOLLER-MEIER E, VAN GOOL L. An adaptive color-based particle filter[J]. Image and Vision Computing, 2003, 21(1): 99-110. doi: 10.1016/S0262-8856(02)00129-4
[7]	MEI X, LING H. Robust visual tracking using L1 minimization[C].USA: IEEE Computer Society, 2011: 1257-1264.
[8]	SUPANCIC J S, RAMANAN D. Self-Paced Learning for long-term tracking[J]. IEEE Conference on Computer Vision and Pattern Recognition, 2013, 9(4):2379-2386. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=CC0213696294
[9]	BOLME D, BEVERIDGE J R, DRAPER B A, et al. Visual object tracking using adaptive correlation filters[J]. Computer Vision and Pattern Recognition, 2010, 119(5) :2544-2550. http://d.old.wanfangdata.com.cn/Periodical/zgtxtxxb-a201802012
[10]	BABENKO B, YANG M H, BELONGIE S.Visual tracking with online multiple instance learning: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, June 20-25, 2009[C].USA: IEEE, 2009.
[11]	HENRIQUES J F, CASEIRO R, MARTINS P, et al. Exploiting the circulant structure of tracking-by-detection with kernels[J]. European Conference on Computer Vision, 2012, 7575(1) :702-715. http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=CC0213286871
[12]	DANELLJAN M, KHAN F S, FELSBERG M, et al. Adaptive color attributes for real-time visual tracking: 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, June 23-28, 2014[C]. USA: IEEE, 2014.
[13]	MA C, YANG X K, ZHANG C Y, et al. Long-term correlation tracking: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, June 7-12, 2015[C].USA: IEEE, 2015.
[14]	DANELLJAN M, HAGER G, KHAN F S, et al. Learning spatially regularized correlation filters for visual tracking: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, December 7-13, 2015[C]. USA: IEEE, 2015.
[15]	李超, 吴玉敬, 徐飞飞, 等.一种目标遮挡情况下的自动跟踪控制方法[J].应用光学, 2017, 38(5): 713-718. http://www.yygx.net/CN/abstract/abstract11003.shtml LI Chao, WU Yujing, XU Feifei, et al. Auto-tracking control method against target occlusion[J]. Journal of Applied Optics, 2017, 38(5): 713-718. http://www.yygx.net/CN/abstract/abstract11003.shtml
[16]	MA C, HUANG J B, YANG X K, et al. Adaptive correlation filters with long-term and short-term memory for object tracking[J]. International Journal of Computer Vision 2018, 126(8): 771-796. doi: 10.1007/s11263-018-1076-4
[17]	王东, 王敏.基于多滤波算法融合的红外小目标检测[J].应用光学, 2017, 38(1): 106-113. http://www.yygx.net/CN/abstract/abstract10901.shtml WANG Dong, WANG Min. Detection of infrared small target based on fusion of multi-filters[J]. Journal of Applied Optics, 2017, 38(1): 106-113. http://www.yygx.net/CN/abstract/abstract10901.shtml
[18]	LI Feng, TIAN Cheng, ZUO Wangmeng, et al. Learning spatial-temporal regularized correlation filters for visual tracking: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, June 18-23, 2018[C].USA: IEEE, 2018.
[19]	HENRIQUES J F, CASEIRO R, MARTINS P, et al. High-speed tracking with kernelized correlation filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence 2015, 37(3): 583-596. doi: 10.1109/TPAMI.2014.2345390
[20]	WANG M M, LIU Y, HUANG Z Y. Large margin object tracking with circulant feature maps: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, July 21-26, 2017[C]. USA: IEEE, 2017.
[21]	WU Y, LIM J, YANG M. Online object tracking: A benchmark: 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, June 23-28, 2013[C].USA: IEEE, 2013.
[22]	LIANG P P, BLASCH E, LING H B. Encoding color information for visual tracking: algorithms and benchmark[J]. IEEE Transactions on Image Processing 2015, 24(12): 5630-5644. doi: 10.1109/TIP.2015.2482905
[23]	MA Chao, HUANG Jiabing, YANG Xiaokang, et al. Hierarchical convolutional features for visual tracking: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, December 7-13, 2015[C].USA: IEEE, 2016.
[24]	DANELLJAN M, ROBINSON A, SHAHBAZ KHAN F, et al. Beyond correlation filters: learning continuous convolution operators for visual tracking[C]//Computer Vision-ECCV 2016. Cham: Springer International Publishing, 2016: 472-488.
[25]	CRAMMER K, DEKEL O, KESHET J, et al.Online passive-aggressive algorithms[J].Journal of Machine Learning Research, 2006, 7(3):551-585. http://d.old.wanfangdata.com.cn/Periodical/jsjkxjsxb-e201604005
[26]	BERTINETTO L, VALMADRE J, GOLODETZ S, et al. Staple: complementary learners for real-time tracking[C]: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, June 27-30, 2016[C].USA: IEEE, 2016.
[27]	BERTINETTO L, VALMADRE J, HENRIQUES J F, et al. Fully-convolutional Siamese networks for object tracking[C]//Lecture Notes in Computer Science. Cham: Springer International Publishing, 2016: 850-865.
[28]	ZHANG J M, MA S G, SCLAROFF S. MEEM: robust tracking via multiple experts using entropy minimization[C]//Computer Vision-ECCV 2014. Cham: Springer International Publishing, 2014: 188-203.
[29]	LI Y, ZHU J K. A scale adaptive kernel correlation filter tracker with feature integration[C]//Computer Vision - ECCV 2014 Workshops. Cham: Springer International Publishing, 2015: 254-265.
[30]	ZHANG Tianzhu, XU Changsheng, YANG Minghsuan. Multi-task correlation particle filter for robust object tracking[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).USA: IEEE, 2017.
[31]	MA C, HUANG J B, YANG X K, et al. Hierarchical convolutional features for visual tracking: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, December 7-13, 2015[C]. USA: IEEE, 2015.
[32]	HARE S, SAFFARI A, TORR P H S. Struck: structured output tracking with kernels[C]: 2011 International Conference on Computer Vision, Barcelona, November 6-13, 2011[C]. USA: IEEE, 2011.
[33]	DANELLJAN M, HAGE RG, KHAN F S, et al. Accurate scale estimation for robust visual tracking[C]// BMVC(2014).[S.l.]: [s.n.], 2014.
[34]	LI B, YAN J J, WU W, et al. High performance visual tracking with Siamese region proposal network: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, June 18-23, 2018[C]. USA: IEEE, 2018.

[1]	REN Zelin, PANG Lan, WANG Chao, LI Jiaheng, ZHOU Fangyan. Low-light pedestrian detection and tracking algorithm based on autoencoder structure and improved Bytetrack[J]. Journal of Applied Optics, 2024, 45(3): 616-629. DOI: 10.5768/JAO202445.0302001
[2]	CHAI Jinguo, YU Shancheng, ZHU Dandan, KANG Lixin, WANG Zhengtai, XU Lulu, REN Yuxuan, TONG Kai. Detection method for calibration of gas concentrations based on absorption peaks in frequency domain[J]. Journal of Applied Optics, 2024, 45(1): 142-149. DOI: 10.5768/JAO202445.0103002
[3]	CHEN Cancan, XIA Runqiu, LIU Yang, LIU Lishuang, CHEN Qingshan. Hierarchical convolution filtering method for infrared dim small target detection[J]. Journal of Applied Optics, 2023, 44(4): 826-833. DOI: 10.5768/JAO202344.0403003
[4]	NIU Chang, YIN Kuiying, HUANG Yinhe. Automatic target detecting and tracking technology based on UAV ground target images[J]. Journal of Applied Optics, 2020, 41(6): 1153-1160. DOI: 10.5768/JAO202041.0601003
[5]	HE Fuqiang, LUO Hong, YAO Xuelian, PING An. Self-adaptive bridge bare rebar detection algorithm based on local image segmentation and multi-feature filtering[J]. Journal of Applied Optics, 2020, 41(3): 508-515. DOI: 10.5768/JAO202041.0302004
[6]	Zhang Hua-liang, Xie Yong-jie, Zhang Song, Zhao Yan, Jiao Jiao. Detection of small, low contrast targets based on adaptive frequency filter[J]. Journal of Applied Optics, 2015, 36(4): 630-634. DOI: 10.5768/JAO201536.0406001
[7]	Wang Chao, Ji Ming, Wang Jiao-ying, Jiang Wen-tao, Xie Jing, Li Tao, Gao Ya. Multi-target detecting algorithm based on digital image[J]. Journal of Applied Optics, 2015, 36(3): 386-390. DOI: 10.5768/JAO201536.0302001
[8]	DONG Jing, FU Dan, YANG Xia. Real-time moving object detection and tracking by using UAV videos[J]. Journal of Applied Optics, 2013, 34(2): 255-259.
[9]	MA Jin, TIAN Tao. Target tracking method based on joint transform correlation[J]. Journal of Applied Optics, 2012, 33(5): 904-908.
[10]	CHENG Gang, ZHU Hui, ZHANG Yong, WANG Qing-quan. Adaptive algorithm for small target detection in infrared searching system[J]. Journal of Applied Optics, 2010, 31(1): 128-131.

Cited By

Cited by

Periodical cited type(4)

1.	李道京，高敬涵，崔岸婧，周凯，吴疆. 2m衍射口径星载双波长陆海激光雷达系统研究. 中国激光. 2022(03): 123-134 .
2.	杜康，刘春雨，刘帅，宋伟阳，徐婷婷. 同轴超紧凑型主三镜一体化光学系统的设计. 激光与光电子学进展. 2020(07): 263-269 .
3.	张龙，王孝坤，程强，胡海翔. 拼接式望远镜主镜衍射效应研究. 应用光学. 2020(03): 447-454 . 本站查看
4.	蒲小琴，董全林，余子箫，张斯明，邵静怡，刘业楠，王军伟. 半主动激光导引头光学系统设计及线性度分析. 航天器环境工程. 2020(03): 303-309 .

Other cited types(2)

Get Citation

PDF

XML

Article views (835) PDF downloads (36) Cited by(6)

Turn off MathJax

Article Contents

Abstract

References

Fusion detection mechanism of robust correlation filtering visual tracking algorithm