基于深度特征的多目标追踪算法的研究
Research on Multi-Object Tracking Algorithm Based on Deep Feature
本文基于DeepSort (Simple Online and Realtime Tracking with a Deep Association Metric) 算法提出了一种能够满足实际场景需要的多目标追踪系统。本文采用了tracking-by-detection框架。这个框架把优化过程分为两个部分:检测部分和追踪部分。检测的质量对于整个追踪系统的性能有很大的影响。通过对比不同追踪器的速度和性能,SDP-CRC和Yolov3是在多目标场景中比较合适的追踪器。 除此之外,通过改进传统的非极大值抑制方法(NMS)来提升检测性能。实验结果显示,这个方法可以能够将MOTA提升3.5\%。对于追踪部分,本文首先利用单目标追踪器(SiamRPN)构建新的估计模型来代替原来的Kalman运动估计模型。实验结果表明这个方法不仅在MOTA上只能提升0.3\%,其速度还降低了近5倍。除此之外通过更新模版帧,充分利用SiamRPN外观信息和提升估计模型在遮挡情况下的鲁棒性,该方法将能够进一步提升追踪系统的整体性能。本文还通过利用追踪器和检测结果之间的位置信息和速度信息来优化它们之间的关联算法。该算法通过避免多维矩阵运算极大的降低了计算复杂度。
his paper proposes a practical multiple object tracking system based on DeepSort (Simple Online and Realtime Tracking with a Deep Association Metric). This system uses the tracking-by-detection method as the framework, which divides the optimization processes into two parts: detection and tracking. As for the overall performance of the algorithm, detection quality is a key element for it. According to the comparison in terms of speed and performance, suitable detectors are SDP-CRC and Yolov3 in multi-object tracking scenes. Additionally, this project has proposed a new pre-processing method based on NMS (non maximum suppression). This method has improved tracking performance by up to 3.5\% in terms of MOTA. As for tracking components, this project replaces a new estimation method based on visual object trackers (SiamRPN) with traditional Kalman motion estimation method. The experimental results show that this method has improved MOTA (Multiple Object Tracking Accuracy) by 0.3\%. Besides, the speed performance has decreased nearly 500\%. That’s because this experiment should be carried out more finely. In the next step, the performance of this method can be improved by updating the template frame appropriately, using appearance information provided by SiamRPN tracker for matching process and improving the robustness of the tracker. Additionally, this project has optimized detection-to-tracker association algorithm by using their positional and velocity relationship. It has reduced the complexity of the algorithm by avoiding multi-dimensional matrix operations.
孙庆宏、董远
计算技术、计算机技术
人工智能计算机视觉多目标追踪数据关联
rtificial IntelligenceComputer VisionMultiple Object TrackingData Association
孙庆宏,董远.基于深度特征的多目标追踪算法的研究[EB/OL].(2022-01-27)[2025-08-11].http://www.paper.edu.cn/releasepaper/content/202201-110.点此复制
评论