| Citation: | HU Xin, SHAO Liangbin, ZHOU Yun-qiang, XIAO Jian, CHENG Hongliang. Vehicle Detection and Tracking Algorithm for Distant Small Targets Based on Improved YOLOv5s-CSC and Deep-Sort[J]. Journal of Southwest Jiaotong University. doi: 10.3969/j.issn.0258-2724.20240528 |
To address the problems of missed detection of distant small vehicle targets, as well as ID switching and jumping during tracking in traffic surveillance scenarios, a small-target detection and tracking algorithm combining improved You Only Look Once version 5 small (YOLOv5s) and improved deep simple online and realtime tracking (Deep-Sort) was proposed. For detection, based on the YOLOv5s baseline network, the convolutional block attention module (CBAM) mechanism was introduced to enhance the feature capture of small targets. The Swin Transformer Block was fused with the cross stage partial (CSP) structure in the backbone network to construct the CSPSTB module and strengthen global information attention. The content-aware reassembly of features (CARAFE) upsampling operator was adopted to reduce feature loss, forming the YOLOv5s-CSC detection network. For tracking, a deep appearance feature extraction network containing a residual squeeze-and-excitation (Res_SE) structure was designed, which was more adaptable to vehicle features during data association. Experimental results on the UA-DETRAC dataset indicate that, compared with the original YOLOv5s model, the improved detection algorithm increases the mean average precision (
| [1] |
赵雪亭, 胡立伟. 城市交通拥塞源参数反演性能综合对比[J]. 西南交通大学学报, 2025, 60(1): 243-252. doi: 10.3969/j.issn.0258-2724.20230008
Zhao Xueting, Hu Liwei. Comprehensive comparison of inversion performance of urban traffic congestion source parameters[J]. Journal of Southwest Jiaotong University, 2025, 60(1): 243-252. doi: 10.3969/j.issn.0258-2724.20230008
|
| [2] |
夏英, 刘敏. 基于时空注意力卷积神经网络的交通流量预测[J]. 西南交通大学学报, 2023, 58(2): 340-347. doi: 10.3969/j.issn.0258-2724.20210526
Xia Ying, Liu Min. Traffic flow prediction based on spatial-temporal attention convolutional neural network[J]. Journal of Southwest Jiaotong University, 2023, 58(2): 340-347. doi: 10.3969/j.issn.0258-2724.20210526
|
| [3] |
Redmon J, Divvala S, Girshick R, et al. You only look once: unified, real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2016: 779-788.
|
| [4] |
Redmon J, Farhadi A. YOLO9000: better, faster, stronger[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2017: 6517-6525.
|
| [5] |
Redmon J, Farhadi A. YOLOv3: an incremental improvement[PP/OL]. V1. arXiv (2018-04-08)[2024-10-12]. https://doi.org/10.48550/arXiv.1804.02767.
|
| [6] |
Bochkovskiy A, Wang C Y, Liao H M. YOLOv4: optimal speed and accuracy of object detection[PP/OL]. V1. arXiv (2020-04-23) [2024-10-12]. https://doi.org/10.48550/arXiv.2004.10934.
|
| [7] |
Li C Y, Li L L, Jiang H L, et al. YOLOv6: a single-stage object detection framework for industrial applications[PP/OL]. V1. arXiv (2022-09-07) [2024-10-14]. https://doi.org/10.48550/arXiv.2209.02976.
|
| [8] |
Wang C Y, Bochkovskiy A, Liao H M. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2023: 7464-7475.
|
| [9] |
Tian Z, Shen C H, Chen H, et al. FCOS: fully convolutional one-stage object detection[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2019: 9626-9635.
|
| [10] |
Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2014: 580-587.
|
| [11] |
Ren S Q, He K M, Girshick R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. doi: 10.1109/TPAMI.2016.2577031
|
| [12] |
蒲玲玲, 杨柳. 改进YOLOv5的多车辆目标实时检测及跟踪算法[J]. 科学技术与工程, 2023, 23(28): 12159-12167. doi: 10.3969/j.issn.1671-1815.2023.28.031
Pu Lingling, Yang Liu. Improved real-time detection and tracking algorithm for multi vehicle targets in YOLOv5[J]. Science Technology and Engineering, 2023, 23(28): 12159-12167. doi: 10.3969/j.issn.1671-1815.2023.28.031
|
| [13] |
Abdelali H A, Derrouz H, Zennayi Y, et al. Multiple hypothesis detection and tracking using deep learning for video traffic surveillance[J]. IEEE Access, 2021, 9: 164282-164291. doi: 10.1109/ACCESS.2021.3133529
|
| [14] |
Hassaballah M, Kenk M A, Muhammad K, et al. Vehicle detection and tracking in adverse weather using a deep learning framework[J]. IEEE Transactions on Intelligent Transportation Systems, 2021, 22(7): 4230-4242. doi: 10.1109/TITS.2020.3014013
|
| [15] |
Zhang X X, Story B, Rajan D. Night time vehicle detection and tracking by fusing vehicle parts from multiple cameras[J]. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(7): 8136-8156. doi: 10.1109/TITS.2021.3076406
|
| [16] |
Jin J N, Wu Y F, Gao J P. Research on target detection and tracking algorithm for campus driverless vehicle based on improved DeepSORT[C]//2022 China Automation Congress (CAC). Piscataway: IEEE, 2022: 1304-1308.
|
| [17] |
Tian Z L, Wahab M N A, Akbar M F, et al. SFFSORT multi-object tracking by shallow feature fusion for vehicle counting[J]. IEEE Access, 2023, 11: 76827-76841. doi: 10.1109/ACCESS.2023.3297190
|
| [18] |
Choi J, Ha S, Lee Y, et al. Vehicle tracking system in drone imagery with YOLOv5 and histogram[C]//2023 62nd Annual Conference of the Society of Instrument and Control Engineers (SICE). Piscataway: IEEE, 2023: 778-783.
|
| [19] |
华泽玺, 施会斌, 罗彦, 等. 基于轻量级YOLO-v4模型的变电站数字仪表检测识别[J]. 西南交通大学学报, 2024, 59(1): 70-80. doi: 10.3969/j.issn.0258-2724.20210544
Hua Zexi, Shi Huibin, Luo Yan, et al. Detection and recognition of digital instruments based on lightweight YOLO-v4 model at substations[J]. Journal of Southwest Jiaotong University, 2024, 59(1): 70-80. doi: 10.3969/j.issn.0258-2724.20210544
|
| [20] |
Woo S, Park J, Lee J Y, et al. CBAM: convolutional block attention module[C]//Computer Vision– ECCV 2018. Cham: Springer International Publishing, 2018: 3-19.
|
| [21] |
Liu Z, Lin Y T, Cao Y, et al. Swin transformer: hierarchical vision transformer using shifted windows[C]//2021 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2021: 9992-10002.
|
| [22] |
Wang J Q, Chen K, Xu R, et al. CARAFE: content-aware reassembly of features[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE, 2019: 3007-3016.
|
| [23] |
胡欣, 胡帅, 马丽军, 等. 基于融合MBAM与YOLOv5的PCB缺陷检测方法[J]. 图学学报, 2024, 45(1): 47-55. doi: 10.11996/JG.j.2095-302X.2024010047
Hu Xin, Hu Shuai, Ma Lijun, et al. PCB defect detection method based on fusion of MBAM and YOLOv5[J]. Journal of Graphics, 2024, 45(1): 47-55. doi: 10.11996/JG.j.2095-302X.2024010047
|
| [24] |
Wojke N, Bewley A, Paulus D. Simple online and realtime tracking with a deep association metric[C]//2017 IEEE International Conference on Image Processing (ICIP). Piscataway: IEEE, 2017: 3645-3649.
|
| [25] |
Bewley A, Ge Z Y, Ott L, et al. Simple online and realtime tracking[C]//2016 IEEE International Conference on Image Processing (ICIP). Piscataway: IEEE, 2016: 3464-3468.
|
| [26] |
Zagoruyko S, Komodakis N. Wide residual networks[PP/OL]. V4. arXiv (2017-06-14)[2024-09-20]. https://doi.org/10.48550/arXiv.1605.07146.
|
| [27] |
Hu J, Shen L, Sun G. Squeeze-and-excitation networks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE, 2018: 7132-7141.
|
| [28] |
Wen L Y, Du D W, Cai Z W, et al. UA-DETRAC: a new benchmark and protocol for multi-object detection and tracking[J]. Computer Vision and Image Understanding, 2020, 193: 102907. doi: 10.1016/j.cviu.2020.102907
|
| [29] |
Lou Y H, Bai Y, Liu J, et al. VERI-wild: a large dataset and a new method for vehicle re-identification in the wild[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2019: 3230-3238.
|
| [30] |
Wang Q L, Wu B G, Zhu P F, et al. ECA-net: efficient channel attention for deep convolutional neural networks[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2020: 11531-11539.
|
| [31] |
Hou Q B, Zhou D Q, Feng J S. Coordinate attention for efficient mobile network design[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE, 2021: 13708-13717.
|