Volume 23 Issue 1
Feb.  2023
Turn off MathJax
Article Contents
ZHANG Nian, ZHANG Liang. Type recognition of highway trucks based on deep learning[J]. Journal of Traffic and Transportation Engineering, 2023, 23(1): 267-279. doi: 10.19818/j.cnki.1671-1637.2023.01.020
Citation: ZHANG Nian, ZHANG Liang. Type recognition of highway trucks based on deep learning[J]. Journal of Traffic and Transportation Engineering, 2023, 23(1): 267-279. doi: 10.19818/j.cnki.1671-1637.2023.01.020

Type recognition of highway trucks based on deep learning

doi: 10.19818/j.cnki.1671-1637.2023.01.020
Funds:

National Natural Science Foundation of China 52178341

Research Project of Shanxi Scholarship Council 2020038

More Information
  • Author Bio:

    ZHANG Nian(1984-), male, associate professor, PhD, zhangnian@tyut.edu.cn

  • Received Date: 2022-07-31
    Available Online: 2023-03-08
  • Publish Date: 2023-02-25
  • A deep learning-based fine target detection method for highway trucks and their wheel axles was proposed to determine the vehicle types of highway trucks and improve the recognization speed and accuracy of vehicle types of trucks. 16 403 side images of trucks were obtained by the road monitoring and network crawling to build a dataset of side images of trucks. The Retinex theory and visual enhancement methods, such as the contrast limited adaptive histogram equalization (CLAHE), were used to preprocess the uneven light images and night vision ones in the collected images. Theoretical analysis and comparative experiments were conducted. The one-stage detection network YOLOv3 was selected as the target detection network for the vehicle type recognition of highway trucks. Then, the detection model was optimized from three aspects, such as adjusting the sizes of prior box and model input and introducing the attention mechanism. For the case that multiple trucks might appear at the same time in a single image, an algorithm based on the mining of target location information was employed to analyze the truck and wheel axle location information. A method was proposed to determine the subordinate relationships between the highway truck and the wheel axle according to the location information of axle center points and truck prediction boxes. Research results show that the vehicle feature information can be enhanced significantly by the image preprocessing. The network performance of the detection model improves after the optimization. The issue of determining the vehicle types of trucks can be well solved by mining and leveraging the target location information. A real-time detection speed of the optimized detection model reaches 47 frames per second. The comprehensive accuracy in recognizing the vehicle types of highway trucks is 94.4%. The method realizes the non-contact, fast, and accurate recognition of vehicle types of highway trucks, provides a new means for the vehicle type recognition of highway trucks. Meeting the construction needs of intelligent traffic systems, the proposed method can be applied to further raise the road service level.

     

  • loading
  • [1]
    WANG Yue. Research on vehicle retrieval technology in monitoring video based on multi-feature fusion[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2019. (in Chinese)
    [2]
    TAN Ting, WANG Wei-feng, WAN Jian, et al. Research of traffic flow detecting system based on multiple loop detectors[J]. Journal of East China Jiaotong University, 2017, 34(2): 60-65. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-HDJT201702008.htm
    [3]
    ZHANG Qi, HU Bin, CHEN Le, et al. Image method of shaft ultrasonic detection based on beam diffusion[J]. Journal of Applied Acoustics, 2020, 39(4): 570-580. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-YYSN202004012.htm
    [4]
    ZHANG Xiao-juan, ZOU Cun-ming. Research on automatic detection and location of parking space based on laser sensing technology[J]. Laser Journal, 2020, 41(11): 37-41. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JGZZ202011008.htm
    [5]
    KIM J, YOU K, CHOI H. Post-voltage-boost circuit-supported single-ended class-B amplifier for piezoelectric transducer applications[J]. Sensors, 2020, 20(18): 5412. doi: 10.3390/s20185412
    [6]
    PAPAGEORGIOU C P, OREN M, POGGIO T. A general framework for object detection[C]//PAPAGEORGIOU C P. Sixth IEEE International Conference on Computer Vision. New York: IEEE, 1998: 555-562.
    [7]
    LIENHART R, MAYDT J. An extended set of haar-like features for rapid object detection[C]//LIENHART R. IEEE International Conference on Image Processing. New York: IEEE, 2002: 900-903.
    [8]
    VIOLA P, JONES M J. Robust real-time face detection[J]. International Journal of Computer Vision, 2004, 57(2): 137-154. doi: 10.1023/B:VISI.0000013087.49260.fb
    [9]
    LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110. doi: 10.1023/B:VISI.0000029664.99615.94
    [10]
    FELZENSZWALB P F, GIRSHICK R B, MCALLESTER D, et al. Object detection with discriminatively trained part-based models[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(9): 1627-1645. doi: 10.1109/TPAMI.2009.167
    [11]
    DALAL S, VISHWAKARMA V P, KUMAR S. Feature- based sketch-photo matching for face recognition[J]. Procedia Computer Science, 2020, 167: 562-570. doi: 10.1016/j.procs.2020.03.318
    [12]
    GENG Qing-tian, YU Fan-hua, WANY Yu-ting, et al. New algorithm for vehicle type detection based on feature fusion[J]. Journal of Jilin University (Engineering and Technology Edition), 2018, 48(3): 929-935. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JLGY201803037.htm
    [13]
    PEI Yue-ling, ZHANG Tao. Vehicle number plate and vehicle identification system based on artificial intelligence[J]. Highway, 2019, 64(8): 277-281. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-GLGL201908055.htm
    [14]
    LI Guo-liang, ZHOU Xuan-he, SUN Ji, et al. A survey of machine learning based database techniques[J]. Chinese Journal of Computers, 2020, 43(11): 2019-2049. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSJX202011001.htm
    [15]
    LI Xun, LIU Yao, LI Peng-fei, et al. Vehicle multi-target detection method based on YOLOv2 algorithm under Darknet framework[J]. Journal of Traffic and Transportation Engineering, 2018, 18(6): 142-158. (in Chinese) doi: 10.19818/j.cnki.1671-1637.2018.06.015
    [16]
    LI Zhe-ming, CAI Hong-ming, JIANG Li-hong. Car make and model recognition based on convolutional neural network[J]. Journal of Donghua University(Natural Science), 2017, 43(4): 472-477. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-DHDZ201704003.htm
    [17]
    YUAN Gong-ping, TANG Yi-ping, HAN Wang-ming, et al. Vehicle category recognition based on deep convolutional neural network[J]. Journal of Zhejiang University (Engineering Science), 2018, 52(4): 694-702. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-ZDZC201804012.htm
    [18]
    CHEN Li-chao, ZHANG Lei, CAO Jian-fang, et al. Vehicle classification based on HOG-C CapsNet in traffic surveillance scenarios[J]. Journal of Computer Applications, 2020, 40(10): 2881-2889. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSJY202010015.htm
    [19]
    CHEN Shu-dong. Vehicle detection and vehicle type identification algorithm based on convolutional neural network[D]. Chengdu: University of Electronic Science and Technology of China, 2018. (in Chinese)
    [20]
    HE Tian. Research on truck model recognition system based on neural network[D]. Xi'an: Xi'an Technological University, 2019. (in Chinese)
    [21]
    HUANG Tao. Application of piezoelectric thin film sensor in automatic vehicle classification[J]. Sensor World, 2017, 23(7): 21-24. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-CGSJ201707003.htm
    [22]
    XIA Fa-qin. The principle and realization of using ground induction coils detection motor vehicles[D]. Wuhan: Wuhan University of Science and Technology, 2011. (in Chinese)
    [23]
    GUO Min. Research on vehicle detection and tracking based on the large trucks illegal lane highway monitoring system[D]. Chengdu: Southwest Jiaotong University, 2015. (in Chinese)
    [24]
    ZHOU Jun-yu, ZHAO Yan-ming. Application of convolution neural network in image classification and object detection[J]. Computer Engineering and Applications, 2017, 53(13): 34-41. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG201713006.htm
    [25]
    JOBSON D J, RAHMAN Z, WOODELL G A. A multiscale Retinex for bridging the gap between color images and the human observation of scenes[J]. IEEE Transactions on Image Processing, 1997, 6(7): 965-976.
    [26]
    FUNT B, CIUREA F, MCCANN J. Retinex in MATLABTM[J]. Journal of Electronic Imaging, 2004, 13(1): 112-121.
    [27]
    MAJEED S H, ISA N A M. Adaptive entropy index histogram equalization for poor contrast images[J]. IEEE Access, 2020, 9: 6402-6437.
    [28]
    SANTOS J C M, CARRIJO G A, FÁTIMA DOS SANTOS CARDOSO C, et al. Fundus image quality enhancement for blood vessel detection via a neural network using CLAHE and Wiener filter[J]. Research on Biomedical Engineering, 2020, 36(2): 107-117.
    [29]
    SANG Jun, GUO Pei, XIANG Zhi-li, et al. Vehicle detection based on faster-RCNN[J]. Journal of Chongqing University, 2017, 40(7): 32-36. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-FIVE201707005.htm
    [30]
    JU Mo-ran, LUO Hai-bo, WANG Zhong-bo, et al. Improved YOLO v3 algorithm and its application in small target detection[J]. Acta Optica Sinica, 2019, 39(7): 0715004. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201907028.htm
    [31]
    ZHANG Ru-yi. Video object detection based on deep learning[D]. Beijing: Beijing Jiaotong University, 2020. (in Chinese)

Catalog

    Article Metrics

    Article views (1034) PDF downloads(180) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return