LI Hai-feng, WU Zhi-long, NIE Jing-jing, PENG Bo, GUI Zhong-cheng. Automatic crack detection algorithm for airport pavement based on depth image[J]. Journal of Traffic and Transportation Engineering, 2020, 20(6): 250-260. doi: 10.19818/j.cnki.1671-1637.2020.06.022
Citation: LI Hai-feng, WU Zhi-long, NIE Jing-jing, PENG Bo, GUI Zhong-cheng. Automatic crack detection algorithm for airport pavement based on depth image[J]. Journal of Traffic and Transportation Engineering, 2020, 20(6): 250-260. doi: 10.19818/j.cnki.1671-1637.2020.06.022

Automatic crack detection algorithm for airport pavement based on depth image

doi: 10.19818/j.cnki.1671-1637.2020.06.022
Funds:

National Key Research and Development Program of China 2019YFB1310601

More Information
  • Author Bio:

    LI Hai-feng(1984-), male, associate professor, PhD, lihf_cauc@126.com

  • Received Date: 2020-07-01
  • Publish Date: 2020-06-25
  • To detect small cracks in airport pavements under strong noise, weak illumination and low contrast, a crack detection algorithm for airport pavements based on depth images was designed. The collected depth image was divided into multiple grids, and each grid was expanded to obtain a local pavement region. For each grid region, the random sampling consensus algorithm was used to construct and optimally estimate the local cubic curved surface. On this basis, the global curved surface model of the entire image acquisition region of parement was generated by fusing the curved surface models of all grid regions under the global scale. Based on the difference image between the global curved surface model and the original depth image, candidate crack pixels were segmented by the adaptive threshold method, and various morphological constraints, such as the total number, length and length width ratio of crack pixels were used to screen the candidate crack pixels to eliminate the incorrect candidate crack pixels, so as to obtain the final crack detection results. The experiment was carried out on the airport pavement depth image datasets. The manual annotation results were taken as the ground truth. The accuracy, recall rate and F value were used as the quantitative evaluation indices. The proposed algorithm was compared with four representative traditional algorithms. Experiment result shows that the highest accuracy, recall rate and F value of the traditional algorithm are 77.05%, 41.02% and 50.02%, respectively. The proposed algorithm has obvious advantages in the accuracy, recall rate and F value, with average values of 91.20%, 97.99% and 94.12%, respectively. The proposed algorithm can detect the crack with the minimum width of 3 mm and the minimum length of 10 cm in the depth image with a resolution of 1 984×2 000, and realize the target of detecting small cracks in the complex airport pavement scene.

     

  • [1]
    SONG Hong-xun, WANG Wei-xing, WANG Feng-ping, et al. Pavement crack detection by ridge detection on fractional calculus and dual-thresholds[J]. International Journal of Multimedia and Ubiquitous Engineering, 2015, 10(4): 19-30. doi: 10.14257/ijmue.2015.10.4.03
    [2]
    ZHANG De-jin, LI Qing-quan, CHEN Ying, et al. Asphalt pavement crack detection based on spatial clustering featurel[J]. Acta Automatica Sinica, 2016, 42(3): 443-454. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201603010.htm
    [3]
    OLIVEIRA H, CORREIA P L. Crack IT—an image processing toolbox for crack detection and characterization[C]∥DETLEV M. 2014 IEEE International Conference on Image Processing (ICIP). New York: IEEE, 2014: 798-802.
    [4]
    AMHAZ R, CHAMBON S, IDIER J, et al. Automatic crack detection on 2D pavement images: an algorithm based on minimal path selection[J]. IEEE Transactions on Intelligent Transportation Systems, 2016, 17(10): 2718-2729. doi: 10.1109/TITS.2015.2477675
    [5]
    SHI Yong, CUI Li-meng, QI Zhi-quan, et al. Automatic road crack detection using random structured forests[J]. IEEE Transactions on Intelligent Transportation Systems, 2016, 17(12): 3434-3445. doi: 10.1109/TITS.2016.2552248
    [6]
    LI Liang-fu, MA Wei-fei, LI Li, et al. Research on detection algorithm for bridge cracks based on deep learning[J]. Acta Automatica Sinica, 2019, 45(9): 1727-1742. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-MOTO201909010.htm
    [7]
    SUN Zhao-yun, MA Zhi-dan, LI Wei, et al. Pavement crack identification method based on deep convolutional neural network fusion mode[J]. Journal of Chang'an University (Natural Science Edition), 2020, 40(4): 1-13. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-XAGL202004002.htm
    [8]
    KATAKAM N. Pavement crack detection system through localized thresholding[D]. Toledo: The University of Toledo, 2009.
    [9]
    XU Wei, TANG Zhen-min, LYU Jian-yong. Pavement crack detection based on image saliency[J]. Journal of Image and Graphics, 2018, 18(1): 69-77. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-ZGTB201301010.htm
    [10]
    QU Zhong, JU Fang-rong, CHEN Si-qi. Concrete surface cracks detection combining structured forest edge detection and percolation model[J]. Computer Science, 2018, 45(11): 295-298, 311. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-JSJA201811048.htm
    [11]
    CHAI Xue-song, ZHU Xing-yong, LI Jian-chao, et al. Tunnel lining crack identification algorithm based on deep convolutional neural network[J]. Railway Engineering, 2018, 58(6): 60-65. (in Chinese). doi: 10.3969/j.issn.1003-1995.2018.06.16
    [12]
    PRASANNA P, DANA K J, GUCUNSKI N, et al. Automated crack detection on concrete bridges[J]. IEEE Transactions on Automation Science and Engineering, 2014, 13(99): 1-9.
    [13]
    CAO Jin-gang, YANG Guo-tian, YANG Xi-yun. Pavement crack detection with deep learning based on attention mechanism[J]. Journal of Computer-Aided Design and Computer Graphics, 2020, 32(8): 1324-1333. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-JSJF202008014.htm
    [14]
    RODRÍGUEZ-MARTÍN M, LAGÜELA S, GONZÁLEZ-AGUILERA D, et al. Thermographic test for the geometric characterization of cracks in welding using IR image rectification[J]. Automation in Construction, 2016, 61: 58-65. doi: 10.1016/j.autcon.2015.10.012
    [15]
    XU Chang-hang, XIE Jing, CHEN Guo-ming, et al. An infrared thermal image processing framework based on superpixel algorithm to detect cracks on metal surface[J]. Infrared Physics and Technology, 2014, 67: 266-272. doi: 10.1016/j.infrared.2014.08.002
    [16]
    PARK H, CHOI M, PARK J, et al. A study on detection of micro-cracks in the dissimilar metal weld through ultrasound infrared thermography[J]. Infrared Physics and Technology, 2014, 62: 124-131. doi: 10.1016/j.infrared.2013.10.006
    [17]
    DHITAL D, LEE J R. A fully non-contact ultrasonic propagation imaging system for closed surface crack evaluation[J]. Experimental Mechanics, 2012, 52: 1111-1122. doi: 10.1007/s11340-011-9567-z
    [18]
    ILIOPOULOS S, AGGELIS D G, PYL L, et al. Detection and evaluation of cracks in the concrete buffer of the Belgian nuclear waste container using combined NDT techniques[J]. Construction and Building Materials, 2015, 78: 369-378. doi: 10.1016/j.conbuildmat.2014.12.036
    [19]
    HUANG Yu-chun, TSAI Y. Crack fundamental element (CFE) for multi-scale crack classification[C]//SCARPAS A. 7th RILEM International Conference on Cracking in Pavements. Berlin: Springer, 2012: 419-428.
    [20]
    PENG Bo, WANG K C P, CHEN Cheng. Automatic crack detection by multi-seeding fusion on 1 mm resolution 3D pavement images[C]∥AMIY V. T & amp; amp; DI Congress 2014. Reston: ASCE, 2014: 543-552.
    [21]
    LI Wei, HU Yan-ju, SHA Ai-min, et al. Two-scale clustering algorithm road pavement crack detection technology based on 3D data[J]. Journal of South China University of Technology (Natural Science Edition), 2015, 43(8): 99-105. (in Chinese). doi: 10.3969/j.issn.1000-565X.2015.08.015
    [22]
    CAO Ting, WANG Wei-xing, TIGHE S, et al. Crack image detection based on fractional differential and fractal dimension[J]. IET Computer Vision, 2019, 13(1): 79-85. doi: 10.1049/iet-cvi.2018.5337
    [23]
    SONG Kui-yang, XU Gui-li, LI Kai-yu, et al. Research on method of pavement crack detection based on structured light[J]. Machine Building and Automation, 2016(6): 223-228. (in Chinese). doi: 10.3969/j.issn.1671-5276.2016.06.060
    [24]
    MOHAMMAD R J, FARROKH J, SAMI F M, et al. Unsupervised approach for autonomous pavement-defect detection and quantification using an inexpensive depth sensor[J]. Journal of Computing in Civil Engineering, 2013, 27: 743-754. doi: 10.1061/(ASCE)CP.1943-5487.0000245
    [25]
    OUYANG W, XU B. Pavement cracking measurements using 3D laser-scan images[J]. Measurement Science and Technology, 2013, 24(10): 105204-1-9.
    [26]
    JIANG Bin, JIN Xiang-liang. Improved correction algorithm for harmonic- and intensity- related errors in time-of-flight cameras[J]. Acta Optica Sinica, 2020, 40(1): 0111024-1-10. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB202001025.htm
    [27]
    LI Zhan-li, ZHOU Kang, MU Qi, et al. TOF camera real-time high precision depth error compensation method[J]. Infrared and Laser Engineering, 2019, 48(12): 1213004-1-10. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-HWYJ201912035.htm
    [28]
    DU Rui-jian, GE Bao-zhen, CHEN Lei. Texture mapping of multi-view high-resolution images and binocular 3D point clouds[J]. Chinese Optics, 2020, 13(5): 1055-1064. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-ZGGA202005017.htm
    [29]
    DING Ying, FAN Jing-tao, SONG Tian-yu. Optimal forward design method for the binocular stereo vision inspection system[J]. Chinese Journal of Scientific Instrument, 2016, 37(3): 650-657. (in Chinese). doi: 10.3969/j.issn.0254-3087.2016.03.023
    [30]
    XU Zhi-gang, CHE Yan-li, LI Jin-long, et al. Research progress on automatic image processing technology for pavement distress[J]. Journal of Traffic and Transportation Engineering, 2019, 19(1): 172-190. (in Chinese). doi: 10.3969/j.issn.1671-1637.2019.01.017
    [31]
    LIU Fei, HE Chun-qiao, SHEN Ai-min, et al. Optimized compensation method of divisional projection for saturated region of structured light[J]. Acta Optica Sinica, 2018, 38(6): 0612001-1-8. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201806023.htm
    [32]
    CANNY J. A computational approach to edge detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, 8(6): 679-698.

Catalog

    Article Metrics

    Article views (1222) PDF downloads(301) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return