LIAO Yanna, DOU Danyang. Design and research of bridge cracks detection method based on Mask RCNN[J]. Journal of Applied Optics, 2022, 43(1): 100-105, 118. DOI: 10.5768/JAO202243.0103005
Citation: LIAO Yanna, DOU Danyang. Design and research of bridge cracks detection method based on Mask RCNN[J]. Journal of Applied Optics, 2022, 43(1): 100-105, 118. DOI: 10.5768/JAO202243.0103005

Design and research of bridge cracks detection method based on Mask RCNN

More Information
  • Received Date: August 11, 2021
  • Revised Date: September 28, 2021
  • Available Online: October 19, 2021
  • The crack is a common disease on bridges and roads. Aiming at the problem that its detection accuracy needs to be improved, a bridge cracks detection algorithm based on Mask region-based convolutional neural networks (RCNN) was proposed, and a semantic enhancement module (SEM) was designed. Combined this module with feature pyramid network (FPN), a new multi-scale feature map was obtained by feature fusion. In view of the complexity and diversity of crack forms and the difficulty of identification, the cracks were divided into two categories for detection, and two strategies were formulated for comparative experiments. The results show that the improved method can get better detection results, the detection accuracy can reach to 99.8%, and the mean average precision (mAP) can be improved by 12.6%.

  • [1]
    郭素明. 道路桥梁养护中常见病害与维护方法探析[J]. 工程技术研究,2018(15):247-248. doi: 10.3969/j.issn.1671-3818.2018.15.115

    GUO Suming. Analysis on common diseases and maintenance methods in road and bridge maintenance[J]. Engineering technology research,2018(15):247-248. doi: 10.3969/j.issn.1671-3818.2018.15.115
    [2]
    杨杰文, 章光, 陈西江, 等. 基于深度学习的较复杂背景下桥梁裂缝检测[J]. 铁道科学与工程学报,2020,17(11):2722-2728.

    YANG Jiewen, ZHANG Guang, CHEN Xijiang, et al. Research on bridge crack detection based on deep learning under complex background[J]. Journal of Railway Science and Engineering,2020,17(11):2722-2728.
    [3]
    韩晓健, 赵志成. 基于计算机视觉技术的结构表面裂缝检测方法研究[J]. 建筑结构学报,2018,39(增刊1):418-427.

    HAN Xiaojian, ZHAO Zhicheng. Structural surface crack detection method based on computer vision technology[J]. Journal of Building Structures,2018,39(S1):418-427.
    [4]
    张海川, 彭博, 许伟强. 基于UNet++及条件生成对抗网络的道路裂缝检测[J]. 计算机应用,2020,40(增刊2):158-161.

    ZHANG Haichuan, PENG Bo, XU Weiqiang. Road crack detection based on UNet++ and conditional generative adversarial nets[J]. Journal of Computer Applications,2020,40(S2):158-161.
    [5]
    WANG Sen, WU Xing, ZHANG Yinghui, et al. A neuralnetwork ensemble method for effective crack segmentation using fully convolutional networks and multi-scale structured forests[J]. Machine Vision and Applications,2020,31(7/8):16-30.
    [6]
    THIRUPPATHIRAJ S, KUMAR U, BUCHKE S. Automatic pothole classification and segmentation using android smartphone sensors and camera images with machine learning techniques[C]//2020 IEEE Region 10 Conference (Tencon). Osaka, Japan.USA: IEEE, 2020: 1386-1391.
    [7]
    侯腾璇, 赵涓涓, 强彦, 等. CRF 3D-UNet肺结节分割网络[J]. 计算机工程与设计,2020,41(6):1663-1669.

    HOU Tengxuan, ZHAO Juanjuan, QIANG Yan, et al. Pulmonary nodules segmentation based on CRF 3D-UNet structure[J]. Computer Engineering and Design,2020,41(6):1663-1669.
    [8]
    ATTIQUE K M, TALLHA A, ZHANG Y D, et al. Attrib-utes based skin lesion detection and recognition: a maskRCNN and transfer learning-based deep learning framework[J]. Pattern Recognition Letters,2021,143:58-66.
    [9]
    REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE,2017,39(1):1137-1149.
    [10]
    OLIVEIRA H, CORREIA P L. Road surface crack detection: improved segmentation with pixel-basedrefinement[C]. 2017 25th European Signal Processing Conference (EUSIPCO), Greek KOS.USA: IEEE: 2017, 2026-2030.
    [11]
    雷斯达, 曹鸿猷, 康俊涛. 基于深度学习的复杂场景下混凝土表面裂缝识别研究[J]. 公路交通科技,2020,37(12):80-88. doi: 10.3969/j.issn.1002-0268.2020.12.011

    LEI S D, CAO Hongyou, KANG Juntao. Study on concrete surface crack recognition in complex scenario based on deep learning[J]. Journal of Highway and Transportation Research and Development,2020,37(12):80-88. doi: 10.3969/j.issn.1002-0268.2020.12.011
    [12]
    CHEN F C, JAHANSHAHI R M. Deep learning-based crack detection using convolutional neural networkand naïve bayes data fusion[J]. IEEE,2018,65(5):4392-4440.
    [13]
    RAZA A, HONG H, FANG T. PFAF-net: pyramid feature network for multimodal fusion[J]. IEEE Sensors Letters, 2020, 4(12) : 1-4.
    [14]
    孙鸿宇, 何远, 王基策, 等. 人工智能技术在安全漏洞领域的应用[J]. 通信学报,2018,39(8):1-17. doi: 10.11959/j.issn.1000-436x.2018137

    SUN Hongyu, HE Yuan, WANG Jice, et al. Application of artificial intelligence technology in the field of security vulnerability[J]. Journal on Communications,2018,39(8):1-17. doi: 10.11959/j.issn.1000-436x.2018137
    [15]
    DUAN K, BAI S, XIE L, et al. Centernet: keypoint-triplets for object detection[C]//IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South).USA:IEEE,2019: 6568-6577.
    [16]
    HEI L, JIA D. Cornernet: detecting objects as paired key-points[J]. International Journal of Computer Vision,2020,128(2):642-656.
    [17]
    杨洋, 何飞, 李洁. 公路桥梁病害分类与编码构建方法[J]. 北方交通,2020(11):28-31.

    YAG Yang, HE Fei, LI Jie. Classification and coding method of highway bridge diseases[J]. Northern Communications,2020(11):28-31.
    [18]
    朱苏雅, 杜建超, 李云松, 等. 采用U-Net卷积网络的桥梁裂缝检测方法[J]. 西安电子科技大学学报,2019,46(4):35-42.

    ZHU Suya, DU Jianchao, LI Yunsong, et al. Method for bridge crack detection based on the U-Net convolutional networks[J]. Journal of Xidian University,2019,46(4):35-42.
    [19]
    ERTAM F, AYDIN G. Data classification with deeplearning using Tensorflow[C]//2017 International Conference on Computer Science and Engineering (UBMK), Antalya. USA:IEEE,2017: 755-758.
  • Related Articles

    [1]HE Zehao, WANG Hongyuan, MIN Rui, CAO Liangcai. Research progress and applications of near-field goniophotometer[J]. Journal of Applied Optics, 2024, 45(1): 17-25. DOI: 10.5768/JAO202445.0101003
    [2]TANG Li, PENG Yong-jun. Numerical simulation on nonlinear transmissive characteristicsof fiber Bragg grating[J]. Journal of Applied Optics, 2011, 32(2): 308-316.
    [3]LIU Quan-xi, ZHONG Ming. Temperature and thermal stress distribution in thin disk laser end-pumped by LD[J]. Journal of Applied Optics, 2010, 31(4): 636-640.
    [4]GAO Feng, ZHU Shi-guo. Relationship between group velocity and phase velocity of the mode-field on multi-mode fiber[J]. Journal of Applied Optics, 2010, 31(4): 611-616.
    [5]WANG Long, SHEN Xue-ju, HAN Yu-dong, LI Zheng. Intensity distribution of Gaussian beam transmitting through medium with nonlinear refraction and absorption[J]. Journal of Applied Optics, 2010, 31(1): 164-168.
    [6]ZHANG Biao, GAO Wei, YANG Zhao-jin, YANG Hong-ru. Light field distribution in side-pumped rod-shaped laser medium of laser diode arrays[J]. Journal of Applied Optics, 2009, 30(2): 338-343.
    [7]XU Qin-chang, LIU Shu-ping, GUO Yun-xiang. Analysis and design of Ge0.05Si0.95/Si heterojunction single-mode coplanar Bragg reflection waveguide grating[J]. Journal of Applied Optics, 2008, 29(5): 763-766.
    [8]WANG Xue-jun, LU Ya-xiong, WANG Zhi-gang. Planar optical waveguide mode in biosensing[J]. Journal of Applied Optics, 2008, 29(4): 644-648.
    [9]WANG Hong-hong, CHEN Fang-bin, JIANG Tao. Double mode control arithmetic employed in nonlinear position servo system[J]. Journal of Applied Optics, 2008, 29(supp): 18-20.
    [10]WANG Ren-zhe, ZHANG Rong-zeng, XU Zhi-qiang, HU Ye-lin. A Study on Effect of Refractive Index on Scattered Light Field Distribution[J]. Journal of Applied Optics, 2004, 25(3): 15-16.

Catalog

    Article views (654) PDF downloads (49) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return