Volume 44 Issue 1
Jan.  2023
Turn off MathJax
Article Contents
WANG Yi, GONG Xiaojie, SU Hao. Image segmentation method of surface defects for metal workpieces based on improved U-net[J]. Journal of Applied Optics, 2023, 44(1): 86-92. doi: 10.5768/JAO202344.0102004
Citation: WANG Yi, GONG Xiaojie, SU Hao. Image segmentation method of surface defects for metal workpieces based on improved U-net[J]. Journal of Applied Optics, 2023, 44(1): 86-92. doi: 10.5768/JAO202344.0102004

Image segmentation method of surface defects for metal workpieces based on improved U-net

doi: 10.5768/JAO202344.0102004
  • Received Date: 2022-03-24
  • Rev Recd Date: 2022-09-06
  • Available Online: 2022-11-29
  • Publish Date: 2023-01-17
  • For the small-size defects of metal workpiece surface and the difficult segmentation of image defects due to non-uniform illumination, an improved U-net semantic segmentation network was proposed to achieve accurate image segmentation of surface defects for metal workpieces. Firstly, the convolutional block attention module (CBAM) was integrated into the U-net netwok to improve the significance of the defective targets in the image. Secondly, part of the traditional convolution in the network was replaced by depthwise over-parameterized convolution (DO-Conv) to increase the number of learnable parameters of the network. Then, the Leaky Relu function was used instead of the partial Relu function in the network to improve the feature extraction ability of the model for the negative intervals. Finally, the median filtering and non-uniform illumination compensation method were used for image preprocessing, so as to reduce the effect of non-uniform illumination on the surface defects of metal workpiece images. The results show that the improved network mean intersection over union, accuracy rate and Dice coefficient index reaches 0.833 5, 0.933 2 and 0.867 4, respectively. The improved network significantly improves the segmentation effect of surface defect images of metal workpieces.
  • loading
  • [1]
    赵鹤, 杨晓洪, 杨奇, 等. 融合注意力机制的金属缺陷图像分割方法[J]. 光电子·激光,2021,32(4):403-408. doi: 10.16136/j.joel.2021.04.0411

    ZHAO He, YANG Xiaohong, YANG Qi, et al. Metal defect image segmentation algorithm combined with attention mechanism[J]. Journal of Optoelectronics·Laser,2021,32(4):403-408. doi: 10.16136/j.joel.2021.04.0411
    HE J W, ZHAO C D, GAO R Y, et a1. Life prediction model of machine tool based on deep learning[J]. International Journal of Plant Engineering and Management,2021,26(1):1-15.
    WU W H, GAO L, DUAN H H, et al. Segmentation of pulmonary nodules in CT images based on 3D-UNEF combined with three-dimensional conditional random field optimization[J]. Medical Physics,2020,47(9):4054-4063. doi: 10.1002/mp.14248
    TAO X, ZHANG D P, MA W Z, et al. Automatic metallic surface defect detection and recognition with convolutional neural networks[J]. Applied Sciences,2018,8(9):1575. doi: 10.3390/app8091575
    ZHANG K H, WANG W D, LUY Z Q, et al. Computer vision detection of foreign objects in coal processing using attention CNN[J]. Engineering Applications of Artificial Intelligence,2021,102:104242-104253. doi: 10.1016/j.engappai.2021.104242
    LI J Y, SU Z F, GENG J H, et al. Real-time detection of steel strip surface defects based on improved YOLO detection network[J]. IFAC-Papers Online,2018,51(21):76-81. doi: 10.1016/j.ifacol.2018.09.412
    徐建桥, 吴俊, 陈向成, 等. 基于规范化样本拆分的轴承缺陷检测[J]. 应用光学,2021,42(2):327-333. doi: 10.5768/JAO202142.0203006

    XU Jianqiao, WU Jun, CHEN Xiangcheng, et al. Bearing defects detection based on standardized sample split[J]. Journal of Applied Optics,2021,42(2):327-333. doi: 10.5768/JAO202142.0203006
    XIAO Z T, LIU B W, GENG L, et al. Segmentation of lung nodules using improved 3D-UNet neural network[J]. Symmetry,2020,12(11):1787. doi: 10.3390/sym12111787
    卢印举, 郝志萍, 戴曙光. 融合双特征的玻璃缺陷图像分割算法[J]. 包装工程,2021,42(23):162-169. doi: 10.19554/j.cnki.1001-3563.2021.23.023

    LU Yinju, HAO Zhiping, DAI Shuguang. Glass defect image segmentation algorithm fused with dual features[J]. Packaging Engineering,2021,42(23):162-169. doi: 10.19554/j.cnki.1001-3563.2021.23.023
    YE M, ZHANG W W, CUI G H, et al. Surface defects inspection of cylindrical metal workpieces based on weakly supervised learning[J]. International Journal of Advanced Manufacturing Technology,2022,119(3/4):1933-1949.
    曹富强, 王明泉, 张俊生, 等. 基于深度学习的铸件X射线图像分割研究[J]. 应用光学,2021,42(6):1025-1033. doi: 10.5768/JAO202142.0602003

    CAO Fuqiang, WANG Mingquan, ZHANG Junsheng, et al. Casting X-ray image segmentation based on deep learning[J]. Journal of Applied Optics,2021,42(6):1025-1033. doi: 10.5768/JAO202142.0602003
    HOU Y W, LIU Z Y, ZHANG T, et al. C-UNet: Complement UNet for remote sensing road extraction[J]. Sensors,2021,21(6):2153. doi: 10.3390/s21062153
    FU H X, SONG G Q, WANG Y C, et al. Improved YOLOv4 marine target detection combined with CBAM[J]. Symmetry,2021,13(4):623. doi: 10.3390/sym13040623
    王粉花, 张强, 黄超, 等. 融合双流三维卷积和注意力机制的动态手势识别[J]. 电子与信息学报,2021,43(5):1389-1396. doi: 10.11999/JEIT200065

    WANG Fenhua, ZHANG Qiang, HUANG Chao, et al. Dynamic gesture recognition combining two stream three-dimensional convolution and attention mechanism[J]. Journal of Electronics and Information,2021,43(5):1389-1396. doi: 10.11999/JEIT200065
    高淑萍, 赵清源, 齐小刚, 等. 改进的MobileNet 的图像分类方法研究[J]. 智能制造学报,2021,16(1):11-20.

    GAO Shuping, ZHAO Qingyuan, QI Xiaogang, et al. Research on the improved image classification method of MobileNet[J]. CAAI Transactions on Intelligent Systems,2021,16(1):11-20.
  • 加载中


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索
    Article views (48) PDF downloads(9) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint