WU Liequan, ZHOU Zhifeng, SHI Yun, REN Pulin. 3D point cloud segmentation algorithm based on fused DenseNet and PointNet[J]. Journal of Applied Optics, 2024, 45(5): 982-991. DOI: 10.5768/JAO202445.0502006
Citation: WU Liequan, ZHOU Zhifeng, SHI Yun, REN Pulin. 3D point cloud segmentation algorithm based on fused DenseNet and PointNet[J]. Journal of Applied Optics, 2024, 45(5): 982-991. DOI: 10.5768/JAO202445.0502006

3D point cloud segmentation algorithm based on fused DenseNet and PointNet

More Information
  • Received Date: September 03, 2023
  • Revised Date: January 26, 2024
  • Available Online: September 01, 2024
  • Point cloud segmentation is crucial for key tasks, including intelligent driving, object recognition and detection, as well as reverse engineering. PointNet represents a direct point cloud data processing approach widely utilized in point cloud segmentation tasks. Nevertheless, it is associated with low segmentation accuracy and the computational cost of PointNet++ is high. Aiming at the above problems, an algorithm combining DenseNet and PointNet was proposed for the segmentation of point clouds. A three-branch hybrid attention mechanism was introduced to enhance PointNet capability to extract local features. DenseNet-STN and DenseNet-MLP structures were proposed to substitute spatial transformation networks (STNs) and multi-layer perceptrons (MLPs) in PointNet, in line with the dense connected convolutional networks (DenseNet) concept. At the same time, the add connection in DenseBlock, rather than the Concat connection, to enhance the accuracy of point feature correlation, without imposing significant complexity to the model. DenseNet-PointNet demonstrates effective generalization ability for complex classification problems and facilitates better function approximation, thereby improving the precision of point cloud segmentation. The findings of the effectiveness and ablation experiments show that the proposed algorithm performs well. The results of the point cloud segmentation experiments indicate that the intersection and concatenation ratio (IoU) of DenseNet-PointNet is superior to that of PointNet in most categories, and also higher than that of PointNet++ in some categories. DenseNet-PointNet achieves this with only 47.6% of the parameters of PointNet++, and 49.1% of the floating point operations (FLOPs). Therefore, these experimental results confirm the feasibility and availability of DenseNet-PointNet.

  • [1]
    WU B, ZHOU X, ZHAO S, et al. Squeezesegv2: improved model structure and unsupervised domain adaptation for road-object segmentation from a lidar point cloud[C]//2019 International Conference on Robotics and Automation (ICRA). New York: IEEE, 2019: 4376-4382.
    [2]
    LIU S, WANG Y, YANG X, et al. Deep learning in medical ultrasound analysis: a review[J]. Engineering, 2019, 5(2): 261-275. doi: 10.1016/j.eng.2018.11.020
    [3]
    TCHAPMI L, CHOY C, ARMENI I, et al. Segcloud: semantic segmentation of 3d point clouds[C]//2017 International Conference on 3D Vision (3DV). New York: IEEE, 2017: 537-547.
    [4]
    HU S M, CAI J X, LAI Y K. Semantic labeling and instance segmentation of 3D point clouds using patch context analysis and multiscale processing[J]. IEEE Transactions on Visualization and Computer Graphics, 2018, 26(7): 2485-2498.
    [5]
    KALOGERAKIS E, HERTZMANN A, SINGH K. Learning 3D mesh segmentation and labeling[J]. ACM Transactions on Graphics (TOG), 2010, 29 (4) : 102: 1-12.
    [6]
    WANG P S, LIU Y, GUO Y X, et al. O-CNN: octree-based convolutional neural networks for 3d shape analysis[J]. ACM Transactions on Graphics (TOG), 2017, 36(4): 1-11.
    [7]
    CAO Z, HUANG Q, KARTHIK R. 3D object classification via spherical projections[C]//2017 International Conference on 3D Vision (3DV). New York: IEEE, 2017: 566-574.
    [8]
    QI C R, SU H, MO K, et al. Pointnet: deep learning on point sets for 3d classification and segmentation[C]//Proceedings of the IEEE Conference On Computer Vision and Pattern Recognition. New York: IEEE, 2017: 652-660.
    [9]
    DENG H, BIRDAL T, ILIC S. Ppfnet: global context aware local features for robust 3d point matching[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2018: 195-205.
    [10]
    JIANG M, WU Y, ZHAO T, et al. Pointsift: a sift-like network module for 3d point cloud semantic segmentation[EB/OL]. (2018-07-02)[2023-08-31]. http://arxiv.org/abs/1807.00652v1.
    [11]
    QI C R, YI L, SU H, et al. Pointnet++: Deep hierarchical feature learning on point sets in a metric space[J]. Advances in Neural Information Processing Systems, 2017, 30: 1745976.
    [12]
    HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2016: 770-778.
    [13]
    HUANG G, LIU Z, VAN D M L, et al. Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2017: 4700-4708.
    [14]
    LEE C Y, XIE S, GALLAGHER P, et al. Deeply-supervised nets[C]//Artificial Intelligence and Statistics. [S. l. ]: PMLR, 2015: 562-570.
  • Related Articles

    [1]SUN Yanan, CHEN Ping, PAN Jinxiao. Low-dose CT denoising using combination of multi-scale residuals and global attention[J]. Journal of Applied Optics, 2025, 46(2): 292-299. DOI: 10.5768/JAO202546.0202001
    [2]CHEN Qingjiang, YIN Lexuan, SHAO Luoyi. Image super-resolution reconstruction based on multi-scale two-stage network[J]. Journal of Applied Optics, 2023, 44(6): 1343-1354. DOI: 10.5768/JAO202344.0602004
    [3]HE Lin, MA Guolu, SONG Zijun, ZHAO Yong, ZENG Guoying, RAO Jian. Attitude combined measurement method in large-scale obstructed space[J]. Journal of Applied Optics, 2022, 43(1): 95-99. DOI: 10.5768/JAO202243.0103004
    [4]LI Zhipeng, ZHAO Changming, ZHANG Haiyang, ZHANG Zilong, WU Xuan. Application of multi-scale fusion super-resolution algorithm in UAV detection[J]. Journal of Applied Optics, 2021, 42(3): 462-473. DOI: 10.5768/JAO202142.0302003
    [5]Yan Zongqun, Yang Jianchang, Xie Zhihong, Yu Hao, Shi Yunsheng. Optical axis parallelism calibration system of large scale multispectral multioptical axis[J]. Journal of Applied Optics, 2016, 37(6): 823-838. DOI: 10.5768/JAO201637.0601007
    [6]Fu Qiang, Sun Xiu-xia, Liu Shu-guang, Hong Yang, Peng Ke. Novel accurate direction detection method of small-scale motion blurred image[J]. Journal of Applied Optics, 2015, 36(5): 748-754. DOI: 10.5768/JAO201536.0502004
    [7]CHEN Dong, LIN Jian-lin, MA De-bao. Small electro-optical target detection based on two-scale wavelet analysis[J]. Journal of Applied Optics, 2011, 32(3): 492-497.
    [8]HUANG Li-hong. Fog-degraded image enhancement based on single-scale Retinex[J]. Journal of Applied Optics, 2010, 31(5): 728-733.
    [9]FENG Xiao-xia, WANG Ming-quan, ZHAO Yue-ping, GAO Yuan-fei. An edge detection algorithm based on multi-scale tensor[J]. Journal of Applied Optics, 2010, 31(3): 451-454.
    [10]SHAO Jun, HUA Wen-shen, ZHOU Zhong-liang, GAN Hou-ji. Optical correlation image recognition technology to resist scale distortion[J]. Journal of Applied Optics, 2008, 29(4): 503-507.
  • Cited by

    Periodical cited type(1)

    1. 丁一飞, 王永红, 胡悦, 黄安琪, 但西佐. 样本块匹配光栅投影阶梯标定方法. 中国测试. 2016(08): 7-12 .

    Other cited types(2)

Catalog

    Article views (100) PDF downloads (36) Cited by(3)

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return