Fusion processing algorithm of single-photon detection for three-dimensional point cloud and visible light image

ZHANG Feifei; PENG Lei; YUAN Tao

doi:10.5768/JAO202142.0602004

Journal of Applied Optics > 2021 > 42(6): 1034-1039. > DOI: 10.5768/JAO202142.0602004

ZHANG Feifei, PENG Lei, YUAN Tao. Fusion processing algorithm of single-photon detection for three-dimensional point cloud and visible light image[J]. Journal of Applied Optics, 2021, 42(6): 1034-1039. DOI: 10.5768/JAO202142.0602004

Citation:

PDF (925 KB)

Fusion processing algorithm of single-photon detection for three-dimensional point cloud and visible light image

1.
China National Aeronautical Radio Electronics Research Institute, Shanghai 200233, China
2.
The 92697 Troops of PLA, Tangshan 063000, China

More Information

Received Date: July 01, 2021
Revised Date: August 19, 2021
Available Online: October 18, 2021

Graphical Abstract

Abstract

Abstract

In order to improve the detection and identification ability of the photoelectric system for the target, and achieve the fusion processing of single-photon detection of 3D point cloud data and 2D visible light images, the fusion processing algorithm of single-photon detection imaging system was proposed. A direct linear transformation method was used, and the parameter calibration problems in the process of fusion processing were solved by selection of homonymic feature points and indirect adjustment algorithm. The fusion processing algorithm was verified by the experimental data, and the pixel-level fusion processing with 1 024×768 resolution single-photon detection of 3D point cloud data and 2D visible light images was achieved. The experimental results show that the proposed fusion processing algorithm can effectively achieve the fusion of 3D and 2D images.
- single photon,
- three-dimensional point cloud,
- fusion,
- visible light images

FullText(HTML)

References (16)

References

[1]	侯利冰, 黄庚华, 况耀武, 等. 光子计数激光测距技术研究[J]. 科学技术与工程,2013,13(18):5186-5190. doi: 10.3969/j.issn.1671-1815.2013.18.020 HOU Libing, HUANG Genghua, KUANG Yaowu, et al. Research of photon counting laser ranging technology[J]. Science Technology and Engineering,2013,13(18):5186-5190. doi: 10.3969/j.issn.1671-1815.2013.18.020
[2]	罗智斌, 张彦峰, 曹宁. 一种基于融合地面LIDAR 点云与红外视频信息的热红外三维建模方法[J]. 广东技术师范学院学报(自然科学),2014(3):55-58. LUO Zhibin, ZHANG Yanfeng, CAO Ning. Thermal infrared three-dimensional modeling method based on the fusion of LIDAR point and ground infrared video information[J]. Journal of Guangdong Polytechnic Normal University,2014(3):55-58.
[3]	李娜. 沙漠地区机载激光点云和光学影像配准及应用研究[D]. 武汉: 武汉大学, 2015. LI Na. Registration of airborne LiDAR point cloud and aerial imagery for desert areas[D]. Wuhan: Wuhan University, 2015.
[4]	吴伟坊. 基于机载LiDAR系统激光点云与图像点云的融合技术[D]. 广州: 华南理工大学, 2019. WU Weifang. Fusion technology of laser point cloud and image point cloud based on airborne LiDAR system[D]. Guangzhou:South China University of Technology, 219.
[5]	王宇岚, 孙韶媛, 刘致驿, 等. 基于多视角融合的夜间无人车三维目标检测[J]. 应用光学,2020,41(2):296-301. doi: 10.5768/JAO202041.0202002 WANG Yulan, SUN Shaoyuan, LIU Zhiyi, et al. Nighttime three-dimensional target detection of driverless vehicles based on multi-view channel fusion network[J]. Journal of Applied Optics,2020,41(2):296-301. doi: 10.5768/JAO202041.0202002
[6]	吴锦秋, 刘汉君, 杨家开, 等. 可见光影像与激光雷达点云融合技术在配网树障巡检中的应用[J]. 湖南电力,2020,40(6):45-52. doi: 10.3969/j.issn.1008-0198.2020.06.010 WU Jinqiu, LIU Hanjun, YANG Jiakai, et al. Application of visible image and LiDAR point cloud fusion technology in distribution network tree barrier inspection[J]. Hunan Electric Power,2020,40(6):45-52. doi: 10.3969/j.issn.1008-0198.2020.06.010
[7]	牛京玉, 胡坚, 贺文静, 等. 基于C6678的主被动三维影像生成算法并行设计[J]. 红外技术,2017,39(11):983-989. NIU Jingyu, HU Jian, HE Wenjing, et al. The parrallel design of active-passive 3D image generation algorithm based on C6678[J]. Infrared Technology,2017,39(11):983-989.
[8]	DEGNAN J J. Photon-counting multikilohertz microlaser altimeters for airborne and spaceborne topographic measurements[J]. Journal of Geodynamics,2002,34:503-549. doi: 10.1016/S0264-3707(02)00045-5
[9]	李铭, 郭颖, 杨贵, 等. 一种推扫式光子计数激光雷达点云滤波算法及其验证[J]. 科学技术与工程,2017,17(9):53-58. doi: 10.3969/j.issn.1671-1815.2017.09.009 LI Ming, GUO Ying, YANG Gui, et al. A noise filter method for the push-broom photon counting lidar and airborne cloud data verification[J]. Science Technology and Engineering,2017,17(9):53-58. doi: 10.3969/j.issn.1671-1815.2017.09.009
[10]	黎荆梅, 周梅, 张正, 等. 三维成像载荷地面快速融合处理方法研究[J]. 科学技术与工程,2015,15(13):114-117. doi: 10.3969/j.issn.1671-1815.2015.13.020 LI Jingmei, ZHOU Mei, ZHANG Zheng, et al. Research on fast fusion of laser point cloud and CCD image acquired by the 3D imaging payload[J]. Science Technology and Engineering,2015,15(13):114-117. doi: 10.3969/j.issn.1671-1815.2015.13.020
[11]	李小朋, 唐伶俐, 周梅,等. 基于转台的线阵激光雷达地面检校方法研究[J]. 遥感信息,2011(6):87-91. doi: 10.3969/j.issn.1000-3177.2011.01.018 LI Xiaopeng, TANG Lingli, ZHOU Mei, et al. Research on linear array LiDAR calibration based on rotating platform[J]. Remote Sensing Information,2011(6):87-91. doi: 10.3969/j.issn.1000-3177.2011.01.018
[12]	梁新合, 梁晋, 郭成, 等. 法向约束的多幅点云数据融合算法[J]. 西安交通大学学报,2009,43(5):71-75. doi: 10.3321/j.issn:0253-987X.2009.05.015 LIANG Xinhe, LIANG Jin, GUO Cheng, et al. Multi-range images integration algorithm based on normal constraint[J]. Journal of Xi'an Jiaotong University,2009,43(5):71-75. doi: 10.3321/j.issn:0253-987X.2009.05.015
[13]	王敏. 摄影测量与遥感[M]. 武汉: 武汉大学出版社, 2011. WANG Min. Photogrammetry and remote Sensing[M]. Wuhan: Wuhan University Press, 2011.
[14]	SCHENK T, CSATHO B. Fusion of LIDAR data and aerial imagery for a more complete surface description[J]. IAPRS,2002,33:310-317.
[15]	徐勇, 裴海龙. 基于特征的机载激光点云与影像数据的融合[J]. 计算机测量与控制,2014,22(2):607-610. doi: 10.3969/j.issn.1671-4598.2014.02.093 XU Yong, PEI Hailong. Fusion of airborne laser point clouds and area-array data based on features[J]. Computer Measurement & Control,2014,22(2):607-610. doi: 10.3969/j.issn.1671-4598.2014.02.093
[16]	米晓峰, 李传荣, 苏国中,等. LiDAR 数据与CCD 影像融合算法研究[J]. 微计算机信息,2010,26(4):113-122. doi: 10.3969/j.issn.2095-6835.2010.04.046 MI Xiaofeng, LI Chuanrong, SU Guozhong, et al. Research on LiDAR and CCD images fusion algorithm[J]. Microcomputer Information,2010,26(4):113-122. doi: 10.3969/j.issn.2095-6835.2010.04.046

[1]	SHEN Wei, SHEN Wei, HU Xin, WAN Xiaojin, YU Hao, XU Yingwen, HU Chengyong, DENG Chuanlu, HUANG Yi. Research on Φ-OTDR disturbance localization method based on differential SG-NLM algorithm[J]. Journal of Applied Optics, 2025, 46(2): 319-326. DOI: 10.5768/JAO202546.0202004
[2]	CHEN Qingjiang, WANG Qiaoying. Image deblurring based on multiple local residual connection attention network[J]. Journal of Applied Optics, 2023, 44(2): 337-344. DOI: 10.5768/JAO202344.0202006
[3]	ZHANG Xinwei, LI Jun, ZHANG Dingbo, YAN Ruijin, TIAN Biao, DING Guoshen, YIN Heyi, MA Tian, WANG Weifeng, ZHAI Xiaowei. Real-time positioning technology of train based on optical fiber coherent Rayleigh backscattering[J]. Journal of Applied Optics, 2022, 43(5): 994-1000. DOI: 10.5768/JAO202243.0508001
[4]	WANG Gang, XIAO Yufeng, ZHENG Youneng, TIAN Xinghao. Reconstruction and localization of radioactive area fusing images from Kinect and γ camera[J]. Journal of Applied Optics, 2020, 41(5): 965-972. DOI: 10.5768/JAO202041.0502005
[5]	Miao Lijun, Che Ziyuan. Visual locating of mobile robot based on adaptive down sampling[J]. Journal of Applied Optics, 2017, 38(3): 429-433. DOI: 10.5768/JAO201738.0302008
[6]	Li Xiao-lei, Pan Jin-xiao, Liu Bin, Chen Ping, Wei Jiao-tong. Detection algorithm of assembly coaxality in local imaging[J]. Journal of Applied Optics, 2016, 37(1): 96-99. DOI: 10.5768/JAO201637.0103005
[7]	YAN De-ke, SUN Chuan-dong, FENG Li, HE Hao-dong, ZHU Shao-lan. ADesign of driving system for high power and narrowpulse-width semiconductor laser[J]. Journal of Applied Optics, 2011, 32(1): 165-169.
[8]	WANG Lei, LI Gao-ping, YANG Zhao-jin, YANG Hong-ru, LIANG Yan-xi. Research on metrology method for laser power and energy[J]. Journal of Applied Optics, 2006, 27(supp): 41-46.
[9]	LIANG Yan-xi. Development Analysis of Optoelectronic Integer Integrated Technology and Optoelectronic System[J]. Journal of Applied Optics, 2005, 26(1): 1-3.
[10]	JIAO Bin-liang, ZHENG Sheng-xuan. Progress in Optical Current Transducer Technique for Power Systems[J]. Journal of Applied Optics, 2004, 25(6): 47-53.

Cited By

Cited by

Periodical cited type(6)

1.	姚东，高波，宋英政，李群，高贵龙. 激光瞬态光栅激励下结构的超声响应特性研究. 光子学报. 2022(09): 225-235 .
2.	周航，张斌，冯其波，崔建英，梁晨，黄悦朗. 环形光源激发超声进行缺陷检测的数值研究. 激光技术. 2021(02): 168-173 .
3.	徐志祥，王铮恭，黄义敏，王雨. 激光超声检测带过渡圆角平板表面缺陷的数值研究. 应用光学. 2020(01): 214-219 . 本站查看
4.	张智望，王强，谷小红，赵亚，吴琳琳，朱凯. 基于分布式光纤的埋地自来水管多点泄漏定位方法分析. 应用光学. 2020(01): 228-234 . 本站查看
5.	徐志祥，杨帆，关守岩，李连福. 基于表面波增强效应的圆柱表面缺陷检测方法研究. 激光与红外. 2020(10): 1183-1189 .
6.	徐志祥，王铮恭，王雨，黄义敏. 激光激发超声波检测带涂层铝板的表面缺陷. 机械工程与自动化. 2019(05): 162-163+166 .

Other cited types(6)

Get Citation

PDF

XML

Article views (893) PDF downloads (54) Cited by(12)

Turn off MathJax

Article Contents

Abstract

References

Fusion processing algorithm of single-photon detection for three-dimensional point cloud and visible light image