Depth image enhancement algorithm based on structure feature guidance filter
-
摘要: 为了解决深度图像中存在的图像模糊、空洞和噪声等图像质量问题,拟从软件的角度出发,在不改变传感器成像系统物理结构的前提下,基于结构特征并以彩色图像作为引导展开研究,实现深度图像增强和空洞修补的目的,提高深度图像的质量。通过对彩色图像和深度图像的结构特征进行提取,得到共性的全局特征,并对得到的结构特征进行联合双边滤波,最后基于马尔科夫随机场的方法进行深度图像增强,实现了低成本获取深度增强的图像。实验结果表明本文算法在保持图像边缘的细节性、平滑性和整体性上具有更好的效果,与其他算法相比,图像的均方根误差RMSE更低,仅为0.506 93及1.169 30(针对Teddy及Art图像)。Abstract: There are many quality problems in depth image,for example, images may be combined with blurring, empty holes and noise. In order to solve these problems, from the view point of software,an algorithm guided by color images based on structural characteristics was studied without changing any physical structure of the sensor imaging system,which could realize depth image enhancement and empty holes repairing,as well as improve the quality of the depth image. Through the extraction for the structure of the color image and depth image, the common global features were obtained. After joint bilateral filtering for the structural features,the depth image was enhanced based on Markov random filed (MRF), and the depth enhanced image was finally obtained with low cost. Experimental results show that the algorithm has a better effect in keeping the detail, smoothness and integrity of image edge; moreover, the rootmeansquare error (RMSE) of this algorithm is smaller than other algorithms,which is 0.50693 and 1.16930 for image Teddy and Art,respectively.
-
Keywords:
- structure feature /
- image enhancement /
- Markov random field /
- bilateral filter
-
-
[1]Zhang Yifei, Li Liangfu, Wang Jiaoying, et al. An image enhancement algorithm based on super resolution reconstruction[J]. Journal of Applied Optics, 2011, 32(2):250255. 张翼飞, 李良福, 王娇颖, 等, 基于超分辨率重建的图像增强算法研究[J]. 应用光学, 2011, 32 (2): 250255. [2]Feng Ce, Dai Shuling. An improved unsharp masking method for depth map enhancement[J]. Journal of Harbin Institute of Technology, 2014, 46 (8): 107112. 冯策, 戴树岭. 一种改进的非锐化掩模深度图像增强算法[J]. 哈尔滨工业大学学报, 2014, 46 (8): 107112. [3]Yang Q X, Yang R G, Davis J, et al. Spatialdepth super resolution for range images[C].USA: IEEE,2007:18. [4]Gwak S H, Park E B, Kim H J. Ultrasound image enhancement using Markov random field model[C].USA:IEEE,c2013:9699. [5]Yu Y J, Acton S T. Speckle reducing anisotropic diffusion[J].IEEE Transactions on Image Processing, 2002, 11(11): 12601270. [6]Torok M M, GolparvarFard M, Kochersberger K B. Imagebased automated 3D crack detection for postdisaster building assessment[J].Journal of Computing in Civil Engineering, 2014, 28(5): 113. [7]Klingbeil L, Nieuwenhuisen M, Schneider J, et al.Towards autonomous navigation of an UAVbased mobile mapping system[C].[S.l.]:Ais. Uni., 2014: 112. [8]Lattanzi D, Miller G R.3D scene reconstruction for robotic bridge inspection[J].Journal of Infrastructure Systems, 2014,20(3): 112. [9]Engel J, Schops T, Cremers D.LSDSLAM: Largescale direct monocular SLAM[C]. Switzerland:Springer International Publishing, 2014:834849. [10]La H M, Lim R S, Basily B B, et al.Mechatronic systems design for an autonomous robotic system for highefficiency bridge deck inspection and evaluation[J].IEEE Transactions on Mechatronics, 2013, 18(6): 16551664. [11]Henry P, Krainin M, Herbst E, et al. RGBD mapping: Using depth cameras for dense 3D modeling of indoor environments[J]. Springer Tracts in Advanced Robotics, 2014, 79: 477491. [12]Warade P P, Kale M S N, Thakare V M.Edge detection: featurebased Canny edge detection[J/OL]. Special Issue of International Journal of Electronics, Communication & Soft Computing Science and Engineering, 2015: 3640[20151130].http://www.ijecscse.org/papers/ATCON2015/DIP01.pdf. -
期刊类型引用(6)
1. 张颖. 基于映射图与界面视觉要素排序的激光全息投影人机动态交互. 设计艺术研究. 2024(01): 51-55 . 百度学术
2. 林尉,张辉,张丽艳,潘阿村,章泓基,朱成顺. 基于OpenCASCADE的轮廓曲线识别与提取系统研究. 现代制造工程. 2024(12): 114-119 . 百度学术
3. 杨帆,牟达,侯茂盛,杨嘉亮,王文博,刘洋. 多色分图层激光扫描自聚焦投影技术. 应用光学. 2023(02): 427-436 . 本站查看
4. 张玲,祝秀琴,赵巍. 利用SLAM激光扫描提取装配式建筑轮廓方法. 激光杂志. 2023(03): 226-231 . 百度学术
5. 刘杰,常兴山,孙锋,周建辉. 基于聚类分析的数据文件格式分析方法. 武汉理工大学学报. 2022(01): 93-99 . 百度学术
6. 侯茂盛,陈雨情,史铮雪,李竺悦. 融合单目视觉的激光扫描投影系统自标定方法. 光子学报. 2021(02): 142-149 . 百度学术
其他类型引用(5)
计量
- 文章访问数: 1335
- HTML全文浏览量: 77
- PDF下载量: 61
- 被引次数: 11