CHANG Qing, ZHAO Shuangming. Light field refocusing analysis of different interpolation algorithms[J]. Journal of Applied Optics, 2020, 41(3): 482-489. DOI: 10.5768/JAO202041.0302001
Citation: CHANG Qing, ZHAO Shuangming. Light field refocusing analysis of different interpolation algorithms[J]. Journal of Applied Optics, 2020, 41(3): 482-489. DOI: 10.5768/JAO202041.0302001

Light field refocusing analysis of different interpolation algorithms

More Information
  • Received Date: November 21, 2019
  • Revised Date: January 07, 2020
  • Available Online: May 29, 2020
  • The light field data refocusing includes spatial domain refocusing and frequency domain refocusing. In the process of the refocusing, the interpolation calculation is needed, the refocusing precision is closely related to the interpolation precision, and the computational efficiency can be affected by the complexity of the interpolation algorithm. In the actual large amount of the image processing, the method with the highest computational efficiency is selected under the premise that the refocusing effect satisfies the accuracy requirement, and wherein the interpolation accuracy has a much greater influence on the frequency domain than the spatial domain. The principle of the spatial domain refocusing and the frequency domain refocusing, as well as the traditional three interpolation methods and the sinc function interpolation method were introduced. Different interpolation methods were used to experiment this two refocusing methods to compare their refocusing effect and calculate their efficiency. The experimental results show that in order to meet the requirement of the computational efficiency in actual applications, the linear interpolation method is the best method to optimize the spatial domain refocusing in the case of meeting the accuracy requirement, and the sinc interpolation with the sampling radius of 2 is optimal in the frequency domain. When the same image is refocused for multiple times, the frequency domain method is superior to the spatial domain method.
  • [1]
    GERSHUN A. The light field[J]. Journal of Mathematics and Physics,1939,18(1/2/3/4):541-151.
    [2]
    ADELSON E H. The plenoptic function and the elements of early vision[M]//Computational Models of Visual Processing. [S.l]: The MIT Press, 1991.
    [3]
    MCMILLAN L, BISHOP G. Plenoptic modeling[C]//Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques - SIGGRAPH '95. USA: ACM Press, 1995.
    [4]
    LEVOY M, HANRAHAN P. Light field rendering[C]//Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques - SIGGRAPH '96. USA: ACM Press, 1996
    [5]
    ADELSON E H, WANG J Y A. Single lens stereo with a plenoptic camera[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):99-106. doi: 10.1109/34.121783
    [6]
    REN N. Digital light field photography[J]. Phd Thesis Stanford University,2006,115(3):38-39.
    [7]
    LIM J G, BOUMAN C A, POLLAK I, et al. Computational Imaging VIII - Restoring the spatial resolution of refocus images on 4D light field[J]. SPIE,2010,7533:753310.
    [8]
    袁艳, 周宇, 胡煌华. 光场相机中微透镜阵列与探测器配准误差分析[J]. 光子学报,2010,39(1):123-126. doi: 10.3788/gzxb20103901.0123

    YUAN Yan, ZHOU Yu, HU Huanghua. Registration error analysis for microlens array and photosonser in light field camera[J]. Acta Photonica Sinica,2010,39(1):123-126. doi: 10.3788/gzxb20103901.0123
    [9]
    张旭, 李晨. 微透镜阵列式光场成像模型及其标定方法[J]. 光学学报,2014,34(12):95-107.

    ZHANG Xu, LI Chen. Calibration and imaging model of light field camera with microlens array[J]. Acta Optica Sinica,2014,34(12):95-107.
    [10]
    LEVOY M, ZHANG Z, MCDOWALL I. Recording and controlling the 4D light field in a microscope using microlens arrays[J]. Journal of Microscopy,2009,235(2):144-162. doi: 10.1111/j.1365-2818.2009.03195.x
    [11]
    杨凡, 袁艳, 周志良. 光场相机成像质量评价方法研究[J]. 现代电子技术,2011,34(6):4-6. doi: 10.3969/j.issn.1004-373X.2011.06.002

    YANG Fan, YUAN Yan, ZHOU Zhiliang. Study on imaging quality evaluation of light field camera[J]. Modern Electronics Technique,2011,34(6):4-6. doi: 10.3969/j.issn.1004-373X.2011.06.002
    [12]
    HUANG C T. Fast realistic refocusing for sparse light fields[C]//IEEE International Conference on Acoustics. USA: IEEE, 2015.
    [13]
    WANNER S, GOLDLUECKE B. Variational light field analysis for disparity estimation and super-resolution[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(3):606-619. doi: 10.1109/TPAMI.2013.147
    [14]
    HORSTMEYER R, EULISS G, ATHALE R. Flexible multimodal camera using a light field architecture: 2009 IEEE International Conference on Computational Photography (ICCP), San Francisco, CA, April 16-17, 2009[C]. USA. IEEE, 2009.
    [15]
    PÉREZ F, PÉREZ A, RODRÍGUEZ M, et al. Super-resolved Fourier-slice refocusing in plenoptic cameras[J]. Journal of Mathematical Imaging and Vision,2015,52(2):200-217. doi: 10.1007/s10851-014-0540-1
    [16]
    GEORGIEV T, YU Z, LUMSDAINE A, et al. Lytro camera technology: theory, algorithms, performance analysis[C]//Proceedings of SPIE - The International Society for Optical Engineering. [S.l]: SPIE, 2013: 8667.
    [17]
    MOORTHY A K, BOVIK A C. A two-step framework for constructing blind image quality indices[J]. IEEE Signal Processing Letters,2010,17(5):513-516. doi: 10.1109/LSP.2010.2043888
    [18]
    MITTAL A, SOUNDARARAJAN R, BOVIK A C. Making a “completely blind” image quality analyzer[J]. IEEE Signal Processing Letters,2013,20(3):209-212. doi: 10.1109/LSP.2012.2227726
    [19]
    NG Ren. Fourier slice photography[J]. ACM Transactions on Graphics,2005,24(3),735-744.
    [20]
    MAYMON S, OPPENHEIM A V. Sinc interpolation of nonuniform samples[J]. IEEE Transactions on Signal Processing,2011,59(10):4745-4758. doi: 10.1109/TSP.2011.2160054

Catalog

    Article views (1780) PDF downloads (53) Cited by()

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return