Simulating Bokeh Effect with Kinect

Bokeh effect is an artistic effect in photography, which is the out-of-focus blur caused by the camera lens, typically, professional cameras with wide aperture lenses are necessary to obtain the Bokeh effect. In this paper, we propose a computational method to simulate the Bokeh effect with the RGBD data captured by Kinect. The proposed method first refines the depth map by modeling it as an optimization problem with the guidance of the corresponding RGB image; the size of the filter kernel is calculated from the refined depth map afterwards, finally, the RGB image with Bokeh effect is computed by filtering with the varying-sized and varying-shaped kernels. We have conducted experiment on 4 sets of data, and the experiment result suggests that the proposed method is optimistic in computing natural Bokeh effect.

[1]  Yo-Sung Ho,et al.  Joint Multilateral Filtering for Stereo Image Generation Using Depth Camera , 2013 .

[2]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[3]  Yutaka Ishibashi,et al.  Weighted Joint Bilateral Filter with Slope Depth Compensation Filter for Depth Map Refinement , 2013, VISAPP.

[4]  Kai-Lung Hua,et al.  Edge-Preserving Depth Map Upsampling by Joint Trilateral Filter , 2018, IEEE Transactions on Cybernetics.

[5]  Przemyslaw Rokita,et al.  Fast generation of depth of field effects in computer graphics , 1993, Comput. Graph..

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jirí Zára,et al.  Fast depth of field rendering with surface splatting , 2003, Proceedings Computer Graphics International 2003.

[8]  Anselmo Lastra,et al.  Fast Summed‐Area Table Generation and its Applications , 2005, Comput. Graph. Forum.

[9]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[10]  Long Ye,et al.  A Modified Joint Trilateral Filter for Depth Image Super Resolution , 2016, IFTC.

[11]  Martin Kraus.  Using Opaque Image Blur for Real-Time Depth-of-Field Rendering and Image-Based Motion Blur , 2013, J. Virtual Real. Broadcast..

[12]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[13]  Jim X. Chen,et al.  Accurate Depth of Field Simulation in Real Time , 2007, Comput. Graph. Forum.

[14]  Ming-Yu Liu,et al.  Joint Geodesic Upsampling of Depth Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Enhua Wu,et al.  Constant Time Weighted Median Filtering for Stereo Matching and Beyond , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Yao Wang,et al.  Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model , 2014, IEEE Transactions on Image Processing.

[17]  Juan Buhler,et al.  A phenomenological model for bokeh rendering , 2002, SIGGRAPH '02.

[18]  Sungkil Lee,et al.  Real‐Time Depth‐of‐Field Rendering Using Point Splatting on Per‐Pixel Layers , 2008, Comput. Graph. Forum.