Correction and rectification of light fields

Abstract The light field is a well-known image-based rendering technology. The traditional way to capture a light field is to move a camera on a plane and take images at every gird points. However, due to device defects it is hard to ensure that the captured light field is ideal. For example, the camera’s imaging plane is not on the image plane of the light field and the camera is not in the right position. To solve this problem we propose a correction and rectification framework that uses only four images. This framework involves un-distortion, feature point detection, homography computation to correct the orientation of the camera, and positional error correction. It is the first to take positional error into consideration. Our experiments show that our method is effective.

[1]  Emanuele Trucco,et al.  Rectification with unconstrained stereo geometry , 1997, BMVC.

[2]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[3]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[4]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[5]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[6]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[7]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[9]  Ulrich Neumann,et al.  A Multi-ring Color Fiducial System and A Rule-Based Detection Method for Scalable Fiducial-tracking Augmented Reality , 1998 .

[10]  Emanuele Trucco,et al.  Projective rectification without epipolar geometry , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.