Multi-camera rectification using linearized trifocal tensor

Multi-camera systems such as linear camera arrays are commonly used to capture content for multi-baseline stereo estimation, view generation for auto-stereoscopic displays, or similar tasks. However, even after a careful mechanical alignment, residual vertical disparities and horizontal disparity offsets impair further processing steps. In consequence, the multicamera content needs to be rectified on a common baseline. The trifocal tensor represents the geometry between three cameras and hence is a helpful tool to calibrate a multi-camera system, and to derive rectifying homographies. Against this background we propose a new method for a robust estimation of the trifocal tensor specialized for linear camera arrays and subsequent rectifying homography computation based on feature point triplets.

[1]  Yunde Jia,et al.  An efficient rectification method for trinocular stereovision , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  P. Eisert,et al.  Joint Estimation of Epipolar Geometry and Rectification Parameters using Point Correspondences for Stereoscopic TV Sequences , 2010 .

[3]  Yo-Sung Ho,et al.  An Efficient Rectification Algorithm for Multi-View Images in Parallel Camera Array , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Zhanyi Hu,et al.  A Linear Trinocular Rectification Method for Accurate Stereoscopic Matching , 2003, BMVC.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  An Ping,et al.  A rectification algorithm for un-calibrated multi-view images based on SIFT features , 2010, 2010 International Conference on Audio, Language and Image Processing.

[7]  Robert Laganière,et al.  Projective Rectification Of Image Triplets From The Fundamental Matrix , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  Vincent Nozick,et al.  Epipolar Rectification for Autostereoscopic Camera Setup , 2010 .

[9]  Peter Eisert,et al.  Semantic Kernels Binarized - A Feature Descriptor for Fast and Robust Matching , 2011, 2011 Conference for Visual Media Production.

[10]  Zhang Yang,et al.  Fast automatic elimination of vertical parallax of multiview images , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[11]  Charles Hansen,et al.  Rectification of images for binocular and trinocular stereovision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[12]  Amnon Shashua,et al.  Algebraic Functions For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jonghyun Choi,et al.  An Efficient Trinocular Rectification Method for Stereo Vision , 2007 .

[14]  Jing Wang,et al.  An efficient rectification method for trinocular stereovision , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  杜歆,et al.  A simple rectification method for linear multi-baseline stereovision system , 2004 .

[16]  Changming Sun,et al.  Uncalibrated three-view image rectification , 2003, Image Vis. Comput..

[17]  Paul F. Whelan,et al.  Projective rectification from the fundamental matrix , 2005, Image Vis. Comput..

[18]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Vincent Nozick,et al.  Multiple view image rectification , 2011, 2011 1st International Symposium on Access Spaces (ISAS).