Calibration of a reconfigurable array of omnidirectional cameras using a moving person

Reconfigurable arrays of omnidirectional cameras are useful for applications where multiple cameras working together are to be deployed at a short notice. This paper addresses the important issue of calibration of such arrays in terms of the relative camera positions and orientations. The location of a one-dimensional object moving parallel to itself, such as a moving person is used to establish correspondences between multiple cameras. In such case, the non-linear 3-D problem of calibration can be approximated by a 2-D problem in plan view. This enables an initial solution using factorization method. A non-linear optimization stage is then used to account for the approximations, as well as to minimize the geometric error between the observed and projected omni pixel coordinates. Experimental results with simulated and real data illustrate the effectiveness of the method.

[1]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[2]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[3]  Kostas Daniilidis,et al.  Wide Area Multiple Camera Calibration and Estimation of Radial Distortion , 2004 .

[4]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Tomáš Svoboda Quick Guide to Multi-Camera Self-Calibration , 2003 .

[8]  Tomás Pajdla,et al.  Structure from Many Perspective Images with Occlusions , 2002, ECCV.

[9]  Mohan M. Trivedi,et al.  N-Ocular stereo for real-time human tracking , 2001 .

[10]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Mohan M. Trivedi,et al.  Video arrays for real-time tracking of person, head, and face in an intelligent room , 2003, Machine Vision and Applications.

[12]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[13]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[14]  Jon Rigelsford Panoramic Vision: Sensors, Theory and Applications , 2002 .

[15]  Philipp Slusallek,et al.  Wide area camera calibration using virtual calibration objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Augusto Sarti,et al.  Accurate and simple geometric calibration of multi-camera systems , 1999, Signal Process..