The Raxel Imaging Model and Ray-Based Calibration

An imaging model provides a mathematical description of correspondence between points in a scene and in an image. The dominant imaging model, perspective projection, has long been used to describe traditional cameras as well as the human eye. We propose an imaging model which is flexible enough to represent an arbitrary imaging system. For example using this model we can describe systems using fisheye lenses or compound insect eyes, which violate the assumptions of perspective projection. By relaxing the requirements of perspective projection, we give imaging system designers greater freedom to explore systems which meet other requirements such as compact size and wide field of view. We formulate our model by noting that all imaging systems perform a mapping from incoming scene rays to photosensitive elements on the image detector. This mapping can be conveniently described using a set of virtual sensing elements called raxels. Raxels include geometric, radiometric and optical properties. We present a novel ray based calibration method that uses structured light patterns to extract the raxel parameters of an arbitrary imaging system. Experimental results for perspective as well as non-perspective imaging systems are included.

[1]  Mark Watt,et al.  Light-water interaction using backward beam tracing , 1990, SIGGRAPH.

[2]  Joe W. Harris,et al.  Principles of Algebraic Geometry , 1978 .

[3]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[4]  E. H. Linfoot Principles of Optics , 1961 .

[5]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[6]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Pat Hanrahan,et al.  Illumination from curved reflectors , 1992, SIGGRAPH.

[8]  Shlomo Sternberg,et al.  Geometric Asymptotics, Revised edition , 1977 .

[9]  Oscar S. Marshall The Camera Obscura , 1952 .

[10]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[11]  A. E. Conrady Decentred Lens-Systems , 1919 .

[12]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[13]  R. Pless,et al.  Discrete and differential two-view constraints for general imaging systems , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[14]  Shree K. Nayar,et al.  Folded catadioptric cameras , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[16]  S. Nayar,et al.  Catadioptric Image Formation , 1997 .

[17]  Dominique Bechmann,et al.  Animation by Deformation of Space‐Time Objects , 1997, Comput. Graph. Forum.

[18]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[19]  Alireza Moini,et al.  Vision Chips , 1999 .

[20]  Sleve Mann,et al.  'Pencigraphy' with AGC: joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[21]  A. Zemanian Distribution Theory and Transform Analysis; An Introduction to Generalized Functions, With Applications , 1965 .

[22]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[23]  Donald G. Burkhard,et al.  Flux Density for Ray Propagation in Discrete Index Media Expressed in Terms of the Intrinsic Geometry of the Deflecting Surface , 1973 .

[24]  A. Ardeshir Goshtasby,et al.  Correction of image deformation from lens distortion using bezier patches , 1989, Comput. Vis. Graph. Image Process..

[25]  Yasushi Yagi,et al.  Panorama scene analysis with conic projection , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[26]  Yiannis Aloimonos,et al.  Polydioptric camera design and 3D motion estimation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  R. Dawkins Climbing Mount Improbable , 1996 .

[28]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[30]  Yael Pritch,et al.  Cameras for stereo panoramic imaging , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[31]  Tomás Pajdla Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.

[32]  Shree K. Nayar,et al.  Planar catadioptric stereo: geometry and calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[33]  Steven W. Zucker,et al.  What is a light source? , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Robert K. Tyson Principles of Adaptive Optics , 1991 .

[35]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[36]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[37]  E. Gaten,et al.  Geometrical optics of a galatheid compound eye , 1994, Journal of Comparative Physiology A.

[38]  Robert Pless,et al.  A spherical eye from multiple cameras (makes better models of the world) , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[39]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[40]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[41]  S. Inokuchi,et al.  Three-dimensional surface measurement by space encoding range imaging , 1985 .

[42]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[43]  A. Zemanian,et al.  Distribution theory and transform analysis , 1966 .

[44]  D. Burkhard,et al.  Flux density for ray propagation in geometrical optics , 1973 .

[45]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[46]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.

[47]  Shree K. Nayar,et al.  Caustics of catadioptric cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[48]  Henrik Wann Jensen,et al.  Rendering Caustics on Non‐Lambertian Surfaces , 1996, Comput. Graph. Forum.

[49]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[50]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[51]  Daphna Weinshall,et al.  Video synthesis made simple with the X-slits projection , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[52]  J. H. Hammond The Camera Obscura, A Chronicle , 1981 .