Practical Pan-Tilt-Zoom-Focus Camera Calibration for Augmented Reality

While high-definition cameras with automated zoom lenses are widely used in broadcasting and film productions, there have been no practical calibration methods working without special hardware devices. We propose a practical method to calibrate pan-tilt-zoom-focus cameras, which takes advantages from both pattern-based and rotation-based calibration approaches. It uses patterns whose positions are only roughly known a priori , with several image samples taken at different rotations. The proposed method can find the camera view's translation along the optical axis caused by zoom and focus operations, which has been neglected in most rotation-based algorithms. We also propose a practical focus calibration technique that is applicable even when the image is too defocused for the patterns to be detected. The proposed method is composed of two separate procedures --- zoom calibration and focus calibration. Once the calibration is done for all zoom settings with a fixed focus setting, the remaining focus calibration is fully automatic. We show the accuracy of the proposed method by comparing it to the algorithm most widely used in computer vision. The proposed algorithm works also well for real cameras with translation offsets.

[1]  Yongduek Seo,et al.  About the self-calibration of a rotating and zooming camera: Theory and practice , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Yi-Ping Hung,et al.  Simple and efficient method of calibrating a motorized zoom lens , 2001, Image Vis. Comput..

[3]  Klaus Diepold,et al.  Modeling the Variation of the Intrinsic Parameters of an Automatic Zoom Camera System using Moving Least-Squares , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[4]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  David W. Murray,et al.  The Effects of Translational Misalignment when Self-Calibrating Rotating and Zooming Cameras , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Reg G. Willson Modeling and calibration of automated zoom lenses , 1994, Other Conferences.

[7]  Ian Reid,et al.  Self-calibration of rotating and zooming cameras (vol 45, pg 107, 2001) , 2002 .

[8]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[9]  Richard I. Hartley,et al.  Self-Calibration of Stationary Cameras , 1997, International Journal of Computer Vision.

[10]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Qiang Ji,et al.  Self-calibration of a rotating camera with a translational offset , 2004, IEEE Transactions on Robotics and Automation.

[12]  Ian D. Reid,et al.  Self-Calibration of Rotating and Zooming Cameras , 2002, International Journal of Computer Vision.

[13]  Marc Pollefeys,et al.  Pan-tilt-zoom camera calibration and high-resolution mosaic generation , 2006, Comput. Vis. Image Underst..