Camera Calibration using Mobile Robot in Intelligent Space

In this paper, we describe an automated camera calibration method by using mobile robots. In the recent years, the research field on smart environments, which is a space with many embedded and networked sensors, has been expanding. Such a system should have flexibility and scalability so that we can easily add, remove or replace devices depending on the size of the space, application, technological advances, and so on. One of the major problems when setting up the devices is a calibration of the sensors. In order to reduce this, we utilize color markers installed on a mobile robot to calibrate distributed vision sensors. The mobility of mobile robots allows us to cover wide areas of the environment without placing many landmarks in the exact positions beforehand. The position and orientation of the mobile robot are estimated from wheel encoder and an ultrasonic 3D positioning system measurement data using Extended Kalman Filter (EKF). Automated camera calibration is performed based on the positions of the color markers in world coordinate system and their corresponding points in image coordinate system. Experimental result shows the validity of this method.

[1]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[2]  Joo-Ho Lee,et al.  Intelligent Space — concept and contents , 2002, Adv. Robotics.

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Larry S. Davis,et al.  Camera calibration using spheres: a semi-definite programming approach , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Zhanyi Hu,et al.  Camera Calibration from the Quasi-affine Invariance of Two Parallel Circles , 2004, ECCV.

[6]  H. Kanazaki,et al.  Localization and Identification of Multiple Objects with Heterogeneous Sensor Data by EM Algorithm , 2006, 2006 SICE-ICASE International Joint Conference.

[7]  Gregory Dudek,et al.  Automated calibration of a camera sensor network , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Hideki Hashimoto,et al.  Spatial memory: an aid system for human activity in intelligent space , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Marilena Vendittelli,et al.  WMR control via dynamic feedback linearization: design, implementation, and experimental validation , 2002, IEEE Trans. Control. Syst. Technol..

[11]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[12]  Sajal K. Das,et al.  Smart Environments: Technology, Protocols and Applications (Wiley Series on Parallel and Distributed Computing) , 2004 .

[13]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Hironori Hiraishi,et al.  Smart Office Robot Collaboration Based on Multi-Agent Programming , 1999, Artif. Intell..

[16]  Anders Heyden,et al.  Stereo head calibration from a planar object , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Elsayed E. Hemayed,et al.  A survey of camera self-calibration , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[18]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[19]  Takashi Suehiro,et al.  Sensorized environment for self-communication based on observation of daily human behavior , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[20]  Armando Fox,et al.  The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms , 2002, IEEE Pervasive Comput..

[21]  Hideki Hashimoto,et al.  Design policy of localization for mobile robots in general environment , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[22]  Jae Wook Jeon,et al.  Performance Evaluation of Transmitting Images to a PDA through a Wireless Network , 2006, 2006 SICE-ICASE International Joint Conference.