A Robust Circular Fiducial Detection Technique and Real-Time 3D Camera Tracking

In this paper a new marker-based approach is presented for 3D camera pose tracking in indoor Augmented Reality (AR). We propose to combine a circular fiducials detection technique with a particle filter to incrementally compute the camera 3D pose parameters. In order to deal with partial occlusions, we have implemented an efficient method for fitting ellipse to scattered data. So even incomplete data will always return an ellipse corresponding to the visible part of the fiducial image. The other advantage of our approach comparing to the related camera pose estimation works is its capacity to naturally discard outliers which occur because of image noises. Results from real data in an augmented reality setup are presented, demonstrating the efficiency and robustness of the proposed method.

[1]  Malik Mallem,et al.  Comparison between particle filter approach and Kalman filter-based technique for head tracking in augmented reality systems , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[2]  Ulrich Neumann,et al.  Extendible tracking by line auto-calibration , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[3]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[4]  Ulrich Neumann,et al.  Multi-ring color fiducial systems for scalable fiducial tracking augmented reality , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[5]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Danica Kragic,et al.  Initialization and System Modeling in 3-D Pose Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[8]  David W. Murray,et al.  Full-3D Edge Tracking with a Particle Filter , 2006, BMVC.

[9]  Andrew Calway,et al.  Real-Time Camera Tracking Using a Particle Filter , 2005, BMVC.

[10]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[11]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[12]  Touradj Ebrahimi,et al.  Particle filter-based camera tracker fusing marker and feature point cues , 2007, Electronic Imaging.

[13]  Marcel J. T. Reinders,et al.  Influence of the observation likelihood function on particle filtering performance in tracking applications , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[14]  Malik Mallem,et al.  Robust circular fiducials tracking and camera pose estimation using particle filtering , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Jun-Sik Kim,et al.  A Camera Calibration Method using Concentric Circles for Vision Applications , 2001 .

[16]  Avinash C. Kak,et al.  A New Approach to the Use of Edge Extremities for Model-based Object Tracking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[19]  Francisco Abad,et al.  Camera Calibration Using Two Concentric Circles , 2004, ICIAR.

[20]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  M. Johansson,et al.  Particle filter-based information acquisition for robust plan recognition , 2005, 2005 7th International Conference on Information Fusion.

[22]  N. Gordon.  A hybrid bootstrap filter for target tracking in clutter , 1995, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Howon Kim,et al.  A New Camera Caibration Method using Concentric Circles for Vision Applications , 2002 .

[24]  Touradj Ebrahimi,et al.  Combination of video-based camera trackers using a dynamically adapted particle filter , 2007, VISAPP.

[25]  Danica Kragic,et al.  Integration of Model-based and Model-free Cues for Visual Object Tracking in 3D , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[26]  Jacek Czyz.  Object Detection in Video via Particle Filters , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[27]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.