Evaluation and improvement of global pose estimation with multiple AprilTags for industrial manipulators

Given the advancing importance for light-weight production materials an increase in automation is crucial. This paper presents a prototypical setup to obtain a precise pose estimation for an industrial manipulator in a realistic production environment. We show the achievable precision using only a standard fiducial marker system (AprilTag) and a state-of-the art camera attached to the robot. The results obtained in a typical working space of a robot cell of about 4.5m × 4.5m are in the range of 15mm to 35mm compared to ground truth provided by a laser tracker. We then show several methods of reducing this error by applying state-of-the-art optimization techniques, which reduce the error significantly to less than 10mm compared to the laser tracker ground truth data and at the same time remove e×isting outliers.

[1]  Jürgen Sturm,et al.  Evaluating Egomotion and Structure-from-Motion Approaches Using the TUM RGB-D Benchmark , 2012 .

[2]  J. M. Corum.  BASIC PROPERTIES OF REFERENCE CROSSPLY CARBON-FIBER COMPOSITE , 2001 .

[3]  M. Rubin,et al.  Arithmetic and geometric solutions for average rigid-body rotation , 2010 .

[4]  Ulrich Hillenbrand.  Consistent parameter clustering: Definition and analysis , 2007, Pattern Recognit. Lett..

[5]  Vineet R. Kamat,et al.  AUGMENTED REALITY MARKERS AS SPATIAL INDICES FOR INDOOR MOBILE AECFM APPLICATIONS , 2012 .

[6]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Vineet R. Kamat,et al.  Collaborative visualization of engineering processes using tabletop augmented reality , 2013, Adv. Eng. Softw..

[10]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[11]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[13]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[14]  Edwin Olson,et al.  AprilCal: Assisted and repeatable camera calibration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[16]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[18]  Georg Braun,et al.  Development of a vision-based 6D pose estimation end effector for industrial manipulators in lightweight production environments , 2015, 2015 IEEE 20th Conference on Emerging Technologies & Factory Automation (ETFA).

[19]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[20]  Nassir Navab,et al.  Model globally, match locally: Efficient and robust 3D object recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  P. Tsai,et al.  Health-risk assessment for workers exposed to polycyclic aromatic hydrocarbons (PAHs) in a carbon black manufacturing industry. , 2001, The Science of the total environment.

[22]  Tamim Asfour,et al.  6-DoF model-based tracking of arbitrarily shaped 3D objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  François Chaumette,et al.  Potential problems of stability and convergence in image-based and position-based visual servoing , 1997 .

[24]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[25]  Christopher Bingham.  An Antipodally Symmetric Distribution on the Sphere , 1974 .

[26]  Gerd Hirzinger,et al.  More accurate camera and hand-eye calibrations with unknown grid pattern dimensions , 2008, 2008 IEEE International Conference on Robotics and Automation.

[27]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Federico Tombari,et al.  Hough Voting for 3D Object Recognition under Occlusion and Clutter , 2012, IPSJ Trans. Comput. Vis. Appl..

[29]  Beom Hee Lee,et al.  Analysis of Resampling Process for the Particle Depletion Problem in FastSLAM , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[30]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Nancy L. Johnson,et al.  Development of a Cost Competitive, Composite Intensive, Body-in-White , 2002 .

[32]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[33]  Markus Ulrich,et al.  CAD-based recognition of 3D objects in monocular images , 2009, 2009 IEEE International Conference on Robotics and Automation.

[34]  Dieter Fox,et al.  KLD-Sampling: Adaptive Particle Filters , 2001, NIPS.

[35]  Zoltan-Csaba Marton,et al.  Tutorial: Point Cloud Library: Three-Dimensional Object Recognition and 6 DOF Pose Estimation , 2012, IEEE Robotics & Automation Magazine.