STag: A Stable Fiducial Marker System

Fiducial markers provide better-defined features than the ones naturally available in the scene. For this reason, they are widely utilized in computer vision applications where reliable pose estimation is required. Factors such as imaging noise and subtle changes in illumination induce jitter on the estimated pose. Jitter impairs robustness in vision and robotics applications, and deteriorates the sense of presence and immersion in AR/VR applications. In this paper, we propose STag, a fiducial marker system that provides stable pose estimation. STag is designed to be robust against jitter factors, thus sustains pose stability better than the existing solutions. This is achieved by utilizing geometric features that can be localized more repeatably. The outer square border of the marker is used for detection and homography estimation. This is followed by a novel homography refinement step using the inner circular border. After refinement, the pose can be estimated stably and robustly across viewing conditions. These features are demonstrated with a comprehensive set of experiments, including comparisons with the state of the art fiducial marker systems.

[1]  Gregory Dudek,et al.  Fourier tags: Smoothly degradable fiducial markers for use in human-robot interaction , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[2]  Hideo Saito,et al.  Random dot markers , 2011, 2011 IEEE Virtual Reality Conference.

[3]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[4]  Mark Fiala,et al.  Designing Highly Reliable Fiducial Markers , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  N. J. A. Sloane,et al.  Lexicographic codes: Error-correcting codes from game theory , 1986, IEEE Trans. Inf. Theory.

[6]  Eric Foxlin,et al.  Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[7]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[8]  Mark Fiala,et al.  Comparing ARTag and ARToolkit Plus fiducial marker systems , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[9]  Andrea Torsello,et al.  An Accurate and Robust Artificial Marker Based on Cyclic Codes , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Antonio Torralba,et al.  Recognizing indoor scenes , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[12]  Jun Rekimoto,et al.  Matrix: a realtime object identification and registration method for augmented reality , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[13]  Andrea Torsello,et al.  RUNE-Tag: A high accuracy fiducial marker with strong occlusion resilience , 2011, CVPR 2011.

[14]  Nassir Navab,et al.  Visual marker detection and decoding in AR systems: a comparative study , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[15]  John H. Conway,et al.  Sphere Packings, Lattices, Codes, and Greed , 1995 .

[16]  Juho Kannala,et al.  Algorithms for Computing a Planar Homography from Conics in Correspondence , 2006, BMVC.

[17]  Diego López-de-Ipiña,et al.  TRIP: A Low-Cost Vision-Based Location System for Ubiquitous Computing , 2002, Personal and Ubiquitous Computing.

[18]  David A. Forsyth,et al.  Invariant Descriptors for 3D Object Recognition and Pose , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[20]  Scott Kirkpatrick,et al.  Optimization by Simmulated Annealing , 1983, Sci..

[21]  Andrea Torsello,et al.  Pi-Tag: a fast image-space marker design based on projective invariants , 2013, Machine Vision and Applications.

[22]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[23]  Gunnar Sparr Depth computations from polyhedral images , 1992, Image Vis. Comput..

[24]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Gregory Dudek,et al.  Fourier Tag: A Smoothly Degradable Fiducial Marker System with Configurable Payload Capacity , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[27]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  W. Fischer,et al.  Sphere Packings, Lattices and Groups , 1990 .

[29]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[31]  Cuneyt Akinlar,et al.  Parallelizing edge drawing algorithm on CUDA , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[32]  Cuneyt Akinlar,et al.  Edpf: a Real-Time parameter-Free Edge Segment Detector with a False Detection Control , 2012, Int. J. Pattern Recognit. Artif. Intell..

[33]  Axel Pinz,et al.  Robust Pose Estimation from a Planar Target , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Israel Amir,et al.  Design of Fiducials for Accurate Registration Using Machine Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Pierre Gurdjos,et al.  Detection and Accurate Localization of Circular Fiducials under Highly Challenging Conditions , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Timothy Bretl,et al.  ChromaTag: A Colored Marker and Fast Detection Algorithm , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[37]  Jean Ponce,et al.  Automatic model construction, pose estimation, and object recognition from photographs using triangular splines , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[38]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[39]  Francisco José Madrid-Cuevas,et al.  Generation of fiducial marker dictionaries using Mixed Integer Linear Programming , 2016, Pattern Recognit..

[40]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.