Fractal Markers: A New Approach for Long-Range Marker Pose Estimation Under Occlusion

Squared fiducial markers are a powerful tool for camera pose estimation in applications such as robots, unmanned vehicles and augmented reality. The four corners of a single marker are enough to estimate the pose of a calibrated camera. However, they have some limitations. First, the methods proposed for detection are ineffective under occlusion. A small occlusion in any part of the marker makes it undetectable. Second, the range at which they can be detected is limited by their size. Very big markers can be detected from a far distance, but as the camera approaches them, they are not fully visible, and thus they can not be detected. Small markers, however, can not be detected from large distances. This paper proposes solutions to the above-mentioned problems. We propose the Fractal Marker, a novel type of marker that is built as an aggregation of squared markers, one into another, in a recursive manner. Also, we proposed a novel method for detecting Fractal Markers under severe occlusions. The results of our experiments show that the proposed method achieves a wider detection range than traditional markers and great robustness to occlusion.

[1]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[2]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[3]  Hyunseok Choi,et al.  A portable surgical navigation device to display resection planes for bone tumor surgery , 2017, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[4]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[5]  R. Muñoz-Salinas,et al.  Accurate automated assessment of gully cross‐section geometry using the photogrammetric interface FreeXSapp , 2018 .

[6]  Chris Parnin,et al.  Dazed: Measuring the Cognitive Load of Solving Technical Interview Problems at the Whiteboard , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: New Ideas and Emerging Technologies Results (ICSE-NIER).

[7]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Malik Mallem,et al.  Robust camera pose estimation using 2d fiducials tracking for real-time augmented reality systems , 2004, VRCAI '04.

[9]  Guoyan Zheng,et al.  AUGMENTED MARKER TRACKING FOR PERIACETABULAR OSTEOTOMY SURGERY: A CADAVER STUDY , 2017 .

[10]  Francisco José Madrid-Cuevas,et al.  Generation of fiducial marker dictionaries using Mixed Integer Linear Programming , 2016, Pattern Recognit..

[11]  Daniel J. Costello,et al.  Error Control Coding, Second Edition , 2004 .

[12]  Edwin Olson,et al.  Flexible Layouts for Fiducial Tags , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Diego Borro,et al.  A new marker design for a robust marker tracking system against occlusions , 2012, Comput. Animat. Virtual Worlds.

[14]  Hao Wang,et al.  Hierarchical fiducial marker design for pose estimation in large-scale scenarios , 2018, J. Field Robotics.

[15]  Vincent Babin,et al.  Stable and repeatable grasping of flat objects on hard surfaces using passive and epicyclic mechanisms , 2019, Robotics and Computer-Integrated Manufacturing.

[16]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[17]  Adrien Bartoli,et al.  Infinitesimal Plane-Based Pose Estimation , 2014, International Journal of Computer Vision.

[18]  Rafael Muñoz-Salinas,et al.  3D Reconstruction and alignment by consumer RGB-D sensors and fiducial planar markers for patient positioning in radiation therapy , 2019, Comput. Methods Programs Biomed..

[19]  Soumya Ranjan Sahoo,et al.  Vision-based autonomous tracking and landing of a fully-actuated rotorcraft , 2019, Control Engineering Practice.

[20]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[21]  Gary R. Bradski,et al.  Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library , 2016 .

[22]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[24]  Rafael Muñoz-Salinas,et al.  Speeded up detection of squared fiducial markers , 2018, Image Vis. Comput..

[25]  Masanao Koeda,et al.  Development of Wireless Surgical Knife Attachment with Proximity Indicators Using ArUco Marker , 2018, HCI.

[26]  Xu Zhang,et al.  Large-scale 3D printing by a team of mobile robots , 2018, Automation in Construction.

[27]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[28]  Jacob M. Graving,et al.  An automated barcode tracking system for behavioural studies in birds , 2017, bioRxiv.

[29]  Mark Fiala,et al.  Designing Highly Reliable Fiducial Markers , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Daniel Cremers,et al.  LDSO: Direct Sparse Odometry with Loop Closure , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Rafael Muñoz-Salinas,et al.  Flexible body scanning without template models , 2019, Signal Process..

[32]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[33]  Nobuyuki Otsu,et al.  ATlreshold Selection Method fromGray-Level Histograms , 1979 .

[34]  Jan Fischer,et al.  A Lightweight ID-Based Extension for Marker Tracking Systems , 2007, EGVE.

[35]  Pavol Fedor,et al.  Autonomous flying with quadrocopter using fuzzy control and ArUco markers , 2017, Intell. Serv. Robotics.

[36]  Rafael Muñoz-Salinas,et al.  Robust identification of fiducial markers in challenging conditions , 2018, Expert Syst. Appl..

[37]  Fabio Bruno,et al.  Detecting Square Markers in Underwater Environments , 2019, Remote. Sens..

[38]  Alberto Finzi,et al.  Kinesthetic teaching and attentional supervision of structured tasks in human–robot interaction , 2019, Auton. Robots.