Plane Registration Leveraged by Global Constraints for Context‐Aware AEC Applications

In this article, we propose a new registration algorithm and computing framework, the KEG tracker, for estimating a camera's position and orientation for a general class of mobile context-aware applications in Architecture, Engineering, and Construction (AEC). By studying two classic natural marker-based reg- istration algorithms, Homography-from-detection and Homography-from-tracking, and by overcoming their specific limitations of jitter and drift, our method applies two global constraints (geometric and appearance) to prevent tracking errors from propagating between con- secutive frames. The proposed method is able to achieve an increase in both stability and accuracy, while being fast enough for real-time applications. Experiments on both synthesized and real-world test cases demonstrate that our method is superior to existing state-of-the-art registration algorithms. The article also explores several AEC applications of our method in context-aware com- puting and desktop-augmented reality.

[1]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[2]  Andrew J. May,et al.  Opportunities and challenges for location aware computing in the construction industry , 2005, Mobile HCI.

[3]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  FuaPascal,et al.  Monocular model-based 3D tracking of rigid objects , 2005 .

[5]  Andrew G. Dempster,et al.  Indoor Positioning Techniques Based on Wireless LAN , 2007 .

[6]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[9]  Vineet R. Kamat,et al.  WLAN based user position tracking for contextual information access in indoor construction environments , 2007 .

[10]  Chimay J. Anumba,et al.  Context Aware Information Delivery for On-Site Construction Operations , 2005 .

[11]  M. Matsumoto,et al.  RFID Indoor Positioning Based on Probabilistic RFID Map and Kalman Filtering , 2007 .

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  Jiri Matas,et al.  Matching with PROSAC - progressive sample consensus , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[17]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[18]  Chimay J. Anumba,et al.  Ubiquitous location tracking for context-specific information delivery on construction sites , 2008 .

[19]  Dieter Schmalstieg,et al.  Robust and unobtrusive marker tracking on mobile phones , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[20]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[21]  Nassir Navab,et al.  A real-time tracking system combining template-based and feature-based approaches , 2007, VISAPP.

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[24]  Fabio Paternò,et al.  Human Computer Interaction with Mobile Devices , 2002, Lecture Notes in Computer Science.

[25]  Selim Benhimane,et al.  Real-time image-based tracking of planes using efficient second-order minimization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[26]  Vineet R. Kamat,et al.  Evaluation of Augmented Reality for Rapid Assessment of Earthquake-Induced Building Damage , 2007 .

[27]  Vincent Lepetit,et al.  Monocular Model-based 3d Tracking of Rigid Objects (Foundations and Trends in Computer Graphics and Vision(R)) , 2005 .

[28]  Vineet R. Kamat,et al.  Collaborative visualization of simulated processes using tabletop fiducial augmented reality , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[29]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[30]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[31]  Vineet R. Kamat,et al.  Evaluation of position tracking technologies for user localization in indoor construction environments , 2009 .

[32]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Patrick Rives,et al.  Vision-based Control for Car Platooning using Homography Decomposition , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[34]  Vincent Lepetit,et al.  Fast Keypoint Recognition in Ten Lines of Code , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Tom Drummond,et al.  Robust feature matching in 2.3µs , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Vineet R. Kamat,et al.  Integration of infrastructure based positioning systems and inertial navigation for ubiquitous context-aware engineering applications , 2011, Adv. Eng. Informatics.

[37]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[38]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[39]  Silvio Savarese,et al.  Semantic structure from motion , 2011, CVPR 2011.

[40]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[41]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[42]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[43]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[44]  E. Malis,et al.  Deeper understanding of the homography decomposition for vision-based control , 2007 .