[POSTER] Augmented Reality for User-Friendly Intra-Oral Scanning

Digital impressions of teeth, obtained through intra-oral scanning, allow for more efficient and cost effective treatments of many dental indications. Current state-of-the-art intra-oral impression acquisition systems make use of a separate monitor to show the scanning progress, forcing the dentist to divert attention away from the scanner and the patient. In this paper, we present an augmented reality based solution to this problem. During the scanning process, an optical see-through head-mounted display is used to show an online overlay of the dynamic dental model onto the patient's teeth. The dentist can then fully focus on the patient and the scanner, while still being able to keep track of the current state of the model. This type of novel application, which fundamentally changes the humancomputer interaction of intra-oral scanning systems, requires a fast and accurate registration of a dynamically growing model onto a glossy, partially occluded surface at a very small scale. To meet this demand, we propose application tailored algorithms for indirect high accuracy online 3D teeth tracking and optical see-through head-mounted display calibration. Experimental results indicate that our system does have a potential to noticeably facilitate intraoral scanning in the future.

[1]  Luc Van Gool,et al.  In-hand scanning with online loop closure , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[2]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[3]  Ji Zhou,et al.  Evaluation of calibration procedures for optical see-through head-mounted displays , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[4]  Nassir Navab,et al.  Single-Point Active Alignment Method (SPAAM) for Optical See-Through HMD Calibration for Augmented Reality , 2002, Presence: Teleoperators & Virtual Environments.

[5]  Anton L. Fuhrmann,et al.  Comprehensive Calibration and Registration Procedures for Augmented Reality , 2001, EGVE/IPT.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Nassir Navab,et al.  Optical see-through calibration with vision-based trackers: propagation of projection matrices , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[8]  Nassir Navab,et al.  Optical see-through HMD calibration: a stereo method validated with a video see-through system , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[10]  Kenneth R. Moser,et al.  [POSTER] Improved SPAAM Robustness through Stereo Calibration , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[13]  Alain Pagani,et al.  Learning to Fuse: A Deep Learning Approach to Visual-Inertial Camera Pose Estimation , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[14]  Harald Wuest,et al.  A camera-based calibration for automotive augmented reality Head-Up-Displays , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[15]  Peter Kazanzides,et al.  Modeling Physical Structure as Additional Constraints for Stereoscopic Optical See-Through Head-Mounted Display Calibration , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[16]  Kenneth R. Moser,et al.  Calibration and interaction in optical see-through augmented reality using leap motion , 2016, VR.

[17]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[18]  Gudrun Klinker,et al.  Automated Spatial Calibration of HMD Systems with Unconstrained Eye-cameras , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[19]  Timo Engelke,et al.  User friedly calibration and tracking for optical stereo see-through augmented reality , 2014, ISMAR.