3D registration on mobile platforms using an accelerometer

In the last several years 3D shape reconstruction and 3D registration using mobile platforms, i.e. smartphones and tablets, have been an increasingly active research avenue. Besides camera(s), nowadays mobile devices are equipped with a variety of sensors, including an accelerometer, a magnetometer and a gyroscope which are, among other applications, extensively used for the task of 3D registration too. To this end usually more than two sensors are utilized. In this work we demonstrate the usage of a tablet as 3D structured light scanner, and we further propose 3D registration method using only single sensor data, supplied by an accelerometer. Briefly, using an accelerometer our method first estimates only few candidate rotations in the spatial domain. Next, for each rotation candidate, the optimal translation is computed using a correlation function, efficiently implemented in the frequency domain. The final 3D registration parameters are chosen based on ICP refinement. The experimental results show a very close agreement with ground truth data. The proposed method is not restricted to mobile platforms only, but it is applicable to any 3D device which can be upgraded with an ubiquitous accelerometer.

[1]  Tomislav Pribanić,et al.  Temporal phase unwrapping using orthographic projection , 2017 .

[2]  Philippe De Smedt,et al.  Towards a three-dimensional cost-effective registration of the archaeological heritage , 2013 .

[3]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Joaquim Salvi,et al.  ' s personal copy Efficient multiple phase shift patterns for dense 3 D acquisition in structured light scanning , 2010 .

[5]  Xavier Lladó,et al.  Revisiting Intensity-Based Image Registration Applied to Mammography , 2011, IEEE Transactions on Information Technology in Biomedicine.

[6]  Du Q. Huynh,et al.  Metrics for 3D Rotations: Comparison and Analysis , 2009, Journal of Mathematical Imaging and Vision.

[7]  Sang Uk Lee,et al.  Registration of multiple-range views using the reverse-calibration technique , 1998, Pattern Recognit..

[8]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[9]  Carlos Martínez,et al.  Automated bin picking system for randomly located industrial parts , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[10]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[12]  Stefano Soatto,et al.  Integral Invariant Signatures , 2004, ECCV.

[13]  Joaquim Salvi,et al.  A Qualitative Review on 3D Coarse Registration Methods , 2015, ACM Comput. Surv..

[14]  Pushmeet Kohli,et al.  MobileFusion: Real-Time Volumetric Surface Reconstruction and Dense Tracking on Mobile Phones , 2015, IEEE Transactions on Visualization and Computer Graphics.

[15]  Oscar Cordón,et al.  A comparative study of state-of-the-art evolutionary image registration methods for 3D modeling , 2011, Comput. Vis. Image Underst..

[16]  M. Milinkovitch,et al.  R2OBBIE-3D, a Fast Robotic High-Resolution System for Quantitative Phenotyping of Surface Geometry and Colour-Texture , 2015, PloS one.

[17]  Leonidas J. Guibas,et al.  Database‐Assisted Object Retrieval for Real‐Time 3D Reconstruction , 2015, Comput. Graph. Forum.

[18]  Forest Baskett,et al.  An Algorithm for Finding Nearest Neighbors , 1975, IEEE Transactions on Computers.

[19]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[20]  In Kyu Park,et al.  Active 3D shape acquisition using smartphones , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Ron Kimmel,et al.  Freehand Laser Scanning Using Mobile Phone , 2015, BMVC.

[23]  Yu Zhong,et al.  Intrinsic shape signatures: A shape descriptor for 3D object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[24]  Simone Gasparini,et al.  3D Structured Light Scanner on the Smartphone , 2016, ICIAR.

[25]  Joaquim Salvi,et al.  An efficient surface registration using smartphone , 2016, Machine Vision and Applications.

[26]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[27]  Weisi Lin,et al.  Detecting keypoint sets on 3D point clouds via Histogram of Normal Orientations , 2016, Pattern Recognit. Lett..

[28]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[29]  Marc Pollefeys,et al.  Live Metric 3D Reconstruction on Mobile Phones , 2013, 2013 IEEE International Conference on Computer Vision.

[30]  Richard I. Hartley,et al.  Global Optimization through Rotation Space Search , 2009, International Journal of Computer Vision.