An Interactive Indoor 3D Reconstruction Method Based on Conformal Geometry Algebra

This paper presents an approach for indoor reconstruction using smartphones. The smartphones sensors are used for measuring the azimuth angle and pitch angle. With these angles, the rooms of the indoor scene are effectively reconstructed. Then the separately reconstructed models are aligned together to form a complete model. Meanwhile, the conformal geometry algebra is used as computing framework. Comparing to other reconstruction approaches, the use of conformal geometry algebra not only simplifies the construction of geometry, but also unifies the representation of all kinds of geometry relations. Remarkably the proposed approach does not need to take photos during the reconstruction process, and it requires only a little clicking on the developed mobile application to build the model. To verify the proposed approach, a typical apartment was chosen as experiment environment. Result from the experiment suggests that the proposed approach is very efficient and suitable for mobile platform.

[1]  David A. Forsyth,et al.  Thinking Inside the Box: Using Appearance Models and Context Based on Room Geometry , 2010, ECCV.

[2]  Roberto Scopigno,et al.  Mobile reconstruction and exploration of indoor structures exploiting omnidirectional images , 2016, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[3]  Aizhu Ren,et al.  GIS-based 3D evacuation simulation for indoor fire , 2012 .

[4]  David A. Forsyth,et al.  Recovering free space of indoor scenes from a single image , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Marc Pollefeys,et al.  Interactive 3D architectural modeling from unordered photo collections , 2008, SIGGRAPH 2008.

[6]  B. Siemiątkowska,et al.  BIM Based Indoor Navigation System of Hermes Mobile Robot , 2013 .

[7]  M. Nakagawa,et al.  TOPOLOGICAL 3D MODELING USING INDOOR MOBILE LIDAR DATA , 2015 .

[8]  Sisi Zlatanova,et al.  A BIM-Oriented Model for supporting indoor navigation requirements , 2013, Comput. Environ. Urban Syst..

[9]  Steven M. Seitz,et al.  Capturing indoor scenes with smartphones , 2012, UIST.

[10]  Leo Reyes,et al.  Conformal Geometric Algebra for Robotic Vision , 2005, Journal of Mathematical Imaging and Vision.

[11]  Eduardo Bayro-Corrochano,et al.  Integration of Hough Transform of lines and planes in the framework of conformal geometric algebra for 2D and 3D robot vision , 2011, Pattern Recognit. Lett..

[12]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, CVPR.

[13]  Josechu J. Guerrero,et al.  Scene structure recovery from a single omnidirectional image , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[14]  A-Xing Zhu,et al.  Geometric Algebra Model for Geometry-oriented Topological Relation Computation , 2016, Trans. GIS.

[15]  Hui Zhang,et al.  Modeling room structure from indoor panorama , 2014, VRCAI '14.

[16]  Peiquan Jin,et al.  Extracting Indoor Spatial Objects from CAD Models: A Database Approach , 2015, DASFAA Workshops.

[17]  Reinhard Klette,et al.  Monocular 3D Reconstruction of Objects Based on Cylindrical Panoramas , 2009, PSIVT.

[18]  Silvio Savarese,et al.  Free your Camera: 3D Indoor Scene Understanding from Arbitrary Camera Motion , 2013, BMVC.

[19]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Silvio Savarese,et al.  Understanding Indoor Scenes Using 3D Geometric Phrases , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Marcel Worring,et al.  A semi-interactive panorama based 3D reconstruction framework for indoor scenes , 2011, Comput. Vis. Image Underst..

[22]  Andreas Zell,et al.  Automatic Generation of Indoor VR-Models by a Mobile Robot with a Laser Range Finder and a Color Camera , 2005, AMS.

[23]  Derek Hoiem,et al.  Recovering the spatial layout of cluttered rooms , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[24]  Ian D. Reid,et al.  Manhattan scene understanding using monocular, stereo, and 3D features , 2011, 2011 International Conference on Computer Vision.

[25]  Yong-Moo Kwon,et al.  Indoor Environment Modeling for Interactive VR - Based Robot Security Service , 2006, ICAT.

[26]  Daniel Fried,et al.  Bayesian geometric modeling of indoor scenes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Guonian Lü,et al.  A Hierarchical Representation and Computation Scheme of Arbitrary-dimensional Geometrical Primitives Based on CGA , 2017 .

[28]  Jaishanker K. Pillai,et al.  Manhattan Junction Catalogue for Spatial Reasoning of Indoor Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Takeo Kanade,et al.  Geometric reasoning for single image structure recovery , 2009, CVPR.

[30]  Matthew Brand,et al.  Lifting 3D Manhattan Lines from a Single Image , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Yinda Zhang,et al.  PanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding , 2014, ECCV.

[32]  Eduardo Bayro-Corrochano,et al.  The Motor Extended Kalman Filter: A Geometric Approach for Rigid Motion Estimation , 2004, Journal of Mathematical Imaging and Vision.

[33]  Wolfgang Effelsberg,et al.  Floor-plan reconstruction from panoramic images , 2007, ACM Multimedia.

[34]  Ricardo Cabral,et al.  Piecewise Planar and Compact Floorplan Reconstruction from Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Bo Wu,et al.  INTEGRATION OF GIS AND BIM FOR INDOOR GEOVISUAL ANALYTICS , 2016 .

[36]  Marc Pollefeys,et al.  Efficient structured prediction for 3D indoor scene understanding , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Dirk Farin.  Reconstructing virtual rooms from panoramic images , 2005 .

[38]  Richard Szeliski,et al.  Stereo reconstruction from multiperspective panoramas , 2004 .

[39]  Yong Hu,et al.  A dynamic evacuation simulation framework based on geometric algebra , 2016, Comput. Environ. Urban Syst..

[40]  Takeo Kanade,et al.  Estimating Spatial Layout of Rooms using Volumetric Reasoning about Objects and Surfaces , 2010, NIPS.