Toward the use of smartphones for mobile mapping

Abstract This paper considers the use of a low cost mobile device in order to develop a mobile mapping system (MMS), which exploits only sensors embedded in the device. The goal is to make this MMS usable and reliable even in difficult environments (e.g. emergency conditions, when also WiFi connection might not work). For this aim, a navigation system able to deal with the unavailability of the GNSS (e.g. indoors) is proposed first. Positioning is achieved by a pedestrian dead reckoning approach, i.e. a specific particle filter has been designed to enable good position estimations by a small number of particles (e.g. 100). This specific characteristic enables its real time use on the standard mobile devices. Then, 3D reconstruction of the scene can be achieved by processing multiple images acquired with the standard camera embedded in the device. As most of the vision-based 3D reconstruction systems are recently proposed in the literature, this work considers the use of structure from motion to estimate the geometrical structure of the scene. The detail level of the reconstructed scene is clearly related to the number of images processed by the reconstruction system. However, the execution of a 3D reconstruction algorithm on a mobile device imposes several restrictions due to the limited amount of available energy and computing power. This consideration motivates the search for new methods to obtain similar results with less computational cost. This paper proposes a novel method for feature matching, which allows increasing the number of correctly matched features between two images according to our simulations and can make the matching process more robust.

[1]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[2]  Andrea Masiero,et al.  Small Footprint Full-Waveform Metrics Contribution to the Prediction of Biomass in Tropical Forests , 2014, Remote. Sens..

[3]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[4]  Anthony J. Walton,et al.  Integrated Magnetic MEMS Relays: Status of the Technology , 2014, Micromachines.

[5]  Fernando Seco Granja,et al.  Accurate Pedestrian Indoor Navigation by Tightly Coupling Foot-Mounted IMU and RFID Measurements , 2012, IEEE Transactions on Instrumentation and Measurement.

[6]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Charles K. Toth Sensor integration in airborne mapping , 2002, IEEE Trans. Instrum. Meas..

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[10]  Fabio Remondino,et al.  UAV PHOTOGRAMMETRY FOR MAPPING AND 3D MODELING - CURRENT STATUS AND FUTURE PERSPECTIVES - , 2012 .

[11]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[12]  Norbert Pfeifer,et al.  Range camera calibration based on image sequences and dense comprehensive error statistics , 2009, Electronic Imaging.

[13]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[14]  Marco Piras,et al.  Statistical analysis of different low cost GPS receivers for indoor and outdoor positioning , 2010, IEEE/ION Position, Location and Navigation Symposium.

[15]  N. Pfeifer,et al.  AUTOMATIC RECONSTRUCTION OF SINGLE TREES FROM TERRESTRIAL LASER SCANNER DATA , 2004 .

[16]  J. Morel,et al.  Is SIFT scale invariant , 2011 .

[17]  Naser El-Sheimy,et al.  Multisensor integration using neuron computing for land-vehicle navigation , 2003 .

[18]  Harald Sternberg,et al.  STEPPING - Smartphone-Based Portable Pedestrian Indoor Navigation , 2011 .

[19]  Martin Byröd,et al.  Conjugate Gradient Bundle Adjustment , 2010, ECCV.

[20]  Andrea Masiero,et al.  On triangulation algorithms in large scale camera network systems , 2012, 2012 American Control Conference (ACC).

[21]  Xiaoling Chen,et al.  Remote sensing and GIS application in the detection of environmental degradation indicators , 2011, Geo spatial Inf. Sci..

[22]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[23]  Andrea Fusiello,et al.  Quasi-Euclidean epipolar rectification of uncalibrated images , 2010, Machine Vision and Applications.

[24]  Guoliang Chen,et al.  Integrated WiFi/PDR/Smartphone Using an Unscented Kalman Filter Algorithm for 3D Indoor Localization , 2015, Sensors.

[25]  Andrea Masiero,et al.  AN ISVD-BASED EUCLIDIAN STRUCTURE FROM MOTION FOR SMARTPHONES , 2014 .

[26]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[27]  Paul Lukowicz,et al.  Virtual lifeline: Multimodal sensor data fusion for robust navigation in unknown environments , 2012, Pervasive Mob. Comput..

[28]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[29]  Andrea Masiero,et al.  Solar Irradiance Modelling with NASA WW GIS Environment , 2015, ISPRS Int. J. Geo Inf..

[30]  Long Quan,et al.  A quasi-dense approach to surface reconstruction from uncalibrated images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Naser El-Sheimy,et al.  Navigating Urban Areas by VISAT—A Mobile Mapping System Integrating GPS/INS/Digital Cameras for GIS Applications , 1998 .

[32]  K. Kraus,et al.  Determination of terrain models in wooded areas with airborne laser scanner data , 1998 .

[33]  Hao Jiang,et al.  Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization , 2015, Sensors.

[34]  Andrea Masiero,et al.  A Particle Filter for Smartphone-Based Indoor Pedestrian Navigation , 2014, Micromachines.

[35]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[36]  Lucila Patino-Studencki,et al.  Comparison and evaluation of acceleration based step length estimators for handheld devices , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[37]  Alberto Guarnieri,et al.  3D modeling of close-range objects: photogrammetry or laser scanning? , 2005 .

[38]  Wang Tao,et al.  Interdisciplinary urban GIS for smart cities: advancements and opportunities , 2013, Geo spatial Inf. Sci..

[39]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[40]  Naser El-Sheimy,et al.  Context-Aware Personal Navigation Using Embedded Sensor Fusion in Smartphones , 2014, Sensors.

[41]  Andrea Masiero,et al.  Preface to the special issue: the role of geomatics in hydrogeological risk , 2015 .

[42]  Yang Gao,et al.  Ubiquitous indoor vision navigation using a smart device , 2013, Geo spatial Inf. Sci..

[43]  Andrea Masiero,et al.  Improved multivariate image analysis for product quality monitoring , 2011 .

[44]  Suzanne Lesecq,et al.  Calibration methods for inertial and magnetic sensors , 2009 .

[45]  Robert A. Scholtz,et al.  Performance Analysis of , 1998 .

[46]  C. Toth,et al.  PERFORMANCE ANALYSIS OF THE AIRBORNE INTEGRATED MAPPING SYSTEM (AIMSTM) , 2018 .

[47]  F. Pirotti,et al.  Evaluation of the dynamic processes of a landslide with laser scanners and Bayesian methods , 2015 .

[48]  Di Wu,et al.  Heading Estimation for Indoor Pedestrian Navigation Using a Smartphone in the Pocket , 2015, Sensors.

[49]  Andrea Masiero,et al.  Advances on multivariate image analysis for product quality monitoring , 2013 .

[50]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[51]  Yi Lin,et al.  A low-cost multi-sensoral mobile mapping system and its feasibility for tree measurements , 2010 .

[52]  Marc Pollefeys,et al.  Multiple view geometry , 2005 .