A two-dimensional pedestrian navigation solution aided with a visual gyroscope and a visual odometer

Integration of different positioning systems such as wireless local area networks (WLAN) and INS has proven to be the most promising approach for navigation in global navigation satellite system challenging environments. However, the integrated solution suffers from the errors induced by the sensors in the INS and the low availability and infrastructure dependency of the WLAN. Visual aiding is a complementary method for augmenting these systems, because it suffers from errors and availability problems of a different nature. We introduce the concept of a “visual gyroscope” and a “visual odometer,” based on recovering user information by tracking the feature motion between consecutive images. All calculations are of sufficiently low complexity to be adoptable for navigation with current smartphones. The camera orientation is observed using the vanishing point locations, and this information is transformed into user heading change information and also used for visual odometer calculations. The visual odometer retrieves the camera translation information based on a special camera configuration and the motion of the matched scale-invariant feature transform features. The performance of both of these tools is evaluated. Experiments in selected environments have proven that visual aiding with a visual gyroscope and visual odometer improves the two-dimensional navigation solution significantly.

[1]  Alan L. Yuille,et al.  Manhattan World: compass direction from a single image by Bayesian inference , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[3]  D. W. Allan,et al.  Statistics of atomic frequency standards , 1966 .

[4]  Gérard Lachapelle,et al.  Mitigation of attitude and gyro errors through vision aiding , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[5]  Illah R. Nourbakhsh,et al.  A Robust Visual Odometry and Precipice Detection System Using Consumer-grade Monocular Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[6]  Shahram Moafipoor,et al.  Intelligent Personal Navigator Supported by Knowledge-Based Systems for Estimating Dead Reckoning Navigation Parameters , 2010 .

[7]  Valérie Renaudin,et al.  Detection of quasi-static instants from handheld MEMS devices , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[8]  Andrew C. Gallagher Using vanishing points to correct camera rotation in images , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[9]  Sanjiv Singh,et al.  Monocular Visual Odometry using a Planar Road Model to Solve Scale Ambiguity , 2011, ECMR.

[10]  Andrew W. Fitzgibbon,et al.  The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences , 1999, International Journal of Computer Vision.

[11]  Michael Veth,et al.  Fusing Low-Cost Image and Inertial Sensors for Passive Navigation , 2007 .

[12]  Laura Ruotsalainen Visual Gyroscope and Odometer for Pedestrian Indoor Navigation with a Smartphone , 2012 .

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  João M. P. Cardoso,et al.  An Analysis of Navigation Algorithms for Smartphones Using J2ME , 2009, MOBILWARE.

[15]  Michael Veth,et al.  Fusion of Low-Cost Imaging and Inertial Sensors for Navigation , 2007 .

[16]  J. Takala,et al.  Bias Prediction for MEMS Gyroscopes , 2012, IEEE Sensors Journal.

[17]  R. Jirawimut,et al.  Visual odometer for pedestrian navigation , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[18]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  W. Hawkinson,et al.  GLANSER: Geospatial location, accountability, and Navigation System for Emergency Responders - system concept and performance assessment , 2012, Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium.

[20]  Liang Chen,et al.  Reliability considerations of multi-sensor multi-network pedestrian navigation , 2012 .

[21]  Michael Weinmann,et al.  Vision-based attitude estimation for indoor navigation using Vanishing Points and lines , 2010, IEEE/ION Position, Location and Navigation Symposium.

[22]  Michael Veth,et al.  Real-Time Fusion of Image and Inertial Sensors for Navigation , 2007 .

[23]  Yuwei Chen,et al.  Using Motion-Awareness for the 3D Indoor Personal Navigation on a Smartphone , 2011 .

[24]  Yuwei Chen,et al.  Multi-sensor multi-network seamless positioning with visual aiding , 2011, 2011 International Conference on Localization and GNSS (ICL-GNSS).

[25]  Charles K. Toth,et al.  Real-Time Integrity Monitoring of a Dead Reckoning Personal Navigator Using a Two-Stage Neural Kalman Filter , 2012, Journal of Navigation.