Achieving Practical and Accurate Indoor Navigation for People with Visual Impairments

Methods that provide accurate navigation assistance to people with visual impairments often rely on instrumenting the environment with specialized hardware infrastructure. In particular, approaches that use sensor networks of Bluetooth Low Energy (BLE) beacons have been shown to achieve precise localization and accurate guidance while the structural modifications to the environment are kept at minimum. To install navigation infrastructure, however, a number of complex and time-critical activities must be performed. The BLE beacons need to be positioned correctly and samples of Bluetooth signal need to be collected across the whole environment. These tasks are performed by trained personnel and entail costs proportional to the size of the environment that needs to be instrumented. To reduce the instrumentation costs while maintaining a high accuracy, we improve over a traditional regression-based localization approach by introducing a novel, graph-based localization method using Pedestrian Dead Reckoning (PDR) and particle filter. We then study how the number and density of beacons and Bluetooth samples impact the balance between localization accuracy and set-up cost of the navigation environment. Studies with users show the impact that the increased accuracy has on the usability of our navigation application for the visually impaired.

[1]  Kostas E. Bekris,et al.  The user as a sensor: navigating users with visual impairments in indoor spaces using tactile landmarks , 2012, CHI.

[2]  A. M. Tekalp,et al.  Multiple camera tracking of interacting and occluded human motion , 2001, Proc. IEEE.

[3]  Amy Hurst,et al.  "just let the cane hit it": how the blind and sighted see navigation differently , 2014, ASSETS.

[4]  Julien Ryckaert,et al.  Channel model for wireless communication around human body , 2004 .

[5]  James M Coughlan,et al.  Crosswatch: a System for Providing Guidance to Visually Impaired Travelers at Traffic Intersections. , 2013, Journal of assistive technologies.

[6]  Eelke Folmer,et al.  Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces , 2014, ASSETS.

[7]  Eckehard Steinbach,et al.  Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning , 2014, UbiComp.

[8]  Roberto Manduchi,et al.  Assistive Technology for Blindness and Low Vision , 2018 .

[9]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[10]  Dragan Peraković,et al.  Model of guidance for visually impaired persons in the traffic network , 2015 .

[11]  J Faria,et al.  Electronic white cane for blind people navigation assistance , 2010, 2010 World Automation Congress.

[12]  Michitaka Hirose,et al.  Virtual leading blocks for the deaf-blind: a real-time way-finder by verbal-nonverbal hybrid interface and high-density RFID tag space , 2004, IEEE Virtual Reality 2004.

[13]  Hironobu Takagi,et al.  NavCog: a navigational cognitive assistant for the blind , 2016, MobileHCI.

[14]  Robert Harle,et al.  Location Fingerprinting With Bluetooth Low Energy Beacons , 2015, IEEE Journal on Selected Areas in Communications.

[15]  Gordon E. Legge,et al.  Indoor Navigation by People with Visual Impairment Using a Digital Sign System , 2013, PloS one.

[16]  S. Chumkamon,et al.  A blind navigation system using RFID for indoor environments , 2008, 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[17]  Tomohiro Tanikawa,et al.  Indoor Marker-based Localization Using Coded Seamless Pattern for Interior Decoration , 2007, 2007 IEEE Virtual Reality Conference.

[18]  Alan L. Yuille,et al.  The Manhattan World Assumption: Regularities in Scene Statistics which Enable Bayesian Inference , 2000, NIPS.

[19]  Georgina Kleege Visible Braille/Invisible Blindness , 2006 .

[20]  Roberto Manduchi,et al.  Zebra Crossing Spotter: Automatic Population of Spatial Databases for Increased Safety of Blind Travelers , 2015, ASSETS.

[21]  C. Galindo,et al.  Combination of UWB and GPS for indoor-outdoor vehicle localization , 2007, 2007 IEEE International Symposium on Intelligent Signal Processing.

[22]  Dragan Ahmetovic,et al.  ZebraRecognizer: Pedestrian crossing recognition for people with visual impairment or blindness , 2016, Pattern Recognit..

[23]  Hironobu Takagi,et al.  Supporting Orientation of People with Visual Impairment: Analysis of Large Scale Usage Data , 2016, ASSETS.

[24]  Shinichiro Haruyama,et al.  Indoor navigation system for visually impaired people using visible light communication and compensated geomagnetic sensing , 2012, 2012 1st IEEE International Conference on Communications in China (ICCC).

[25]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[26]  Torben Poulsen Acoustic traffic signal for blind pedestrians , 1982 .

[27]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[28]  S.J. LaGrow,et al.  Three Aspects of Coverage Provided by the Long Cane: Object, Surface, and Foot-Placement Preview , 1996 .

[29]  Alessandro Rizzi,et al.  Robust traffic lights detection on mobile devices for pedestrians with visual impairment , 2016, Comput. Vis. Image Underst..

[30]  Hironobu Takagi,et al.  NavCog: turn-by-turn smartphone navigation assistant for people with visual impairments or blindness , 2016, W4A.

[31]  Dragan Ahmetovic,et al.  Mind your crossings: Mining GIS imagery for crosswalk localization , 2016 .

[32]  Pius D.S. Kinako,et al.  Conserving the mangrove forest of the Niger Delta , 1977 .

[33]  Agata Brajdic,et al.  Walk detection and step counting on unconstrained smartphones , 2013, UbiComp.

[34]  Per Ola Kristensson,et al.  Supporting blind navigation using depth sensing and sonification , 2013, UbiComp.

[35]  Dragan Ahmetovic,et al.  ZebraRecognizer: Efficient and Precise Localization of Pedestrian Crossings , 2014, 2014 22nd International Conference on Pattern Recognition.