Fuzzy gaze control-based navigational assistance system for visually impaired people in a dynamic indoor environment

285 million people are estimated to be visually impaired worldwide. Visually impaired people typically use a white cane or a guide dog or both of them to walk down the street. However, such as a cane and/or a dog are not enough to secure them from being collided with obstacles in a dynamic environment. This paper proposes a navigational assistance system based on fuzzy integral-based gaze control for visually impaired people in a dynamic indoor environment. It largely consists of an RGB-D camera and a vibrotactile vest interface. The RGB-D camera detects static and dynamic obstacles and obtains obstacle information on their center positions, sizes, and velocities. The fuzzy integral-based gaze control for obstacle detection is proposed to reduce a blind spot of the camera and obtain more information of the environment. The vibrotactile vest interface notifies a direction to avoid the obstacle using a fuzzy integral-based imminent-obstacle selection algorithm. To confirm the performance of the proposed assistance system for visually impaired people, experiments are carried out in an indoor dynamic environment.

[1]  Genci Capi,et al.  Development of a New Robotic System for Assisting Visually Impaired People , 2012, Int. J. Soc. Robotics.

[2]  D. Pascolini,et al.  Global estimates of visual impairment: 2010 , 2011, British Journal of Ophthalmology.

[3]  Gerard Lacey,et al.  The Evolution of Guido , 2008, IEEE Robotics & Automation Magazine.

[4]  Beatriz Defez Garcia,et al.  Real-time assistance prototype — A new navigation aid for blind people , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[5]  José L. González-Mora,et al.  Development of a New Space Perception System for Blind People, Based on the Creation of a Virtual Acoustic Space , 1999, IWANN.

[6]  Laurent Itti,et al.  A System for Assisting the Visually Impaired in Localization and Grasp of Desired Objects , 2014, ECCV Workshops.

[7]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[8]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Michael Lawo,et al.  Wearable Navigation System for the Visually Impaired and Blind People , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[10]  Liang-Gee Chen,et al.  An intelligent depth-based obstacle detection system for visually-impaired aid applications , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[11]  Shraga Shoval,et al.  NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired] , 2003, IEEE Robotics Autom. Mag..

[12]  Soo-Chang Pei,et al.  Census-based vision for auditory depth images and speech navigation of visually impaired users , 2011, IEEE Transactions on Consumer Electronics.

[13]  Jong-Hwan Kim,et al.  Obstacle Detection Using Fuzzy Integral-Based Gaze Control for Mobile Robot , 2012, RiTA.

[14]  P. Aigner,et al.  Shared control framework applied to a robotic aid for the blind , 1999 .

[15]  Lu Wang,et al.  The design and implementation of a walking assistant system with vibrotactile indication and voice prompt for the visually impaired , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[16]  Yunhui Liu,et al.  A wearable stereo vision system for visually impaired , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[17]  C. Ye,et al.  NCC-RANSAC: A fast plane extraction method for navigating a smart cane for the visually impaired , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[18]  G. Medioni,et al.  RGB-D camera Based Navigation for the Visually Impaired , 2011 .

[19]  N. Bourbakis,et al.  Sensing Surrounding 3-D Space for Navigation of the Blind , 2008, IEEE Engineering in Medicine and Biology Magazine.

[20]  Abdesselam Bouzerdoum,et al.  Pedestrian sensing using time-of-flight range camera , 2011, CVPR 2011 WORKSHOPS.

[21]  Hyun Myung,et al.  Landmark-Based Particle Localization Algorithm for Mobile Robots With a Fish-Eye Vision System , 2013, IEEE/ASME Transactions on Mechatronics.

[22]  Laehyun Kim,et al.  An electronic traveler aid for the blind using multiple range sensors , 2009, IEICE Electron. Express.

[23]  Jong-Hwan Kim,et al.  Fuzzy Integral-Based Gaze Control of a Robotic Head for Human Robot Interaction , 2015, IEEE Transactions on Cybernetics.

[24]  Jong-Hwan Kim,et al.  Fuzzy Integral-Based Gaze Control Architecture Incorporated With Modified-Univector Field-Based Navigation for Humanoid Robots , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  René Farcy,et al.  Optical Device Indicating a Safe Free Path to Blind People , 2012, IEEE Transactions on Instrumentation and Measurement.

[26]  Z. Zenn Bien,et al.  Multiobjective Navigation of a Guide Mobile Robot for the Visually Impaired Based on Intention Inference of Obstacles , 2001, Auton. Robots.

[27]  Charles M. Higgins,et al.  A Navigation Aid for the Blind Using Tactile-Visual Sensory Substitution , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Arun K. Majumdar,et al.  An electronic travel aid for navigation of visually impaired persons , 2011, 2011 Third International Conference on Communication Systems and Networks (COMSNETS 2011).

[29]  A Y C Nee,et al.  Assistive obstacle detection and navigation devices for vision-impaired users , 2013, Disability and rehabilitation. Assistive technology.

[30]  Salvatore Graziani,et al.  Multisensor Strategies to Assist Blind People: A Clear-Path Indicator , 2009, IEEE Transactions on Instrumentation and Measurement.

[31]  Eiichiro Takahagi A fuzzy measure identification method by diamond pairwise comparisons and $${\phi_s}$$ transformation , 2008, Fuzzy Optim. Decis. Mak..

[32]  Jun Ishikawa,et al.  Indoor-Outdoor Navigation System for Visually-Impaired Pedestrians: Preliminary Evaluation of Position Measurement and Obstacle Display , 2011, 2011 15th Annual International Symposium on Wearable Computers.