A Virtual Blind Cane Using a Line Laser-Based Vision System and an Inertial Measurement Unit

A virtual blind cane system for indoor application, including a camera, a line laser and an inertial measurement unit (IMU), is proposed in this paper. Working as a blind cane, the proposed system helps a blind person find the type of obstacle and the distance to it. The distance from the user to the obstacle is estimated by extracting the laser coordinate points on the obstacle, as well as tracking the system pointing angle. The paper provides a simple method to classify the obstacle’s type by analyzing the laser intersection histogram. Real experimental results are presented to show the validity and accuracy of the proposed system.

[1]  Beatriz Muñoz,et al.  A longitudinal study of the association between visual impairment and mobility performance in older adults: the salisbury eye evaluation study. , 2014, American journal of epidemiology.

[2]  Rosen Ivanov,et al.  Indoor navigation system for visually impaired , 2010, CompSysTech '10.

[3]  Guangjun Zhang,et al.  Complete calibration of a structured light stripe vision sensor through planar target of unknown orientations , 2005, Image Vis. Comput..

[4]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[5]  M. Mahadevappa,et al.  Ultrasonic spectacles and waist-belt for visually impaired and blind person , 2012, 2012 National Conference on Communications (NCC).

[6]  Dongjian He,et al.  Blind-Road Location and Recognition in Natural Scene , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[7]  Young Soo Suh.  Orientation Estimation Using a Quaternion-Based Indirect Kalman Filter With Adaptive Estimation of External Acceleration , 2010, IEEE Transactions on Instrumentation and Measurement.

[8]  A. S. Al-Fahoum,et al.  A Smart Infrared Microcontroller-Based Blind Guidance System , 2013 .

[9]  Sangyoun Lee,et al.  Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind , 2014, Sensors.

[10]  Yoshihiro Niitsu,et al.  Detection and notification of dangerous obstacles and places for visually impaired persons using a smart cane , 2014, 2014 Seventh International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[11]  Darius Burschka,et al.  Optimization based IMU camera calibration , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  E. Pissaloux,et al.  Coding the Environment in Tactile Maps for Real-Time Guidance of the Visually Impaired , 2006, 2006 IEEE International Symposium on MicroNanoMechanical and Human Science.

[13]  Roberto Manduchi,et al.  Dynamic environment exploration using a virtual white cane , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Marcel Tresanchez,et al.  Bioinspired Electronic White Cane Implementation Based on a LIDAR, a Tri-Axial Accelerometer and a Tactile Belt , 2010, Sensors.

[15]  Youfu Li,et al.  Self-recalibration of a structured light system via plane-based homography , 2007, Pattern Recognit..

[16]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[17]  C I Howarth,et al.  The efficiency and walking speed of visually impaired people. , 1986, Ergonomics.

[18]  H. D. Black,et al.  A passive system for determining the attitude of a satellite , 1964 .

[19]  Young Soo Suh,et al.  Foot Pose Estimation Using an Inertial Sensor Unit and Two Distance Sensors , 2015, Sensors.

[20]  Guanrong Chen,et al.  Introduction to random signals and applied Kalman filtering, 2nd edn. Robert Grover Brown and Patrick Y. C. Hwang, Wiley, New York, 1992. ISBN 0‐471‐52573‐1, 512 pp., $62.95. , 1992 .

[21]  Shraga Shoval,et al.  NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired] , 2003, IEEE Robotics Autom. Mag..