Voice-controlled smart assistive device for visually impaired individuals

This paper presents the modeling, implementation and testing of an experimental microcontroller (MCU) based smart assistive system which can be used by the visually impaired or blind people. This device includes haptic and audio feedback options from which the user can select. A Smart Phone can be used to control the device using predefined voice commands and Bluetooth connectivity. The device is portable and the purpose of its usage is to warn the user when objects are present on the walking path so collision can be avoided. Distance measurements, between the user and possible obstacles, are performed using ultrasonic echolocation and the data provided by the ultrasonic sensor is processed by a microcontroller, which also handles the feedback part. The hardware design, software architecture and mechanical design of the enclosure as well as the breadboard prototyping are covered in this material. Experimental results performed in different functionality scenarios demonstrate that the proposed system can be successfully used to fulfill its purpose.

[1]  Juan Aceros,et al.  A necklace sonar with adjustable scope range for assisting the visually impaired , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Gang Luo,et al.  Magnifying Smartphone Screen Using Google Glass for Low-Vision Users , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Bruno Ando,et al.  A Haptic Solution to Assist Visually Impaired in Mobility Tasks , 2015, IEEE Transactions on Human-Machine Systems.

[4]  Kishor Bhurchandi,et al.  Low Cost E-Book Reading Device for Blind People , 2015, 2015 International Conference on Computing Communication Control and Automation.

[5]  Franco Tecchia Fundamentals of Wearable Computers and Augmented Reality, Second Edition , 2016, PRESENCE: Teleoperators and Virtual Environments.

[6]  Nikolaos G. Bourbakis,et al.  A 2D Vibration Array as an Assistive Device for Visually Impaired , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.