AmIE: An Ambient Intelligent Environment for Blind and Visually Impaired People

The Internet of things (IoT) is a revolutionary technology that is rapidly changing our world. IoT systems are becoming essential in modern life; traditional devices are becoming ubiquitous, connected, wireless, and smart. The aim of this investigation is to develop an IoT context-aware system that creates an Ambient Intelligence environment; in an apartment, house, or a building; to assist blind, visually-impaired, and elderly people. The main challenges that the system addresses include supporting assisted navigation, communication, security, and safe-living at an affordable cost. The proposed solution aims at providing effective indoor navigation, an easy-to-deploy system, a multilingual user-friendly interface and supports speech instructions. The proposed system is supported by sensors, communication nodes, control processors, wireless Internet access, a smart watch, to name but a few. The chapter includes studying the effectiveness of adding Bluetooth low energy devices at doors, stairs, walls, exit signs, service rooms, and more to enable accurate navigation. In addition, an investigation is included on the training needed by the users as related to the adoption of such a modern tool. System testing includes multiple navigation scenarios, accuracies, reliability of interactions, and the effectiveness of the multilingual features. System testing, analysis, and evaluation confirm the effectiveness of the developed system in application.

[1]  Issam W. Damaj,et al.  RECON: A remotely controlled drone for roads safety , 2014, 2014 International Conference on Connected Vehicles and Expo (ICCVE).

[2]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[3]  Issam Damaj,et al.  AgriSys: A smart and ubiquitous controlled-environment agriculture system , 2016, 2016 3rd MEC International Conference on Big Data and Smart City (ICBDSC).

[4]  Safaa J. Kasbah,et al.  Integrated Mobile Solutions in an Internet-of-Things Development Model , 2020, ArXiv.

[5]  Issam W. Damaj,et al.  HOBOT: A customizable home management system with a surveillance RoBOT , 2014, 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE).

[6]  L. Dunai,et al.  3D CMOS sensor based acoustic object detection and navigation system for blind people , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[7]  Pelin Angin,et al.  Real-time Mobile-Cloud Computing for Context- Aware Blind Navigation , 2011, Int. J. Next Gener. Comput..

[8]  Weihua Sheng,et al.  Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  Yue Liu,et al.  Bluetooth positioning using RSSI and triangulation methods , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[10]  B. R. Prudhvi,et al.  Silicon eyes: GPS-GSM based navigation assistant for visually impaired using capacitive touch braille keypad and smart SMS facility , 2013, 2013 World Congress on Computer and Information Technology (WCCIT).

[11]  Milan Hudec,et al.  RUDO: A Home Ambient Intelligence System for Blind People , 2017, Sensors.

[12]  Josechu J. Guerrero,et al.  Navigation Assistance for the Visually Impaired Using RGB-D Sensor With Range Expansion , 2016, IEEE Systems Journal.

[13]  Issam W. Damaj,et al.  SysMART Indoor Services: A System of Smart and Connected Supermarkets , 2018, 2018 IEEE Canadian Conference on Electrical & Computer Engineering (CCECE).

[14]  João Barroso,et al.  Blind Guide: An Ultrasound Sensor-based Body Area Network for Guiding Blind People , 2015, DSAI.

[15]  Iyad Abu Doush,et al.  ISAB: Integrated Indoor Navigation System for the Blind , 2016, Interact. Comput..

[16]  Mari Carmen Domingo,et al.  An overview of the Internet of Things for people with disabilities , 2012, J. Netw. Comput. Appl..

[17]  Vinod Namboodiri,et al.  GuideBeacon: Beacon-based indoor wayfinding for the blind, visually impaired, and disoriented , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[18]  Zsolt Toth,et al.  Development of Bluetooth based indoor positioning application , 2018, 2018 IEEE International Conference on Future IoT Technologies (Future IoT).

[19]  Issam W. Damaj,et al.  A wearable and ubiquitous NFC wallet , 2015, 2015 IEEE 28th Canadian Conference on Electrical and Computer Engineering (CCECE).