Mobility Assistance for Vulnerable Road Users using Machine Learning

This paper presents the research for the development of a new assistance system to increase the independent mobility of vulnerable road users (VRUs). This assistance system helps the elderly mobile users in virtually screening of directions using GPS, tracking of sidewalks, identifying the traffic signals and other sign boards. MATLAB/Simulink serves as the main software used in developing this application. Images and other types of data are captured using sensors on Android devices. AlexNet is used to identify and classify different traffic warning signs in real-time. A detailed description of this method and the results are presented in this paper. Once the MATLAB-based program is developed, it can be converted into Java codes when needed. Using Android Studio, the code can be used in the application. VRUs with mobility impairments and vision deficiencies often find it difficult to use wheelchair on sidewalks. This paper also presents a sidewalk tracking system with a departure warning. In this research, Hough Transform is used to present the detection of sidewalk. This sidewalk tracking system can provide the user with essential information that can minimize the risk of an accident. Elaborated implementation of this system and results are presented in this paper. Rerouting the user when they approach the end of the sidewalk is left for future work. The application will further be developed to provide a voice navigation informing the departure warning, a traffic signal or a recognized sign board.

[1]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[2]  Shraga Shoval,et al.  NavBelt and the guideCane , 2003 .

[3]  Romina Kühn,et al.  Mobility Impaired Pedestrians Are Not Cars: Requirements for the Annotation of Geographical Data , 2008, ICCHP.

[4]  David J. Calder,et al.  Ecological solutions for the blind , 2010, 4th IEEE International Conference on Digital Ecosystems and Technologies.

[5]  Soh-Khim Ong,et al.  A multiple sensor-based shoe-mounted user interface designed for navigation systems for the visually impaired , 2010, 2010 The 5th Annual ICST Wireless Internet Conference (WICON).

[6]  J. M. Hans du Buf,et al.  The SmartVision local navigation aid for blind and visually impaired persons , 2011 .

[7]  C. Victor,et al.  Emotional well-being and adjustment to vision loss in later life: a meta-synthesis of qualitative studies , 2012, Disability and rehabilitation.

[8]  Lilit Hakobyan,et al.  Mobile assistive technologies for the visually impaired. , 2013, Survey of ophthalmology.

[9]  M. Zaw,et al.  Detection of Lane Departure using 2-D FIR and Hough Transform , 2014 .

[10]  Hla Myo Tun,et al.  Design and Simulation of Vehicle Lane Tracking Using Matlab , 2014 .

[11]  M. Zaw,et al.  Video Based Lane Departure Warning System using Hough Transform , 2014 .

[12]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[13]  Nan Sun,et al.  Color image encryption in YCbCr space , 2016, 2016 8th International Conference on Wireless Communications & Signal Processing (WCSP).

[14]  Pravin T. Mandlik,et al.  Image Processing based Lane Departure Warning System Using Hough Transform and Euclidean Distance , 2016 .

[15]  Stuart Newstead,et al.  Understanding fatal older road user crash circumstances and risk factors , 2018, Traffic injury prevention.

[16]  J Roca,et al.  Accident ahead? Difficulties of drivers with and without reading impairment recognising words and pictograms in variable message signs. , 2018, Applied ergonomics.

[17]  Gudmundur F. Ulfarsson,et al.  Traffic safety in an aging society: Analysis of older pedestrian crashes , 2019 .