AudiNect: an aid for the autonomous navigation of visually impaired people, based on virtual interface

Abstract In this paper, the realization of a new kind of autonomous navigation aid is presented. The prototype, called AudiNect , is mainly developed as an aid for visually impaired people, though a larger range of applications is also possible. The AudiNect prototype is based on the Kinect device for Xbox 360. On the basis of the Kinect output data, proper acoustic feedback is generated, so that useful depth information from 3D frontal scene can be easily developed and acquired. To this purpose, a number of basic problems have been analyzed, in relation to visually impaired people orientation and movement, through both actual experimentations and a careful literature research in the field. Quite satisfactory results have been reached and discussed, on the basis of proper tests on blindfolded sighted individuals. Keywords : Visually Impaired, Blind, Autonomous Navigation, Virtual Interfaces, Kinect, AudiNect. 1. INTRODUCTION It is well known that the traditional aids for visually impaired people are canes and guide dogs, though they can present a number of limitations. Indeed, they do not allow natural movements or extended mobility, so that external helps and additional costs can often be required. In recent years, Virtual and Augmented Reality has been applied to rehabilitation of children and adults in presence of visual impairment, so that increased autonomy and significant life quality improvement can be reached [1], [2], [3], [4].

[1]  Nashwa El-Bendary,et al.  Virtual Reality Technology for Blind and Visual Impaired People: Reviews and Recent Advances , 2012 .

[2]  Harald Reiterer,et al.  NAVI - A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect , 2011, INTERACT.

[3]  J. Souquet,et al.  Design of Low-Loss Wide-Band Ultrasonic Transducers for Noninvasive Medical Application , 1979, IEEE Transactions on Sonics and Ultrasonics.

[4]  Giuseppe Monno,et al.  Product Engineering, Tools and Methods Based on Virtual Reality , 2008 .

[5]  Kumar Yelamarthi,et al.  RFID and GPS integrated navigation system for the visually impaired , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[6]  Carlo Maria Medaglia,et al.  A RFID SYSTEM TO HELP VISUALLY IMPAIRED PEOPLE IN MOBILITY , 2007 .

[7]  R. Dean The Oxford Handbook of Computer Music , 2011 .

[8]  Ken Sakamura,et al.  Assisting mobility of the disabled using space-identifying ubiquitous infrastructure , 2008, Assets '08.

[9]  David A. Ross,et al.  Talking braille: a wireless ubiquitous computing network for orientation and wayfinding , 2005, Assets '05.

[10]  Sean Kean,et al.  Meet the Kinect: An Introduction to Programming Natural User Interfaces , 2011 .

[11]  Zoltan Juhasz,et al.  MOST-NNG: An Accessible GPS Navigation Application Integrated into the MObile Slate Talker (MOST) for the Blind , 2010, ICCHP.

[12]  Casey Reas,et al.  Processing: a programming handbook for visual designers and artists , 2007 .

[13]  William R. Sherman,et al.  Developing Virtual Reality Applications: Foundations of Effective Design , 2009 .