Low-Cost Open Source Ultrasound-Sensing Based Navigational Support for the Visually Impaired

Nineteen million Americans have significant vision loss. Over 70% of these are not employed full-time, and more than a quarter live below the poverty line. Globally, there are 36 million blind people, but less than half use white canes or more costly commercial sensory substitutions. The quality of life for visually impaired people is hampered by the resultant lack of independence. To help alleviate these challenges this study reports on the development of a low-cost, open-source ultrasound-based navigational support system in the form of a wearable bracelet to allow people with the lost vision to navigate, orient themselves in their surroundings and avoid obstacles when moving. The system can be largely made with digitally distributed manufacturing using low-cost 3-D printing/milling. It conveys point-distance information by utilizing the natural active sensing approach and modulates measurements into haptic feedback with various vibration patterns within the four-meter range. It does not require complex calibrations and training, consists of the small number of available and inexpensive components, and can be used as an independent addition to traditional tools. Sighted blindfolded participants successfully demonstrated the device for nine primary everyday navigation and guidance tasks including indoor and outdoor navigation and avoiding collisions with other pedestrians.

[1]  M. Stuart,et al.  Effects of aging on vibration detection thresholds at various body regions , 2003, BMC geriatrics.

[2]  Joao Fradinho Oliveira,et al.  The path force feedback belt , 2013, 2013 8th International Conference on Information Technology in Asia (CITA).

[3]  BowyerAdrian,et al.  3D Printing and Humanity's First Imperfect Replicator , 2014 .

[4]  Ramiro Velazquez,et al.  Wearable Assistive Devices for the Blind , 2016, ArXiv.

[5]  H. P. Savindu,et al.  BrailleBand: Blind support haptic wearable band for communication using braille language , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  American Foundation for the Blind , 1967 .

[7]  Alicia Gibb,et al.  Building Open Source Hardware: DIY Manufacturing for Hackers and Makers , 2014 .

[8]  Lucia L. Prieto-Godino,et al.  Open Labware: 3-D Printing Your Own Lab Equipment , 2015, PLoS biology.

[9]  A. Roe,et al.  Multiple representation in primate SI: A view from a window on the brain , 2007 .

[10]  Joshua M. Pearce,et al.  Approaches to open source 3-D printable probe positioners and micromanipulators for probe stations , 2018, HardwareX.

[11]  Joshua M. Pearce,et al.  Open Source Completely 3-D Printable Centrifuge , 2019 .

[12]  Shah Khusro,et al.  Technology-assisted white cane: evaluation and future directions , 2018, PeerJ.

[13]  Jamie P. Halsall,et al.  Aging in the United States , 2012 .

[14]  Mohsen Attaran,et al.  The rise of 3-D printing: The advantages of additive manufacturing over traditional manufacturing , 2017 .

[15]  Joshua M. Pearce Open-Source Lab: How to Build Your Own Hardware and Reduce Research Costs , 2013 .

[16]  Ariffin Abdul Mutalib,et al.  Smart Cane: Assistive Cane for Visually-impaired People , 2011, ArXiv.

[17]  Pan Hui,et al.  A Survey on Haptic Technologies for Mobile Augmented Reality , 2017, ACM Comput. Surv..

[18]  Shachar Maidenbaum,et al.  The "EyeCane", a new electronic travel aid for the blind: Technology, behavior & swift learning. , 2014, Restorative neurology and neuroscience.

[19]  Yiting Yi,et al.  A design of blind-guide crutch based on multi-sensors , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Himadri Nath Saha,et al.  Low cost ultrasonic smart glasses for blind , 2017, 2017 8th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON).

[21]  Joshua M. Pearce,et al.  Open-Source 3-D Platform for Low-Cost Scientific Instrument Ecosystem , 2016, Journal of laboratory automation.

[22]  Rhys Jones,et al.  RepRap – the replicating rapid prototyper , 2011, Robotica.

[23]  Leyland Pitt,et al.  Disruptions, decisions, and destinations: enter the age of 3-D printing and additive manufacturing , 2015, IEEE Engineering Management Review.

[24]  Rohan Thakker,et al.  Substitute Eyes for Blind with Navigator Using Android , 2013, 2013 Texas Instruments India Educators' Conference.

[25]  Josechu J. Guerrero,et al.  Navigation Assistance for the Visually Impaired Using RGB-D Sensor With Range Expansion , 2016, IEEE Systems Journal.

[26]  D. Gold,et al.  Identifying the needs of people in Canada who are blind or visually impaired: Preliminary results of a nation-wide study , 2005 .

[27]  ニール ガーシェンフェルド,et al.  How to Make Almost Anything : The Digital Fabrication Revolution , 2012 .

[28]  P. Nirmalan,et al.  Research Reports: Acceptance of the Long Cane by Persons who are Blind in South India , 2006 .

[29]  Joshua M. Pearce,et al.  Building Research Equipment with Free, Open-Source Hardware , 2012, Science.

[30]  A. Gottschalk,et al.  New concepts in acute pain therapy: preemptive analgesia. , 2001, American family physician.

[31]  Jong-Hyeon Jeong,et al.  A standardized obstacle course for assessment of visual function in ultra low vision and artificial vision. , 2014, Journal of visualized experiments : JoVE.

[32]  C. Lenay,et al.  SENSORY SUBSTITUTION: LIMITS AND PERSPECTIVES , 2003 .

[33]  Eduardo Bayro-Corrochano,et al.  Cognitive guidance system for the blind , 2012, World Automation Congress 2012.

[34]  B. R. Prudhvi,et al.  Silicon eyes: GPS-GSM based navigation assistant for visually impaired using capacitive touch braille keypad and smart SMS facility , 2013, 2013 World Congress on Computer and Information Technology (WCCIT).

[35]  Mark W. Newman,et al.  Supporting visually impaired navigation: a needs-finding study , 2011, CHI Extended Abstracts.

[36]  Joshua M. Pearce,et al.  Distributed Manufacturing of Flexible Products: Technical Feasibility and Economic Viability , 2017, Technologies.

[37]  Tugrul Çavdar,et al.  Ultrasonic Assistive Headset for visually impaired people , 2016, 2016 39th International Conference on Telecommunications and Signal Processing (TSP).

[38]  J Shane Purcell,et al.  A revolution in the making. , 2007, Family practice management.

[39]  A. Streri,et al.  Touching for knowing : cognitive psychology of haptic manual perception , 2003 .

[40]  A. Duran,et al.  Electronic long cane for locomotion improving on visual impaired people. A case study , 2011, 2011 Pan American Health Care Exchanges.

[41]  Joshua M. Pearce,et al.  Impact of DIY Home Manufacturing with 3D Printing on the Toy and Game Market , 2017 .

[42]  Paul Smith,et al.  Commons People: Additive Manufacturing Enabled Collaborative Commons Production , 2015 .

[43]  Joshua M. Pearce,et al.  Belt-Driven Open Source Circuit Mill Using Low-Cost 3-D Printer Components , 2018, Inventions.

[44]  Paulo Blikstein,et al.  Digital Fabrication and Making' in Education: The Democratization of Invention , 2013 .

[45]  Lawrence D. Rosenblum,et al.  Echolocating Distance by Moving and Stationary Listeners , 2000 .

[46]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[47]  João Barroso,et al.  Blind Guide: An Ultrasound Sensor-based Body Area Network for Guiding Blind People , 2015, DSAI.

[48]  Joshua M. Pearce,et al.  Economic Potential for Distributed Manufacturing of Adaptive Aids for Arthritis Patients in the U.S. , 2018, Geriatrics.

[49]  Hod Lipson,et al.  Fabricated: The New World of 3D Printing , 2013 .

[50]  J. Borstad,et al.  The role of sensitization in musculoskeletal shoulder pain , 2015, Brazilian journal of physical therapy.

[51]  Brian C. J. Moore,et al.  A summary of research investigating echolocation abilities of blind and sighted humans , 2014, Hearing Research.

[52]  Kunal Pal,et al.  Development of an ultrasonic cane as a navigation aid for the blind people , 2014, 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT).

[53]  Joshua M. Pearce,et al.  Reversing the Trend of Large Scale and Centralization in Manufacturing: The Case of Distributed Manufacturing of Customizable 3-D-Printable Self-Adjustable Glasses , 2014 .

[54]  Hong Jiao,et al.  Getting started with open‐hardware: Development and control of microfluidic devices , 2014, Electrophoresis.

[55]  Frederick Lippman,et al.  Blindness and vision impairment , 2008 .

[56]  D. D. Alwis,et al.  Low Cost Ultrasonic Based Wide Detection Range Smart Walking Stick for Visually Impaired , 2017 .

[57]  Joshua M. Pearce,et al.  Distributed manufacturing with 3-D printing: a case study of recreational vehicle solar photovoltaic mounting systems , 2015 .

[58]  Gretchen A. Stevens,et al.  Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[59]  Lidia Dobrescu,et al.  Ultrasonic electronic system for blind people navigation , 2015, 2015 E-Health and Bioengineering Conference (EHB).

[60]  Ruxandra Tapu,et al.  When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition , 2016, Sensors.

[61]  Per Magne Knutsen,et al.  Motor–sensory convergence in object localization: a comparative study in rats and humans , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[62]  Paulus Insap Santosa,et al.  Obstacle Avoidance for Visually Impaired Using Auto-Adaptive Thresholding on Kinect's Depth Image , 2014, 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops.

[63]  Joshua M. Pearce,et al.  Emergence of Home Manufacturing in the Developed World: Return on Investment for Open-Source 3-D Printers , 2017 .

[64]  R. Welsh Foundations of Orientation and Mobility , 1979 .