Telewheelchair: the Remote Controllable Electric Wheelchair System combined Human and Machine Intelligence

Wheelchairs are essential means of transport for the elderly people and the physically challenged. However, wheelchairs need to be accompanied by caregivers. As society ages and the number of care recipients increases, the burden on caregivers is expected to increase. In order to reduce the burden on caregivers, we present Telewheelchair, an electric wheelchair equipped with a remote control function and computational operation assistance function. The caregiver can remotely control the Telewheelchair by means of a head mounted display (HMD). In addition, the proposed system is equipped with a human detection system to stop the wheelchair automatically and avoid collisions. We conducted a user study on the wheelchair in four types of systems and investigated the time taken to achieve tasks. Telewheelchair will enhance geriatric mobility and improve society by combining human intelligence and machine intelligence.

[1]  Walter D. Potter,et al.  HelpStar Technology for Semi-Autonomous Wheelchairs , 2005, CPSN.

[2]  José Luis Lázaro,et al.  Integral system for assisted mobility , 2000, Inf. Sci..

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[5]  Yoshinori Kobayashi,et al.  Robotic wheelchair easy to move and communicate with companions , 2013, CHI Extended Abstracts.

[6]  Wolfgang Broll,et al.  Comparing VR and non-VR driving simulations: An experimental user study , 2017, 2017 IEEE Virtual Reality (VR).

[7]  Bernd Freisleben,et al.  HaWCoS: the "hands-free" wheelchair control system , 2002, ASSETS.

[8]  Norihiro Hagita,et al.  User-friendly autonomous wheelchair for elderly care using ubiquitous network robot platform , 2014, HAI.

[9]  Urbano Nunes,et al.  A Wheelchair Steered through Voice Commands and Assisted by a Reactive Fuzzy-Logic Controller , 2002, J. Intell. Robotic Syst..

[10]  T. Saitoh,et al.  Voice controlled intelligent wheelchair , 2007, SICE Annual Conference 2007.

[11]  René Farcy,et al.  Tactile interface to steer electric wheelchairs , 2016, IHM.

[12]  Erik Wästlund,et al.  What you see is where you go: testing a gaze-driven power wheelchair for individuals with severe multiple disabilities , 2010, ETRA.

[13]  Manuel Mazo,et al.  EOG guidance of a wheelchair using neural networks , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Komei Hasegawa,et al.  DECoReS: Degree Expressional Command Reproducing System for Autonomous Wheelchairs , 2015, HAI.

[15]  Khaled Assaleh,et al.  A wavelet- and neural network-based voice system for a smart wheelchair control , 2011, J. Frankl. Inst..

[16]  Manuel Mazo,et al.  An integral system for assisted mobility [automated wheelchair] , 2001, IEEE Robotics Autom. Mag..

[17]  Ben A. Abbott,et al.  Applications of virtual reality technology to wheelchair remote steering systems , 2003 .

[18]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[19]  J. Rekimoto,et al.  Flying head: a head motion synchronization mechanism for unmanned aerial vehicle control , 2013, CHI Extended Abstracts.

[20]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  Kosuke Sato,et al.  ExtendedHand on Wheelchair , 2016, UIST.

[22]  Manuel Mazo,et al.  Electro-Oculographic Guidance of a Wheelchair Using Eye Movements Codification , 2003, Int. J. Robotics Res..

[23]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[24]  Manuel Mazo,et al.  Wheelchair Guidance Strategies Using EOG , 2002, J. Intell. Robotic Syst..

[25]  Francisco Rodríguez,et al.  Electronic control of a wheelchair guided by voice commands , 1995 .