Semantic Mapping for Safe and Comfortable Navigation of a Brain-Controlled Wheelchair

This paper presents a novel navigation system designed for a brain-controlled wheelchair, which interacts with human user by the low throughput interface. The navigation system proposes the semantic map, which is integrated with the navigation points, semantic targets and local 3D map, to a human user who can choose one of the navigation points as a goal for navigation. The semantic targets provide category, geometry and functionality information of the recognized objects, such as a table which can be docked. The local 3D map provides the navigation points in the traversable areas. The human-wheelchair interactive system shows the semantic map to user, and the user selects the goal via a brain-computer interfaces BCI. Therefore, this method can help the wheelchair implement accurate navigation e.g. docking with a low throughput interface and the safety and comfortability are improved. Our navigation system is successfully tested in real environment.

[1]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[2]  J. Baumeister,et al.  Influence of phosphatidylserine on cognitive performance and cortical activity after induced stress , 2008, Nutritional neuroscience.

[3]  Jose M Carmena,et al.  Invasive or noninvasive: understanding brain-machine interface technology. , 2010, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[4]  Christian Mandel,et al.  Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Fernando Lopes da Silva,et al.  Comprar Niedermeyer's Electroencephalography, 6/e (Basic Principles, Clinical Applications, and Related Fields ) | Fernando Lopes Da Silva | 9780781789424 | Lippincott Williams & Wilkins , 2010 .

[6]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[7]  Jingchuan Wang,et al.  Semantic Mapping for Smart Wheelchairs Using RGB-D Camera , 2013 .

[8]  Vijay Kumar,et al.  Integrating Human Inputs with Autonomous Behaviors on an Intelligent Wheelchair Platform , 2007, IEEE Intelligent Systems.

[9]  Roland Siegwart,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot , 2022 .

[10]  José del R. Millán,et al.  Vision-Based Shared Control for a BCI Wheelchair , 2011 .

[11]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[12]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[13]  Jingchuan Wang,et al.  3D Semantic Map-Based Shared Control for Smart Wheelchair , 2012, ICIRA.

[14]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[15]  Yiannis Demiris,et al.  Human-wheelchair collaboration through prediction of intention and adaptive assistance , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Shinichi Hirai,et al.  Robust real time material classification algorithm using soft three axis tactile sensor: Evaluation of the algorithm , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[18]  Honghai Liu,et al.  Intelligent Robotics and Applications , 2014, Lecture Notes in Computer Science.

[19]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.