Real-Time Stairs Geometric Parameters Estimation for Lower Limb Rehabilitation Exoskeleton

Stairs are common structures that hinder the rehabilitation exoskeleton applications in the artificial environ­ment. It is impossible for the exoskeleton to save all the geometric parameters such as height and depth of each stair in real-world. By detection and modeling the stairs with computer vision, this paper provides the possibility of wearing rehabilitation exoskeleton for training hemiplegia patients on stairs. Based on the point cloud reconstructed from RGB-D data, normal of each point are computed firstly. We subsequently apply over-segmentation then re-aggregation on the point cloud and normals to extract planes exhaustively. Finally, a stairs graph are modeled based on this planes and the geometric parameters are computed based on the stairs model. Our algorithm is designed as simple as possible to reach the real-time requirement for practical situations. We evaluated this stairs modeling algorithm on two situations. The results indicate that it achieves equivalent precision to state-of-art approaches and even works on partial occlusion conditions.

[1]  Manfred Morari,et al.  Automatic gait-pattern adaptation algorithms for rehabilitation with a 4-DOF robotic orthosis , 2004, IEEE Transactions on Robotics and Automation.

[2]  Tobias Schwarze,et al.  Stair detection and tracking from egocentric stereo vision , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[3]  Michael Brady,et al.  Vision-based Detection of Stair-cases , 2003 .

[4]  Shuihua Wang,et al.  Detecting stairs and pedestrian crosswalks for the blind by RGBD camera , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops.

[5]  Yingli Tian,et al.  Depth-aware indoor staircase detection and recognition for the visually impaired , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[6]  Bärbel Mertsching,et al.  3D graph based stairway detection and localization for mobile robots , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Kang-Sun Choi,et al.  Supervoxel-based Staircase Detection from Range Data , 2015 .

[8]  Wai Ho Li,et al.  Plane-based detection of staircases using inverse depth , 2012, ICRA 2012.

[9]  Ren C. Luo,et al.  Multisensor integrated stair recognition and parameters measurement system for dynamic stair climbing robots , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[10]  M. Omizo,et al.  Modeling , 1983, Encyclopedic Dictionary of Archaeology.

[11]  Bernard Brogliato,et al.  Modeling, stability and control of biped robots - a general framework , 2004, Autom..

[12]  刘霁,et al.  A stairway detection algorithm based on vision for UGV stair climbing , 2008 .

[13]  Qiming Chen,et al.  Adaptive stair-ascending and stair-descending strategies for powered lower limb exoskeleton , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[14]  Philip David,et al.  Ascending stairway modeling from dense depth imagery for traversability analysis , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  W. Marsden I and J , 2012 .

[16]  Kang-Hyun Jo,et al.  Stairway segmentation using Gabor Filter and vanishing point , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[17]  Kang-Hyun Jo,et al.  Stairways detection and distance estimation approach based on three connected point and triangular similarity , 2016, 2016 9th International Conference on Human System Interactions (HSI).

[18]  G. Medioni,et al.  Piecewise Planar Modeling for Step Detection using Stereo Vision , 2008 .

[19]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[20]  Martin Lauer,et al.  Detection of ascending stairs using stereo vision , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  A. Esquenazi,et al.  The ReWalk Powered Exoskeleton to Restore Ambulatory Function to Individuals with Thoracic-Level Motor-Complete Spinal Cord Injury , 2012, American journal of physical medicine & rehabilitation.

[22]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[23]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Masahiro Fujita,et al.  Stair climbing for humanoid robots using stereo vision , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[25]  Sven Behnke,et al.  Real-Time Plane Segmentation Using RGB-D Cameras , 2012, RoboCup.

[26]  Hamid D. Taghirad,et al.  Autonomous staircase detection and stair climbing for a tracked mobile robot using fuzzy controller , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[27]  Yasuhisa Hasegawa,et al.  Standing-up motion support for paraplegic patient with Robot Suit HAL , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[28]  Josechu J. Guerrero,et al.  Detection and Modelling of Staircases Using a Wearable Depth Sensor , 2014, ECCV Workshops.

[29]  Levi J. Hargrove,et al.  Depth Sensing for Improved Control of Lower Limb Prostheses , 2015, IEEE Transactions on Biomedical Engineering.