DimRad: A Radar-Based Perception System for Prosthetic Leg Barrier Traversing

Lower extremity amputees face challenges in natural locomotion, which is partially compensated using powered assistive systems, e.g., micro-processor controlled prosthetic leg. In this paper, a radar-based perception system is proposed to assist prosthetic legs for autonomous obstacle traversing, focusing on multiple-step staircases. The presented perception system is composed of a radar module operating with a multiple-input-multiple-output (MIMO) configuration to localize consecutive stair corners. An inertial measurement unit (IMU) is integrated for coordinates correction due to the angular dis-positioning that occurs because of the knee angular motion. The captured information from both sensors is used for staircase dimensioning (depth and height). A shallow neural network (NN) is proposed to model the error due to the hardware limitations and enhance the dimension estimation accuracy (≈ 1 cm). The algorithm is implemented on a microcontroller subsystem of the radar kit to qualify the perception system for embedded integration in powered prosthetic legs.

[1]  Markus Hahn,et al.  A Novel Target-Height Estimation Approach Using Radar-Wave Multipath Propagation for Automotive Applications , 2017 .

[2]  M. Cherniakov,et al.  Implementation of MIMO Beamforming on an OTS FMCW Automotive Radar , 2019, 2019 20th International Radar Symposium (IRS).

[3]  R.B. Dybdal,et al.  Radar cross section measurements , 1986, Proceedings of the IEEE.

[4]  Rory A. Cooper,et al.  Stairs detection for enhancing wheelchair capabilities based on radar sensors , 2017, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE).

[5]  Daniel Thalmann,et al.  A global human walking model with real-time kinematic personification , 1990, The Visual Computer.

[6]  Bin Yang,et al.  Person Identification and Body Mass Index: A Deep Learning-Based Study on Micro-Dopplers , 2018, 2019 IEEE Radar Conference (RadarConf).

[7]  D. Nussler,et al.  Design of a SIW meander antenna for 60 GHz applications , 2012, 2012 The 7th German Microwave Conference.

[8]  Kenton R Kaufman,et al.  Energy expenditure and activity of transfemoral amputees using mechanical and microprocessor-controlled prosthetic knees. , 2008, Archives of physical medicine and rehabilitation.

[9]  Kathryn Ziegler-Graham,et al.  Estimating the prevalence of limb loss in the United States: 2005 to 2050. , 2008, Archives of physical medicine and rehabilitation.

[10]  Bin Yang,et al.  Towards Adversarial Denoising of Radar Micro-Doppler Signatures , 2018, 2019 International Radar Conference (RADAR).

[11]  Eugenijus Kaniusas,et al.  Relying on more sense for enhancing lower limb prostheses control: a review , 2020, Journal of NeuroEngineering and Rehabilitation.

[12]  M S Roys,et al.  Serious stair injuries can be prevented by improved stair design. , 2001, Applied ergonomics.

[13]  V. G. Hansen,et al.  Constant false alarm rate processing in search radars , 1973 .

[14]  Alexander Verl,et al.  A Radar-Based Terrain Mapping Approach for Stair Detection Towards Enhanced Prosthetic Foot Control , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[15]  R Jiménez-Fabián,et al.  Review of control algorithms for robotic ankle systems in lower-limb orthoses, prostheses, and exoskeletons. , 2012, Medical engineering & physics.

[16]  Karin Ackermann,et al.  Modern Antenna Design , 2016 .

[17]  Bin Yang,et al.  Person Recognition Based on Micro-Doppler and Thermal Infrared Camera Fusion for Firefighting , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[18]  Clarence W. de Silva,et al.  Sensor Fusion for Predictive Control of Human-Prosthesis-Environment Dynamics in Assistive Walking: A Survey , 2019, ArXiv.

[19]  Wen Zhang,et al.  Environmental Features Recognition for Lower Limb Prostheses Toward Predictive Walking , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  B. Howard,et al.  Relation of lower-extremity amputation to all-cause and cardiovascular disease mortality in American Indians: the Strong Heart Study. , 2004, Diabetes care.

[21]  Nils Pohl,et al.  Compact 3D imaging radar based on FMCW driven frequency-scanning antennas , 2016, 2016 IEEE Radar Conference (RadarConf).

[22]  Urs Schneider,et al.  An Adversarial Super-Resolution Remedy for Radar Design Trade-offs , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[23]  Kuangen Zhang,et al.  A Subvision System for Enhancing the Environmental Adaptability of the Powered Transfemoral Prosthesis , 2020, IEEE Transactions on Cybernetics.