A new Kinect-based guidance mode for upper limb robot-aided neurorehabilitation

During typical robot-assisted training sessions, patients are required to execute tasks with the assistance of a robot while receiving feedback on a 2D display. Three-dimensional tasks of this sort require the adoption of stereoscopy to achieve correct visuo-motor-proprioceptive alignment. Stereoscopy often causes side-effects as sickness and tiredness, and it may affect the processes of recovery and cortical reorganization of the patients' brain in an unclear way. It follows that it is preferrable for a robot-assisted neurorehabilitation therapy to work in a real 3D setup containing real objects rather than using virtual reality. In this paper, we propose a new system for robot-assisted neurorehabilitation scenarios which allows patients to execute therapy by manipulating real, generic 3D objects. The proposed system is based on a new algorithm for identification and tracking of generic objects which makes efficient use of a Microsoft Kinect sensor. We discuss the results of several experiments conducted in order to test robustness, accuracy and speed of the tracking algorithm and the feasibility of the integrated system.

[1]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[2]  D. Mozaffarian,et al.  Executive summary: heart disease and stroke statistics--2010 update: a report from the American Heart Association. , 2010, Circulation.

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  N. Hogan.  An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Antonio Frisoli,et al.  A new force-feedback arm exoskeleton for haptic interaction in virtual environments , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[9]  H.I. Krebs,et al.  Robot-Aided Neurorehabilitation: A Robot for Wrist Rehabilitation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  S. Page,et al.  Computer-based rhythm and timing training in severe, stroke-induced arm hemiparesis. , 2011, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[11]  Luc Van Gool,et al.  Fast scale invariant feature detection and matching on programmable graphics hardware , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Luca Lombardi,et al.  Tracking without Background Model for Time-of-Flight Cameras , 2009, PSIVT.

[13]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[14]  Maarten J. IJzerman,et al.  Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. , 2006, Journal of rehabilitation research and development.

[15]  Antonio Frisoli,et al.  A new gaze-tracking guidance mode for upper limb robot-aided neurorehabilitation , 2011, 2011 IEEE World Haptics Conference.