Task-centric optimization of configurations for assistive robots

Robots can provide assistance to a human by moving objects to locations around the person’s body. With a well-chosen initial configuration, a robot can better reach locations important to an assistive task despite model error, pose uncertainty, and other sources of variation. However, finding effective configurations can be challenging due to complex geometry, a large number of degrees of freedom, task complexity, and other factors. We present task-centric optimization of robot configurations (TOC), which is an algorithm that finds configurations from which the robot can better reach task-relevant locations and handle task variation. Notably, TOC can return one or two configurations to be used sequentially while assisting with a task. TOC performs computationally demanding optimizations offline to generate a function that rapidly outputs the configurations online based on the robot’s observations. TOC explicitly models the task, environment, and user, and implicitly handles error using representations of robot dexterity. We evaluated TOC with a software simulation of a mobile manipulator (a PR2) providing assistance with 9 activities of daily living to a user in a wheelchair and a robotic bed. TOC had an overall average success rate of 90.6% compared to 50.4%, 43.5%, and 58.9% for three baseline algorithms based on state-of-the-art methods from the literature. We additionally demonstrate how TOC can find configurations for more than one robot and can help with the optimization of environments for assistance.

[1]  Dong-Soo Kwon,et al.  Integration of a Rehabilitation Robotic System (KARES II) with Human-Friendly Man-Machine Interaction Units , 2004, Auton. Robots.

[2]  Tsuneo Yoshikawa,et al.  Analysis and Control of Robot Manipulators with Redundancy , 1983 .

[3]  Jane Smith,et al.  The development of Handy 1, a rehabilitation robotic system to assist the severely disabled , 1998 .

[4]  Charles C. Kemp,et al.  Optimization of Robot Configurations for Assistive Tasks , 2016 .

[5]  Dipl.-Ing. C. Schaeffer Care-O-bot: A System for Assisting Elderly or Disabled Persons in Home Environments , 2000 .

[6]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[8]  R. D. Schraft,et al.  Robotic home assistant Care-O-bot II , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[9]  Martin Hägele,et al.  Robotic home assistant Care-O-bot® 3 - product vision and innovation platform , 2009, 2009 IEEE Workshop on Advanced Robotics and its Social Impacts.

[10]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[11]  Heather Janiszewski Goodin,et al.  The nursing shortage in the United States of America: an integrative review of the literature. , 2003, Journal of advanced nursing.

[12]  Terrence E Murphy,et al.  Disability in activities of daily living, depression, and quality of life among older medical ICU survivors: a prospective cohort study , 2011, Health and quality of life outcomes.

[13]  Tiffany L. Chen,et al.  Robots for Humanity : A Case Study in Assistive Mobile Manipulation , 2012 .

[14]  Tamim Asfour,et al.  Robot placement based on reachability inversion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Gerd Hirzinger,et al.  Using a model of the reachable workspace to position mobile manipulators for 3-d trajectories , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[16]  Rachid Alami,et al.  Synthesizing Robot Motions Adapted to Human Presence , 2010 .

[17]  Thierry Siméon,et al.  A mobile robot that performs human acceptable motions , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Michael Beetz,et al.  Learning and performing place-based mobile manipulation , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[19]  Chrystopher L. Nehaniv,et al.  An empirical framework for human-robot proxemics , 2009 .

[20]  Charles C. Kemp,et al.  Collaboration Between a Robotic Bed and a Mobile Manipulator May Improve Physical Assistance for People with Disabilities , 2016 .

[21]  Leslie Pack Kaelbling,et al.  Backward-forward search for manipulation planning , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Pradeep K. Khosla,et al.  Dexterity measures for design and control of manipulators , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[23]  Steven M. LaValle,et al.  Current Issues in Sampling-Based Motion Planning , 2005, ISRR.

[24]  James J. Kuffner,et al.  Navigation among movable obstacles: real-time reasoning in complex environments , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[25]  Advait Jain,et al.  EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces , 2010, Auton. Robots.

[26]  Charles C. Kemp,et al.  Assistive Mobile Manipulation : Designing for Operators with Motor Impairments Phillip , 2016 .

[27]  Maren Bennewitz,et al.  Stance selection for humanoid grasping tasks by inverse reachability maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Máximo A. Roa,et al.  Reachability and Capability Analysis for Manipulation Tasks , 2013, ROBOT.

[29]  Jeffrey C. Trinkle,et al.  Orientation-based reachability map for robot base placement , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[31]  J. Wiener,et al.  Measuring the activities of daily living: comparisons across national surveys. , 1990, Journal of gerontology.

[32]  William D. Smart,et al.  Robots for humanity: using assistive robotics to empower people with disabilities , 2013, IEEE Robotics & Automation Magazine.

[33]  Giulio Sandini,et al.  Manipulability analysis , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[34]  Kenji Shimada,et al.  Improvement of kinematically redundant manipulator design and placement using torque-weighted isotropy measures , 2009, 2009 International Conference on Advanced Robotics.

[35]  Milan Simic,et al.  Sampling-Based Robot Motion Planning: A Review , 2014, IEEE Access.

[36]  Siddhartha S. Srinivasa,et al.  BiSpace Planning: Concurrent Multi-Space Exploration , 2008, Robotics: Science and Systems.

[37]  Chih-Hung King,et al.  Assistive mobile manipulation for self-care tasks around the head , 2014, 2014 IEEE Symposium on Computational Intelligence in Robotic Rehabilitation and Assistive Technologies (CIR2AT).

[38]  Kevin Warwick,et al.  Maintain order even on the hop - review of "Robot modelling and control" by M. Spong, S. Hutchinson and M. Vidyasagar , 2006 .

[39]  David Hsu,et al.  Placing a robot manipulator amid obstacles for optimized execution , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[40]  Richard P. Paul,et al.  Robotics research : the First International Symposium , 1984 .

[41]  Rachid Alami,et al.  Planning human-aware motions using a sampling-based costmap planner , 2011, 2011 IEEE International Conference on Robotics and Automation.

[42]  E. Bernabé,et al.  Health and Quality of Life Outcomes , 2004 .

[43]  Daniel Leidner,et al.  Object-centered hybrid reasoning for whole-body mobile manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Henry Dreyfuss,et al.  Measure of Man and Woman: Human Factors in Design , 1993 .

[45]  Charles C. Kemp,et al.  Task-centric selection of robot and environment initial configurations for assistive tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Charles C. Kemp,et al.  In-home and remote use of robotic body surrogates by people with profound motor deficits , 2019, PloS one.

[47]  Ming-June Tsai Workspace geometric characterization and manipulability of industrial robots , 1986 .

[48]  Paolo Dario,et al.  MOVAID: a personal robot in everyday life of disabled and elderly people , 1999 .

[49]  Andrea Lockerd Thomaz,et al.  Humanoid manipulation planning using backward-forward search , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[50]  Frank L. Hammond,et al.  Multi-objective weighted isotropy measures for the morphological design optimisation of kinematically redundant manipulators , 2011 .

[51]  David Lee,et al.  The influence of subjects' personality traits on personal spatial zones in a human-robot interaction experiment , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[52]  Kenji Shimada,et al.  Morphological design optimization of kinematically redundant manipulators using weighted isotropy measures , 2009, 2009 IEEE International Conference on Robotics and Automation.

[53]  Sanjeev Kumar,et al.  AN OPTIMIZATION APPROACH TO SOLVE THE INVERSE KINEMATICS OF REDUNDANT MANIPULATOR , 2010 .

[54]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[55]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[56]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[57]  Kerstin Dautenhahn,et al.  A long-term Human-Robot Proxemic study , 2011, 2011 RO-MAN.

[58]  Charles C. Kemp,et al.  Model predictive control for fast reaching in clutter , 2016, Auton. Robots.

[59]  Bilge Mutlu,et al.  Human-robot proxemics: Physical and psychological distancing in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[60]  Jihong Lee A study on the manipulability measures for robot manipulators , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[61]  Jane Smith,et al.  The development of handy 1. A robotic system to assist the severely disabled , 1999 .

[62]  Michael Gienger,et al.  Task-oriented whole body motion for humanoid robots , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[63]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators , 1993, IEEE Trans. Robotics Autom..

[64]  Charles A. Klein,et al.  Dexterity Measures for the Design and Control of Kinematically Redundant Manipulators , 1987 .

[65]  Patrick Beeson,et al.  TRAC-IK: An open-source library for improved solving of generic inverse kinematics , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[66]  Septimiu E. Salcudean,et al.  Matrix normalization for optimal robot design , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[67]  Charles C. Kemp,et al.  Autobed: Open Hardware for Accessible Web-based Control of an Electric Bed , 2016 .

[68]  Advait Jain,et al.  Whole-arm tactile sensing for beneficial and acceptable contact during robotic assistance , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[69]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  C. Karen Liu,et al.  Articulated swimming creatures , 2011, ACM Trans. Graph..