Salient Feature of Haptic-Based Guidance of People in Low Visibility Environments Using Hard Reins

This paper presents salient features of human-human interaction where one person with limited auditory and visual perception of the environment (a follower) is guided by an agent with full perceptual capabilities (a guider) via a hard rein along a given path. We investigate several salient features of the interaction between the guider and follower such as: 1) the order of an autoregressive (AR) control policy that maps states of the follower to actions of the guider; 2) how the guider may modulate the pulling force in response to the trust level of the follower; and 3) how learning may successively apportion the responsibility of control across different muscles of the guider. Based on experimental systems identification on human demonstrations from ten pairs of naive subjects, we show that guiders tend to adopt a third-order AR predictive control policy and followers tend to adopt second-order reactive control policy. Moreover, the extracted guider's control policy was implemented and validated by human-robot interaction experiments. By modeling the follower's dynamics with a time varying virtual damped inertial system, we found that it is the coefficient of virtual damping which is most sensitive to the trust level of the follower. We used these experimental insights to derive a novel controller that integrates an optimal order control policy with a push/pull force modulator in response to the trust level of the follower monitored using a time varying virtual damped inertial model.

[1]  Iwan Ulrich,et al.  The GuideCane-applying mobile robot technologies to assist the visually impaired , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[2]  S. A. Stoeter,et al.  Proceedings - IEEE International Conference on Robotics and Automation , 2003 .

[3]  I. Stokes,et al.  Lumbar spinal muscle activation synergies predicted by multi-criteria cost function. , 2001, Journal of biomechanics.

[4]  Roberta L. Klatzky,et al.  Navigation System for the Blind: Auditory Display Modes and Guidance , 1998, Presence.

[5]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[6]  T. Nanayakkara,et al.  A VARIABLE STIFFNESS JOINT BY GRANULAR JAMMING , 2012 .

[7]  Kaspar Althoefer,et al.  Force-velocity modulation strategies for soft tissue examination , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Thrishantha Nanayakkara,et al.  Saccade adaptation in response to altered arm dynamics. , 2003, Journal of neurophysiology.

[9]  Daniel P. Stormont,et al.  Analyzing Human Trust of Autonomous Systems in Hazardous Environments , 2008 .

[10]  Kiyotaka Izumi,et al.  Evolving a multiobjective obstacle avoidance skill of a seven-link manipulator subject to constraints , 2004, Int. J. Syst. Sci..

[11]  Kaspar Althoefer,et al.  Novel method to form adaptive internal impedance profiles in walkers , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Kaspar Althoefer,et al.  Design of a variable stiffness flexible manipulator with composite granular jamming and membrane coupling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  JACK M. LOOMIS, PhD,et al.  Navigating without Vision: Basic and Applied Research , 2001 .

[14]  T. Nanayakkara,et al.  A Geographic Primitive-Based Bayesian Framework to Predict Cyclone-Induced Flooding* , 2013 .

[15]  Thrishantha Nanayakkara,et al.  Stable walking on variable visco-elastic terrains using meta-parameters for passive state migration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  L Uddawatta,et al.  Analysis on four legged multipurpose rope climbing robot , 2009, 2009 International Conference on Industrial and Information Systems (ICIIS).

[17]  Roberta L. Klatzky,et al.  Nonvisual Route following with Guidance from a Simple Haptic or Auditory Display , 2007 .

[18]  Alberto Finzi,et al.  A Mixed-Initiative Approach to Human-Robot Interaction in Rescue Scenarios , 2005 .

[19]  Gunnar Johannsen,et al.  Mathematical Concepts for Modeling Human Behavior in Complex Man-Machine Systems , 1979 .

[20]  Kaspar Althoefer,et al.  Novel uniaxial force sensor based on visual information for minimally invasive surgery , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  L. Udawatta,et al.  High Performance Temperature Controller For Infant Incubators , 2006, 2006 International Conference on Information and Automation.

[22]  Takayuki Kanda,et al.  Robot behavior adaptation for human-robot interaction based on policy gradient reinforcement learning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  L. Udawatta,et al.  Stable bipedal ramp climbing with torso , 2010, 2010 Fifth International Conference on Information and Automation for Sustainability.

[24]  John D. Sterman,et al.  Deterministic Chaos in Models of Human Behavior: Methodological Issues and Experimental Results , 2015 .

[25]  K. Watanabe,et al.  Intelligent control of a 7-DOF manipulator based on model primitives , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[26]  Gordana Collier,et al.  Upper Limb Joint Torque Distribution Resulting from the Flat Tennis Serve Impact Force , 2014 .

[27]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[28]  Toshio Fukuda,et al.  Multi-dimensional reinforcement learning using a vector Q-net - Application to mobile robots , 2003 .

[29]  Clément Gosselin,et al.  Safe, Stable and Intuitive Control for Physical Human-Robot Interaction , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[31]  Keigo Watanabe,et al.  Skillful adaptation of a 7-DOF manipulator to avoid moving obstacles in a teleoperated force control task , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[32]  L. Nifong,et al.  Robotic cardiac surgery. , 2003, Journal of long-term effects of medical implants.

[33]  Kaspar Althoefer,et al.  Granular jamming transitions for a robotic mechanism , 2013 .

[34]  Matthew Howard,et al.  Internal impedance control helps information gain in embodied perception , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Kaspar Althoefer,et al.  A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor , 2012, 2012 IEEE International Conference on Robotics and Automation.

[36]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[37]  Minoru Abe,et al.  Electrocutaneous Communication in a Guide Dog Robot (MELDOG) , 1985, IEEE Transactions on Biomedical Engineering.

[38]  Kaspar Althoefer,et al.  Endoscopic add-on stiffness probe for real-time soft surface characterisation in MIS , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Mo M. Jamshidi,et al.  Orchestration of Advanced Motor Skills in a Group of Humans through an Elitist Visual Feedback Mechanism , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[40]  Ewart de Visser,et al.  Measurement of trust in human-robot collaboration , 2007, 2007 International Symposium on Collaborative Technologies and Systems.

[41]  Carlos Balaguer,et al.  Full-Body Postural Control of a Humanoid Robot with Both Imitation Learning and Skill Innovation , 2014, Int. J. Humanoid Robotics.

[42]  Azad M. Madni,et al.  Intelligent Sensing in Dynamic Environments Using Markov Decision Process , 2011, Sensors.

[43]  B. Prabu,et al.  ROVI: A Robot for Visually Impaired for Collision- Free Navigation , 2009 .

[44]  Ravi Vaidyanathan,et al.  IEEE International Conference on Intelligent Robots and Systems , 2011, IROS 2011.

[45]  R. Shadmehr,et al.  A Real-Time State Predictor in Motor Control: Study of Saccadic Eye Movements during Unseen Reaching Movements , 2002, The Journal of Neuroscience.

[46]  A. Ordys,et al.  A novel approach to determine the inverse kinematics of a human upper limb model with 9 degrees of freedom , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[47]  Eui Park,et al.  MEASURING TRUST OF HUMAN OPERATORS IN NEW GENERATION RESCUE ROBOTS , 2008 .

[48]  Shinichi Hirai,et al.  Robust real time material classification algorithm using soft three axis tactile sensor: Evaluation of the algorithm , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[49]  Kaspar Althoefer,et al.  Identification of Haptic Based Guiding Using Hard Reins , 2015, PloS one.

[50]  Carlos Balaguer,et al.  A humanoid robot standing up through learning from demonstration using a multimodal reward function , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[51]  Darwin G. Caldwell,et al.  Locomotion with continuum limbs , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Thrishantha Nanayakkara,et al.  Passive dynamics of high frequency bat wing flapping with an anisotropic membrane , 2014, 7th International Conference on Information and Automation for Sustainability.

[53]  Andreas Daffertshofer,et al.  Deterministic and stochastic features of rhythmic human movement , 2006, Biological Cybernetics.

[54]  L. Udawatta,et al.  Gait pattern analysis of an Asian elephant , 2012, 2012 IEEE 6th International Conference on Information and Automation for Sustainability.

[55]  Kiyotaka Izumi,et al.  Evolutionary Learning of a Fuzzy Behavior Based Controller for a Nonholonomic Mobile Robot in a Class of Dynamic Environments , 2001, J. Intell. Robotic Syst..

[56]  T. Flash,et al.  Comparing Smooth Arm Movements with the Two-Thirds Power Law and the Related Segmented-Control Hypothesis , 2002, The Journal of Neuroscience.

[57]  Thrishantha Nanayakkara,et al.  Adaptive internal impedance control for stable walking on uncertain visco-elastic terrains , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[58]  R L Klatzky,et al.  Navigating without vision: basic and applied research. , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[59]  Kiyotaka Izumi,et al.  Evolving Runge-Kutta-Gill RBF networks to estimate the dynamics of a multi-link manipulator , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[60]  P. Sridhar,et al.  Dynamic power management of an embedded sensor network based on actor-critic reinforcement based learning , 2007, 2007 Third International Conference on Information and Automation for Sustainability.

[61]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[62]  T. Nirmalathas,et al.  A computationally efficient framework for stochastic prediction of flood propagation , 2012, 2012 IEEE 6th International Conference on Information and Automation for Sustainability.

[63]  Alberto Finzi,et al.  Human-Robot Interaction Through Mixed-Initiative Planning for Rescue and Search Rovers , 2005, AI*IA.

[64]  Kaspar Althoefer,et al.  Haptics for Multi-fingered Palpation , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[65]  Kaspar Althoefer,et al.  Efficient Break-Away Friction Ratio and Slip Prediction Based on Haptic Surface Exploration , 2014, IEEE Transactions on Robotics.

[66]  Darwin G. Caldwell,et al.  Human-robot skills transfer interfaces for a flexible surgical robot , 2014, Comput. Methods Programs Biomed..

[67]  Keigo Watanabe,et al.  Controlling multi-link manipulators by fuzzy selection of dynamic models , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[68]  Kaspar Althoefer,et al.  Simplifying grasping complexity through generalization of kinaesthetically learned synergies , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[69]  Martha Flanders,et al.  Choosing a wavelet for single-trial EMG , 2002, Journal of Neuroscience Methods.

[70]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[71]  Shinichi Hirai,et al.  Disposable soft 3 axis force sensor for biomedical applications , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[72]  Darwin G. Caldwell,et al.  Skills transfer across dissimilar robots by learning context-dependent rewards , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[74]  Kaspar Althoefer,et al.  Behavioral Characteristics of Manual Palpation to Localize Hard Nodules in Soft Tissues , 2014, IEEE Transactions on Biomedical Engineering.

[75]  H. Akaike A new look at the statistical model identification , 1974 .

[76]  Kaspar Althoefer,et al.  Observational Learning: Basis, Experimental Results and Models, and Implications for Robotics , 2013, Cognitive Computation.

[77]  Lyuba Alboul,et al.  A Robot Swarm Assisting a Human Fire-Fighter , 2009, Adv. Robotics.

[78]  Kaspar Althoefer,et al.  Using visual cues to enhance haptic feedback for palpation on virtual model of soft tissue , 2015, Medical & Biological Engineering & Computing.

[79]  Joachim Hermsdörfer,et al.  Predictive and reactive control of grasping forces: on the role of the basal ganglia and sensory feedback , 2006, Experimental Brain Research.

[80]  Xiaojing Song,et al.  Dominant sources of variability in passive walking , 2012, 2012 IEEE International Conference on Robotics and Automation.

[81]  Thrishantha Nanayakkara,et al.  Portable acoustic device for detection of coconut palms infested by Rynchophorus ferrugineus (Coleoptera: Curculionidae) , 2010 .

[82]  Jacques Penders,et al.  Exploring Haptic Interfacing with a Mobile Robot without Visual Feedback , 2012, TAROS.

[83]  Kaspar Althoefer,et al.  An Optimal State Dependent Haptic Guidance Controller via a Hard Rein , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.