Human-Robot Formation Control via Visual and Vibrotactile Haptic Feedback

In this paper we present a new visuo-haptic interaction mechanism for human-robot formation control. The formation setup consists of a human leader and multiple follower robots. The mobile robots are equipped only with RGB-D cameras, and they should maintain a desired distance and orientation to the leader at all times. Mechanical limitations common to all the robots limit the possible trajectories that the human can take. In this regard, vibrotactile feedback provided by a haptic bracelet guides the human along trajectories that are feasible for the team by warning her/him when the formation constraints are being violated. Psychophysical tests on the bracelet together with real-world experiments conducted with a team of Pioneer robots show the effectiveness of the proposed visuo-haptic paradigm for the coordination of mixed human-robot teams.

[1]  Alois Ferscha,et al.  Tactor placement in wrist worn wearables , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[2]  Francesco Chinello,et al.  Vibrotactile haptic feedback for human-robot interaction in leader-follower tasks , 2012, PETRA '12.

[3]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[5]  Jean-Paul Laumond,et al.  An Optimality Principle Governing Human Walking , 2008, IEEE Transactions on Robotics.

[6]  Rupert G. Miller.  Beyond ANOVA, basics of applied statistics , 1987 .

[7]  Andreas Riener,et al.  Sensor-actuator supported implicit interaction in driver assistance systems , 2010, Ausgezeichnete Informatikdissertationen.

[8]  Wei Ni,et al.  Intuitive vibro-tactile feedback for human body movement guidance , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Lyuba Alboul,et al.  Experiments in cooperative human multi-robot navigation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Jacques Penders,et al.  An experiment on squad navigation of human and robots , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[11]  E. Guglielmelli,et al.  Forearm orientation guidance with a vibrotactile feedback bracelet: On the directionality of tactile motor communication , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[12]  Sonia Chernova,et al.  Mobile human-robot teaming with environmental tolerance , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Roger W. Cholewiak,et al.  Sensory and Physiological Bases of Touch , 1991 .

[15]  Niklas Gloeckner,et al.  Handbook Of Human Vibration , 2016 .

[16]  A. Landi.  Human Hand Function , 2007 .

[17]  Mark W. Spong,et al.  Cooperative Avoidance Control for Multiagent Systems , 2007 .

[18]  Koji Tsukada,et al.  ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation , 2004, UbiComp.

[19]  Tobias Ende,et al.  VibroTac: An ergonomic and versatile usable vibrotactile feedback device , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[20]  ChangSu Ha,et al.  Vision-based teleoperation of unmanned aerial and ground vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  J J Koenderink,et al.  Haptic Aftereffect of Curved Surfaces , 1996, Perception.

[22]  Katherine J. Kuchenbecker,et al.  Evaluation of Tactile Feedback Methods for Wrist Rotation Guidance , 2012, IEEE Transactions on Haptics.

[23]  Hideki Hashimoto,et al.  Human-following mobile robot in a distributed intelligent sensor network , 2004, IEEE Transactions on Industrial Electronics.

[24]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[25]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[26]  Karon E. MacLean,et al.  Detecting vibrations across the body in mobile contexts , 2011, CHI.

[27]  Jean-Paul Laumond,et al.  On the nonholonomic nature of human locomotion , 2008, Auton. Robots.

[28]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[29]  Sebastian Thrun,et al.  Toward a Framework for Human-Robot Interaction , 2004, Hum. Comput. Interact..

[30]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[31]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  R. Johansson.  Tactile sensibility in the human hand: receptive field characteristics of mechanoreceptive units in the glabrous skin area. , 1978, The Journal of physiology.

[33]  Domenico Prattichizzo,et al.  On a Class of Hierarchical Formations of Unicycles and Their Internal Dynamics , 2012, IEEE Transactions on Automatic Control.

[34]  Domenico Prattichizzo,et al.  Discussion of paper by , 2003 .

[35]  C. E. Chapman,et al.  Perception of vibrotactile stimuli during motor activity in human subjects , 2004, Experimental Brain Research.