Human–Robot Interaction and Cooperation Through People Detection and Gesture Recognition

In this paper, we propose a system that performs human–robot interaction in order to carry out a cooperation between a robot and a person. The system is based on people detection and gesture recognition. Human beings are detected using a technique that combines face and legs detection from data provided by a camera and a laser range finder. Besides that the gesture recognition method allows the person to choose the kind of help he/she wants. In this work, the cooperative tasks the robot can perform are to guide the user up to a desired place in the work environment, to carry a load together with or for a person, to follow a person or navigate to a place to get something the user wants. Many experiments were performed and two of them (person guidance and navigation up to a predefined place carrying an object) will be shown in this paper with the purpose of validating the proposed system.

[1]  Raquel Frizera Vassallo,et al.  A nonlinear controller for people guidance based on omnidirectional vision , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Karsten Berns,et al.  Perception systems for naturally interacting humanoid robots , 2011, 2011 RO-MAN.

[3]  Verena V. Hafner,et al.  Real-time dynamic visual gesture recognition in human-robot interaction , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[4]  M. S. Filho,et al.  An approach to avoid obstacles in mobile robot navigation: the tangential escape , 2008 .

[5]  Javier Ruiz-del-Solar,et al.  Dynamic gesture recognition for human robot interaction , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[6]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  António E. Ruano,et al.  Fast Line, Arc/Circle and Leg Detection from Laser Scan Data in a Player Driver , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[10]  George A. Bekey,et al.  AUTONOMOUS ROBOTS, From Biological Inspiration to Implementation and Control, by G.A. Bekey, MIT Press, 2005, xv + 577 pp., index, ISBN 0-262-02578-7, 25 pages of references (Hb. £35.95) , 2005, Robotica.

[11]  Alexander H. Waibel,et al.  Natural human-robot interaction using speech, head pose and gestures , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Chu-Song Chen,et al.  Fast Human Detection Using a Novel Boosted Cascading Structure With Meta Stages , 2008, IEEE Transactions on Image Processing.

[13]  Alexander Carballo,et al.  Multiple People Detection from a Mobile Robot using Double Layered Laser Range Finders , 2009 .

[14]  Fatih Murat Porikli,et al.  Human Detection via Classification on Riemannian Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[16]  Alan F. Smeaton,et al.  A Framework for Evaluating Stereo-Based Pedestrian Detection Techniques , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  J. Geoffrey Chase,et al.  Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design , 2008 .

[18]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[19]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Huosheng Hu,et al.  Multisensor-Based Human Detection and Tracking for Mobile Service Robots , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Dariu Gavrila,et al.  Pedestrian Detection and Tracking Using a Mixture of View-Based Shape–Texture Models , 2008, IEEE Transactions on Intelligent Transportation Systems.

[23]  E. Hall.  The Silent Language , 1959 .