Real-time social touch gesture recognition for sensate robots

This paper describes the hardware and algorithms for a realtime social touch gesture recognition system. Early experiments involve a Sensate Bear test-rig with full body touch sensing, sensor visualization and gesture recognition capabilities. Algorithms are based on real humans interacting with a plush bear. In developing a preliminary gesture library with thirteen Symbolic Gestures and eight Touch Subtypes, we have taken the first steps toward a Robotic Touch API, showing that the Huggable robot behavior system will be able to stream currently active sensors to detect regional social gestures and local sub-gestures in realtime. The system demonstrates the infrastructure to detect three types of touching: social touch, local touch, and sensor-level touch.

[1]  Debra Phillips Parshall.  Research and Reflection: Animal-Assisted Therapy in Mental Health Settings , 2003 .

[2]  T. Taichi,et al.  Automatic Categorization of Haptic Interactions -What are the Typical Haptic Interactions Between a Human and a Robot? , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[3]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[4]  Takanori Shibata,et al.  Long-term Interaction between Seal Robots and Elderly People - Robot Assisted Activity at a Health Service Facility for the Aged , 2005, AMiRE.

[5]  Heather-Marie Callanan Knight.  An architecture for sensate robots : real time social-gesture recognition using a full body array of touch sensors , 2008 .

[6]  Masayuki Inaba,et al.  Development of friendly artifact-first prototype: penguin , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[7]  Kazuhiko Shinozawa,et al.  Recognizing human touching behaviors using a haptic interface for a pet-robot , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[8]  S. Thayer,et al.  History and strategies of research on social touch , 1986 .

[9]  Pamela J. Hinds,et al.  Whose job is it anyway? a study of human-robot interaction in a collaborative task , 2004 .

[10]  Cynthia Breazeal,et al.  Design of a therapeutic robotic companion for relational, affective touch , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  C. Davis.  Touch , 1997, The Lancet.

[12]  Fumihide Tanaka,et al.  Socialization between toddlers and robots at an early childhood education center , 2007, Proceedings of the National Academy of Sciences.

[13]  Masayuki Inaba,et al.  Development of functional whole-body flesh with distributed three-axis force sensors to enable close interaction by humanoids , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Takanori Shibata,et al.  Robot assisted activity at a health service facility for the aged for 17 months: an interim report of long-term experiment , 2005, IEEE Workshop on Advanced Robotics and its Social Impacts, 2005..

[16]  Cynthia Breazeal,et al.  A Sensitive Skin for Robotic Companions Featuring Temperature, Force, and Electric Field Sensors , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Cynthia Breazeal,et al.  Affective Touch for Robotic Companions , 2005, ACII.

[18]  Michael Lynn,et al.  Reach out and touch your customers , 1998 .

[19]  Cynthia Breazeal,et al.  The design of a semi-autonomous robot avatar for family communication and education , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  M. Lynn,et al.  Reach Out and Touch Your Customers , 1998 .