TERESA: a socially intelligent semi-autonomous telepresence system

TERESA is a socially intelligent semi-autonomous telepresence system that is currently being developed as part of an FP7-STREP project funded by the European Union. The ultimate goal of the project is to deploy this system in an elderly day centre to allow elderly people to participate in social events even when they are unable to travel to the centre. In this paper, we present an overview of our progress on TERESA. We discuss the most significant scientific and technical challenges including: understanding and automatically recognizing social behaviour; defining social norms for the interaction between a telepresence robot and its users; navigating the environment while taking into account social features and constraints; and learning to estimate the social impact of the robot’s actions from multiple sources of feedback. We report on our current progress on each of these challenges, as well as our plans for future work.

[1]  Cynthia Breazeal,et al.  Learning Social Interaction from the Wizard: A Proposal , 2014, AAAI 2014.

[2]  Stefanos Zafeiriou,et al.  Real-time generic face tracking in the wild with CUDA , 2014, MMSys '14.

[3]  Stefanos Zafeiriou,et al.  Robust Discriminative Response Map Fitting with Constrained Local Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Barbara Majecka,et al.  Statistical models of pedestrian behaviour in the Forum , 2009 .

[5]  E. Hall,et al.  The Hidden Dimension , 1970 .

[6]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[7]  Kai Oliver Arras,et al.  Planning Problems for Social Robots , 2011, ICAPS.

[8]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[9]  Margaret J. Weber,et al.  Influence of Sensory Abilities on the Interpersonal Distance of the Elderly , 2003 .

[10]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[11]  Thierry Siméon,et al.  Transition-based RRT for path planning in continuous cost spaces , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[13]  Anind K. Dey,et al.  Modeling Interaction via the Principle of Maximum Causal Entropy , 2010, ICML.

[14]  J. Mills,et al.  Presbycusis , 2005, The Lancet.

[15]  Anne Spalanzani,et al.  Understanding human interaction for probabilistic autonomous navigation using Risk-RRT approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.