Unsupervised Learning of Qualitative Motion Behaviours by a Mobile Robot

The success of mobile robots, in daily living environments, depends on their capabilities to understand human movements and interact in a safe manner. This paper presents a novel unsupervised qualitative-relational framework for learning human motion patterns using a single mobile robot platform. It is capable of learning human motion patterns in real-world environments, in order to predict future behaviours. This previously untackled task is challenging because of the limited field of view provided by a single mobile robot. It is only able to observe one location at any time, resulting in incomplete and partial human detections and trajectories. Central to the success of the presented framework is mapping the detections into an abstract qualitative space, and then characterising motion invariant to exact metric position. This framework was used by a physical robot autonomously patrolling a company's office during a six week deployment. Experimental results from this deployment are discussed and demonstrate the effectiveness and applicability of the system.

[1]  Frank Witlox,et al.  Representing moving objects in computer-based expert systems: the overtake event example , 2005, Expert Syst. Appl..

[2]  Anthony G. Cohn,et al.  Unsupervised Learning of Event Classes from Video , 2010, AAAI.

[3]  Thomas Eiter,et al.  Where is ...? Learning and Utilizing Motion Patterns of Persons with Mobile Robots , 2003, IJCAI.

[4]  Marc Hanheide,et al.  Real-time multisensor people tracking for human-robot spatial interaction , 2015 .

[5]  Anthony G. Cohn,et al.  Grounding Language in Perception for Scene Conceptualization in Autonomous Robots , 2014, AAAI Spring Symposia.

[6]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[8]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[9]  Nico Van de Weghe,et al.  Implementing a qualitative calculus to analyse moving point objects , 2011, Expert Syst. Appl..

[10]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[11]  Wolfram Burgard,et al.  Using EM to learn motion behaviors of persons with mobile robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Nick Hawes,et al.  Learning By Observation Using Qualitative Spatial Relations , 2015, AAMAS.

[13]  Eliseo Clementini,et al.  Qualitative Representation of Positional Information , 1997, Artif. Intell..

[14]  Shen Jun,et al.  A Hierarchical Self-Organizing Approach for Learning the Patterns of Motion Trajectories , 2003 .

[15]  Anthony G. Cohn,et al.  QSRlib: a software library for online acquisition of qualitative spatial relations from video , 2016 .

[16]  Wolfram Burgard,et al.  Learning Motion Patterns of People for Compliant Robot Motion , 2005, Int. J. Robotics Res..

[17]  Juan Chen,et al.  A survey of qualitative spatial representations , 2013, Knowledge engineering review (Print).

[18]  Kai Oliver Arras,et al.  Socially-aware robot navigation: A learning approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Gian Luca Foresti,et al.  Trajectory clustering and its applications for video surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[20]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Anthony G. Cohn,et al.  Egocentric Activity Monitoring and Recovery , 2012, ACCV.

[22]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[23]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[24]  Takayuki Kanda,et al.  Abstracting People's Trajectories for Social Robots to Proactively Approach Customers , 2009, IEEE Transactions on Robotics.

[25]  David C. Hogg,et al.  Detecting inexplicable behaviour , 2004, BMVC.