External cameras and a mobile robot: A collaborative surveillance system

This paper presents a system that surveils an indoor environment through the collaborative use of overhead cameras and a mobile robot. The robot is localized both in the image plane of the external camera and a ground plane map of its environment. This simultaneous localization is used to build up a homography between the image plane of each external camera and the ground plane. The robot begins the calibration procedure by moving through a series of pre-determined waypoints in the environment. As it comes into view of each camera, it uses visual servoing to orbit the centre of the camera image and keeping within its eld of view whilst avoiding obstacles. The system builds up a transformation matrix between each camera and the ground plane and proceeds to patrol the environment. When an intruder is detected in any of the external cameras, the system uses the automatically determined homography matrices to calculate the ground plane position of the person and sends out the robot to intercept the intruder. Experiments are conducted with 2 external cameras in this paper but could easily be extended to N cameras.

[1]  Rüdiger Dillmann,et al.  Robotics and Autonomous Systems: Editorial , 2003 .

[2]  Ray A. Jarvis,et al.  DISTANCE TRANSFORM BASED PATH PLANNING FOR ROBOT NAVIGATION , 1994 .

[3]  Isao Shimoyama,et al.  Synthesis of pheromone-oriented emergent behavior of a silkworm moth , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[4]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[5]  Punarjay Chakravarty,et al.  People tracking from a moving panoramic camera , 2008, ICRA 2008.

[6]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[7]  Raymond Austin Jarvis,et al.  Distributed visual servoing of a mobile robot for surveillance applications , 2004 .

[8]  William Whittaker,et al.  Conditional particle filters for simultaneous mobile robot localization and people-tracking , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[10]  Punarjay Chakravarty,et al.  Person tracking, pursuit & interception by mobile robot , 2006 .

[11]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[12]  Daniel P. Huttenlocher,et al.  A multi-resolution technique for comparing images using the Hausdorff distance , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Geoffrey Taylor,et al.  MECSE-30-2004 Automatic Video Surveillance and Robotic Early Response : An Evaluation of ObjectVideo VEW , 2004 .

[14]  Jun Ota,et al.  Self-calibration of environmental camera for mobile robot navigation , 2007, Robotics Auton. Syst..

[15]  J. Brouwer.  Sequentiële Monte Carlo Methoden (Sequential Monte Carlo Methods) , 2011 .

[16]  Henrik I. Christensen,et al.  Behaviour coordination for navigation in office environments , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.