Human-robot collaboration in a Mobile Visual Sensor Network

This paper proposes and implements a framework for human-robot collaboration in a Mobile Visual Sensor Network (MVSN). A collaborative architecture for the proposed human-integrated MVSN was developed to allow the human operator and robots to collaborate to perform surveillance tasks. We successfully implemented the MVSN so the user can control the deployment of the mobile sensors through his head movement. We also explored using computer vision techniques and navigation techniques on the robot nodes to conduct active human target detection. The robot nodes, therefore, are able to detect human faces while exploring the unknown environment, and then relay the face images to the operator for target recognition. In this way, humans and robots can complement each other to accomplish surveillance tasks. Our experimental results validated the proposed framework.

[1]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Katia Sycara,et al.  Human Factors issues for Interaction with Bio-Inspired Swarms , 2012 .

[3]  Katia P. Sycara,et al.  The RETSINA MAS, a Case Study , 2002, SELMAS.

[4]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[5]  J. V. Erp,et al.  Vibrotactile in-vehicle navigation system , 2004 .

[6]  Yael Edan,et al.  Human-robot collaboration for improved target recognition of agricultural robots , 2003, Ind. Robot.

[7]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[8]  Itshak Tkach,et al.  Switching Between Collaboration Levels in a Human–Robot Target Recognition System , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Illah R. Nourbakhsh,et al.  Human-robot teaming for search and rescue , 2005, IEEE Pervasive Computing.

[10]  Gang Li,et al.  A cost-effective and open mobile sensor platform for networked surveillance , 2011, Optical Engineering + Applications.

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[12]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[13]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[14]  Martin Buss,et al.  Human-Robot Collaboration: a Survey , 2008, Int. J. Humanoid Robotics.

[15]  Jeanine Ayers,et al.  Multimodal interaction for human-robot teams , 2013, Defense, Security, and Sensing.

[16]  Illah R. Nourbakhsh,et al.  Interaction challenges in human-robot space exploration , 2005, INTR.

[17]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[18]  Mircea Nicolescu,et al.  Smart Monitoring of Complex Public Scenes Collaboration between Human Guards, Security Network and Robotic Platforms , 2011, AAAI 2011.

[19]  Guillermo Rodríguez-Ortiz,et al.  A New Method to Evaluate Human-Robot System Performance , 2003, Auton. Robots.