Multiple camera human detection and tracking inside a robotic cell an approach based on image war, computer vision, k-d trees and particle filtering

In an industiral scenario the capability to detect and track human workers entering a robotic cell represents a fundamental requirement to enable safe and efficient human-robot cooperation. This paper proposes a new approach to the problem of Human Detection and Tracking based on low-cost commercial RGB surveillance cameras, image warping techniques, computer vision algorithms, efficient data structures such as k-dimensional trees and particle filtering. Results of several validation experiments are presented.

[1]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[2]  Matteo Munaro,et al.  Tracking people within groups with RGB-D data , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  G.M. Bone,et al.  Markerless human tracking for industrial environments , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.

[4]  Jean-Paul Laumond,et al.  An Optimality Principle Governing Human Walking , 2008, IEEE Transactions on Robotics.

[5]  Matteo Munaro,et al.  RGB-D Human Detection and Tracking for Industrial Environments , 2014, IAS.

[6]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[7]  Achim J. Lilienthal,et al.  Multi-human tracking using high-visibility clothing for industrial safety , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Luigi Palopoli,et al.  Safety provisions for human/robot interactions using stochastic discrete abstractions , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Dana Kulic,et al.  Pre-collision safety strategies for human-robot interaction , 2007, Auton. Robots.

[10]  Mehrdad R. Kermani,et al.  A New Sensory System for Modeling and Tracking Humans Within Industrial Work Cells , 2011, IEEE Transactions on Instrumentation and Measurement.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Henrik Andreasson,et al.  An inexpensive monocular vision system for tracking humans in industrial environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Paolo Rocco,et al.  Towards safe human-robot interaction in robotic cells: An approach based on visual tracking and intention estimation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Josechu J. Guerrero,et al.  Exploiting projective geometry for view-invariant monocular human motion analysis in man-made environments , 2014, Comput. Vis. Image Underst..

[15]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[16]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..