System of systems approach to a human tracking problem with mobile robots using a single security camera

Solving the problem of integrating several independent systems to work intelligently and autonomously together has been an important task for an area called System of Systems (SoS). Currently there are initiatives in large-scale systems utilizing a SoS approach, such as Internet and Ballistic Missile Defense systems. In this work, a smaller, yet complex human tracking task by a mobile robot in a dynamic outdoor environment has been achieved by utilizing a SoS design approach. The detection of moving humans is performed using statistical background modeling and foreground detection on sequential images provided by a single fixed security camera in an outdoor location. The robot control is achieved through established communication formatted as XML messages containing positional data of a moving human target. A real world application of such a SoS architecture includes border thread detection, where humans crossing the border illegally can be tracked by autonomous border protection vehicles.

[1]  Larry S. Davis,et al.  Tracking humans from a moving platform , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Ming Zhao,et al.  Robust background subtraction in HSV color space , 2002, SPIE ITCom.

[3]  R. Chapuis,et al.  Shape-based pedestrian detection and localization , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[4]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  S. Ribaric,et al.  Real-time active visual tracking system , 2004, Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference (IEEE Cat. No.04CH37521).

[6]  Karsten P. Ulland,et al.  Vii. References , 2022 .

[7]  Dimitri N. Mavris,et al.  Systems-of-Systems Analysis of Ballistic Missile Defense Architecture Effectiveness through Surrogate Modeling and Simulation , 2010, 2008 2nd Annual IEEE Systems Conference.

[8]  Wolfram Burgard,et al.  Tracking multiple moving targets with a mobile robot using particle filters and statistical data association , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[9]  Eli Saber,et al.  An application of human robot interaction: development of a ping-pong playing robotic arm , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[10]  Mark W. Maier,et al.  Architecting Principles for Systems‐of‐Systems , 1996 .

[11]  Andreas Zell,et al.  Detection, tracking, and pursuit of humans with an autonomous mobile robot , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[12]  Mo M. Jamshidi,et al.  A Discrete Event XML based Simulation Framework for System of Systems Architectures , 2007, 2007 IEEE International Conference on System of Systems Engineering.