A Mobile Vision System with Reconfigurable Intelligent Agents

Performing face detection and tracking on a mobile robot in a dynamic environment is a challenging task with the real-time constraints. To realize a natural reactive behavior of the mobile robot, some efficient algorithms are applied for face detection and tracking due to the limited onboard computation power. Instead of pushing the limit of software development and the computational resources by implementing these algorithms on a software platform, a reconfigurable System-on-Chip (SoC) platform is adopted to achieve the higher real-time performance. A BDI intelligent agent model is proposed as a unified structure for both hardware and software. The real-world experimental results on a mobile vision system for face detection and tracking demonstrate the feasibility and efficiency of the reconfigurable intelligent agent model.

[1]  Adam Johnson,et al.  Pattern matching in reconfigurable logic for packet classification , 2001, CASES '01.

[2]  Yanbing Li,et al.  Hardware-software co-design of embedded reconfigurable architectures , 2000, DAC.

[3]  Robert K. Brayton,et al.  HW/SW partitioning and code generation of embedded control applications on a reconfigurable architecture platform , 2002, Proceedings of the Tenth International Symposium on Hardware/Software Codesign. CODES 2002 (IEEE Cat. No.02TH8627).

[4]  K. Rohr.  Towards model-based recognition of human movements in image sequences , 1994 .

[5]  Andreas Zell,et al.  Detection, tracking, and pursuit of humans with an autonomous mobile robot , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[6]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Yan Meng.  An agent-based reconfigurable system-on-chip architecture for real-time systems , 2005, Second International Conference on Embedded Software and Systems (ICESS'05).

[8]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[9]  Michael Wooldridge,et al.  A Formal Specification of dMARS , 1997, ATAL.

[10]  Marten van Sinderen,et al.  Transparent dynamic reconfiguration for CORBA , 2001, Proceedings 3rd International Symposium on Distributed Objects and Applications.

[11]  Anup Basu,et al.  Motion Tracking with an Active Camera , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Peter M. Athanas,et al.  A versatile framework for FPGA field updates: an application of partial self-reconfiguration , 2003, 14th IEEE International Workshop on Rapid Systems Prototyping, 2003. Proceedings..

[14]  M. Melamed.  Detection , 2021, SETI: Astronomy as a Contact Sport.

[15]  Vered Gafni,et al.  Robots: a real-time systems architectural style , 1999, ESEC/FSE-7.

[16]  Klaus Buchenrieder,et al.  Codesign of embedded systems based on Java and reconfigurable hardware components , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[17]  Bernhard Fröba,et al.  Face detection and tracking using edge orientation information , 2000, IS&T/SPIE Electronic Imaging.

[18]  Philip James-Roxby,et al.  A Self-reconfiguring Platform , 2003, FPL.

[19]  Debanjan Saha,et al.  Hardware software partitioning using genetic algorithm , 1997, Proceedings Tenth International Conference on VLSI Design.

[20]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[21]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[22]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[23]  Vinay Sharma,et al.  Robust detection of people in thermal imagery , 2004, ICPR 2004.