Reconfigurable Architecture for Distributed Smart Cameras

Embedded smart cameras must provide enough computational power to handle complex image understanding algorithms on huge amount of data in-situ. In a distributed set-up, smart cameras must provide efficient communication and flexibility in additional to performance. Programmability and physical constraints such as size, weight and power (SWAP) complicate design and architectural choices. In this chapter, we explore the use of FPGAs as computational engine in distributed smart cameras and present a smart camera system designed to be used as node in a camera sensor network. Beside the performance and flexibility size and power requirements are addressed through a modular and scalable design. The programability of the system is addressed by a seamless integration of the Intel OpenCV computer vision library to the platform.

[1]  Yu Shi,et al.  An FPGA-Based Smart Camera for Gesture Recognition in HCI Applications , 2007, ACCV.

[2]  Duc Truong Pham,et al.  Smart Vision Applications , 2003 .

[3]  Bernhard Rinner,et al.  Embedded Middleware for Smart Camera Networks and Sensor Fusion , 2009, Multi-Camera Networks.

[4]  Weiming Shen,et al.  Dynamic manufacturing scheduling using both functional and resource related agents , 2001, Integr. Comput. Aided Eng..

[5]  C. Shalizi,et al.  Causal architecture, complexity and self-organization in time series and cellular automata , 2001 .

[6]  Jaroslaw Sobieszczanski-Sobieski,et al.  Particle swarm optimization , 2002 .

[7]  G. Prytz,et al.  Real-time performance measurements using UDP on Windows and Linux , 2005, 2005 IEEE Conference on Emerging Technologies and Factory Automation.

[8]  Hajime Asama,et al.  Cooperation between the human operator and the multi-agent robotic system: evaluation of agent monitoring methods for the human interface system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Jeffrey S. Rosenschein,et al.  Rational interaction: cooperation among intelligent agents , 1986 .

[11]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[12]  Jeffrey O. Kephart,et al.  Autonomic computing: Architectural approach and prototype , 2006, Integr. Comput. Aided Eng..

[13]  Jürgen Teich,et al.  The Erlangen Slot Machine: a highly flexible FPGA-based reconfigurable platform , 2005, 13th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM'05).

[14]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[15]  François Verdier,et al.  Mapping Semantics of CORBA IDL and GIOP to Open Core Protocol for Portability and Interoperability of SDR Waveform Components , 2008, 2008 Design, Automation and Test in Europe.

[16]  Klaus Fischer,et al.  Agents in manufacturing: online scheduling and production plant configuration , 1999, Proceedings. First and Third International Symposium on Agent Systems Applications, and Mobile Agents.

[17]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[18]  Allen Y. Yang,et al.  CITRIC: A low-bandwidth wireless camera network platform , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[19]  Stephen D. Huston,et al.  The ACE Programmer's Guide: Practical Design Patterns for Network and Systems Programming , 2003 .

[20]  David Naso,et al.  Modelling adaptive multi-agent manufacturing control with discrete event system formalism , 2004, Int. J. Syst. Sci..

[21]  John Anderson,et al.  An Agent-Based Approach to introductory Robotics using robotic Soccer , 2006, Int. J. Robotics Autom..

[22]  Andrea Cavallaro,et al.  Multi-Camera Networks: Principles and Applications , 2009 .

[23]  Bernhard Rinner,et al.  A novel software framework for embedded multiprocessor smart cameras , 2009, TECS.

[24]  Gérard G. Medioni,et al.  Distributed Visual Processing for a Home Visual Sensor Network , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[25]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[26]  Salim Hariri,et al.  The Autonomic Computing Paradigm , 2006, Cluster Computing.

[27]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[28]  Prithviraj Dasgupta,et al.  Auction-based multi-robot task allocation in COMSTAR , 2007, AAMAS '07.