The evolution from single to pervasive smart cameras

Having seen increased interest from the research community, smart camera systems have gone through a number of evolutionary steps like from single cameras to distributed smart camera systems with collaboration features. This work aims at defining a taxonomy to classify these systems based on their platform capabilities, the degree of distributed processing as well as system autonomy aspects covering self-configuration and mobility. Existing camera systems are classified according to the proposed taxonomy. Besides capturing the design space for smart cameras, the main contribution of this paper is an overview of the research challenges for the envisioned class of pervasive smart camera systems. As defined in this work, future pervasive smart camera systems will be visual sensor networks targeted at end-user applications where special emphasis is put on unobtrusiveness of the cameras as well as simple deployment supported by self configuration capabilities.

[1]  Rolf Ernst,et al.  A High-End Real-Time Digital Film Processing Reconfigurable Platform , 2007, EURASIP J. Embed. Syst..

[2]  John Fraser Snowdon,et al.  Characterization of a Reconfigurable Free-Space Optical Channel for Embedded Computer Applications with Experimental Validation Using Rapid Prototyping Technology , 2007, EURASIP J. Embed. Syst..

[3]  W. Grimson,et al.  Ground Plane Rectification by Tracking Moving Objects , 2003 .

[4]  Mubarak Shah,et al.  Human Tracking in Multiple Cameras , 2001, ICCV.

[5]  Wolfgang Straßer,et al.  Adaptive Probabilistic Tracking Embedded in Smart Cameras for Distributed Surveillance in a 3D Model , 2007, EURASIP J. Embed. Syst..

[6]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Chen Wu,et al.  Mapping Vision Algorithms on SIMD Architecture Smart Cameras , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[8]  T.W.J. Moorhead,et al.  Smart CMOS camera for machine vision applications , 1999 .

[9]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..

[10]  Bernhard Rinner,et al.  Embedded Middleware on Distributed Smart Cameras , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Anthony Rowe,et al.  CMUcam3: An Open Programmable Embedded Vision Sensor , 2007 .

[12]  Wayne H. Wolf,et al.  Design and implementation of ubiquitous smart cameras , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[13]  C. Guestrin,et al.  Distributed localization of networked cameras , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[14]  Jocelyn Sérot,et al.  Hardware, Design and Implementation Issues on a Fpga-Based Smart Camera , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[15]  Paul Wielage,et al.  Xetal: a low-power high-performance smart camera processor , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[16]  Makoto Yokoo,et al.  Trends of internet auctions and agent-mediated Web commerce , 2001, New Generation Computing.

[17]  D. Covi,et al.  VISoc: A smart camera SoC , 2002, Proceedings of the 28th European Solid-State Circuits Conference.

[18]  Stephan Schraml,et al.  Embedded Vehicle Speed Estimation System Using an Asynchronous Temporal Contrast Vision Sensor , 2007, EURASIP J. Embed. Syst..

[19]  Horst Bischof,et al.  TRICam - An Embedded Platform for Remote Traffic Surveillance , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[20]  Chih-Lin Hu,et al.  A mobile agent-based active network architecture for intelligent network control , 2002, Inf. Sci..

[21]  Anthony Rowe,et al.  FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System , 2007, 28th IEEE International Real-Time Systems Symposium (RTSS 2007).

[22]  Wu-chi Feng,et al.  Panoptes: scalable low-power video sensor networking technologies , 2003, ACM Multimedia.

[23]  Haeyong Chung,et al.  Distributed metric calibration of ad hoc camera networks , 2006, TOSN.

[24]  Keith J. Blow,et al.  Making motes intelligent: an agent-based approach to wireless sensor networks , 2006 .

[25]  Horst Bischof,et al.  Online Auto-Calibration in Man-Made Worlds , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[26]  Bernhard Rinner,et al.  An Introduction to Distributed Smart Cameras , 2008, Proceedings of the IEEE.

[27]  Bernhard Rinner,et al.  Real-time video analysis on an embedded smart camera for traffic surveillance , 2004, Proceedings. RTAS 2004. 10th IEEE Real-Time and Embedded Technology and Applications Symposium, 2004..

[28]  Miguel A. Patricio,et al.  Multi-Agent Framework in Visual Sensor Networks , 2007, EURASIP J. Adv. Signal Process..

[29]  Chenyang Lu,et al.  Rapid Development and Flexible Deployment of Adaptive Wireless Sensor Network Applications , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[30]  Deborah Estrin,et al.  Cyclops: in situ image sensing and interpretation in wireless sensor networks , 2005, SenSys '05.

[31]  Henry Medeiros,et al.  A Light-Weight Event-Driven Protocol for Sensor Clustering in Wireless Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[32]  Wolfgang Straßer,et al.  SMARTCLASSYSURV - a smart camera network for distributed tracking and activity recognition and its application to assisted living , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[33]  Bernhard Rinner,et al.  Distributed embedded smart cameras for surveillance applications , 2006, Computer.

[34]  Roberto Manduchi,et al.  Characterizing energy consumption in a visual sensor network testbed , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[35]  António de Sousa.  Smart Cameras in Embedded Systems , 2020 .

[36]  Richard P. Kleihorst,et al.  Camera Mote with a High-Performance Parallel Processor for Real-Time Frame-Based Video Processing , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[37]  Yu Shi,et al.  An FPGA-Based Smart Camera for Gesture Recognition in HCI Applications , 2007, ACCV.

[38]  Robert B. Fisher.  Self-Organization of Randomly Placed Sensors , 2002, ECCV.

[39]  Roberto Manduchi,et al.  A Power-Aware, Self-Managing Wireless Camera Network for, Wide Area Monitoring , 2006 .

[40]  Bernhard Rinner,et al.  Improved Agent-Oriented Middleware for Distributed Smart Cameras , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[41]  Sharath Pankanti,et al.  Enabling video privacy through computer vision , 2005, IEEE Security & Privacy Magazine.

[42]  Oscar de Bruijn,et al.  Living memory: agent-based information management for connected local communities , 2002, Interact. Comput..

[43]  Sufen Fong,et al.  MeshEye: A Hybrid-Resolution Smart Camera Mote for Applications in Distributed Intelligent Surveillance , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[44]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[45]  Lui Sha,et al.  The Simplex Reference Model: Limiting Fault-Propagation Due to Unreliable Components in Cyber-Physical System Architectures , 2007, RTSS 2007.