A 3D object model for wireless camera networks with network constraints

A new general 3D object model is required in the literature of smart camera networks to facilitate future research. This paper presents a novel hierarchical and structural 3D model description which is well-suited for both events detection and real-time free view-point surveillance. With this 3D model, sparse points are used to reconstruct objects. In addition, the state of the model is easy to track and estimate, which can be used to reduce time and computation when reconstructing the model. Further, data flow in the network is reduced to the level where smart cameras can afford. Concrete data structure of the model is described in this paper and its reconstruction method, fusion method are provided. Finally, experiment results show its feasibility, efficiency and effectiveness.

[1]  P. Besl.  Geometric modeling and computer vision , 1988, Proc. IEEE.

[2]  Mark A. Horowitz,et al.  Light field video camera , 2000, IS&T/SPIE Electronic Imaging.

[3]  Bernhard Rinner,et al.  An Introduction to Distributed Smart Cameras , 2008, Proceedings of the IEEE.

[4]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[5]  Wayne H. Wolf,et al.  Multiple object tracking and occlusion handling by information exchange between uncalibrated cameras , 2005, IEEE International Conference on Image Processing 2005.

[6]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Gary L. Miller,et al.  Dynamic mesh refinement , 2007 .

[9]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[10]  Ryo Kurazume,et al.  Fast 3D reconstruction of human shape and motion tracking by parallel fast level set method , 2008, 2008 IEEE International Conference on Robotics and Automation.

[11]  Hideo Saito,et al.  Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras , 2007, IEEE Transactions on Multimedia.

[12]  Wolfgang Straßer,et al.  Smart Camera Based Monitoring System and Its Application to Assisted Living , 2008, Proceedings of the IEEE.

[13]  Dan Schonfeld,et al.  Distributed Bayesian Multiple-Target Tracking in Crowded Environments Using Multiple Collaborative Cameras , 2007, EURASIP J. Adv. Signal Process..

[14]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[15]  Marc Parizeau,et al.  MONNET: Monitoring Pedestrians with a Network of Loosely-Coupled Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Jules Bloomenthal,et al.  Polygonization of implicit surfaces , 1988, Comput. Aided Geom. Des..

[17]  Mark Weiss.  Data Structures and Problem Solving Using C , 1999 .

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  Ian F. Akyildiz,et al.  Wireless Multimedia Sensor Networks: Applications and Testbeds , 2008, Proceedings of the IEEE.

[20]  Masahiro Okuda,et al.  Construction of Regular 3D Mesh Models for Real Objects , 2006 .

[21]  Anil M. Cheriyadat,et al.  Detecting multiple moving objects in crowded environments with coherent motion regions , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Chen Wu,et al.  Real-Time Human Pose Estimation: A Case Study in Algorithm Design for Smart Camera Networks , 2008, Proceedings of the IEEE.

[23]  Bernhard Rinner,et al.  A Bright Future for Distributed Smart Cameras , 2008 .

[24]  Demetri Terzopoulos,et al.  Smart Camera Networks in Virtual Reality , 2007, Proceedings of the IEEE.

[25]  Leonidas J. Guibas,et al.  Multi-person tracking from sparse 3D trajectories in a camera sensor network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[26]  Tim Ellis,et al.  Multi-camera video surveillance , 2002, Proceedings. 36th Annual 2002 International Carnahan Conference on Security Technology.

[27]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[28]  Henry Medeiros,et al.  Distributed Object Tracking Using a Cluster-Based Kalman Filter in Wireless Camera Networks , 2008, IEEE Journal of Selected Topics in Signal Processing.

[29]  Justus H. Piater,et al.  A modular multi-camera framework for team sports tracking , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[30]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[32]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[33]  Lisa M. Brown,et al.  IBM smart surveillance system (S3): a open and extensible framework for event based surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..