GPU-friendly warped display for scope-maintained video surveillance

In this paper, we propose an efficient technique for warped display of surveillance video signal. Usually, there are regions of interest (ROIs) in video surveillance, such as entrance or exit, and moving objects or persons. The surveillant has two or more conflicting goals in mind. He/She wants to blow up the ROIs, but also wants to have an overview of the whole surveillance scope. The proposed method solves this conflict by warping the input video signal in real time fashion. First, multiple ROIs are detected. Then, the mesh for texture mapping is deformed, according to the position and shape of the ROIs. The original video frame is mapped as a texture on the deformed mesh to produce the warped effect. Mesh deformation and texture mapping are accelerated by modern graphics processing units (GPU). By allocating more display space for ROIs, the proposed technique highlights such important regions and assists the surveillant to locate them effectively. By experiments, we show that the proposed method is effective and efficient.

[1]  Arnold W. M. Smeulders,et al.  Fast occluded object tracking by a robust appearance filter , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Masaaki Oka,et al.  Real-time manipulation of texture-mapped surfaces , 1987, SIGGRAPH '87.

[3]  Andrew S. Glassner Digital Cubism, Part 2 , 2004, IEEE Computer Graphics and Applications.

[4]  Anthony J. Yezzi,et al.  Fast incorporation of optical flow into active polygons , 2005, IEEE Transactions on Image Processing.

[5]  Andrew S. Glassner Digital cubism , 2004, IEEE Computer Graphics and Applications.

[6]  George Furnas,et al.  The FISHEYE view: A new look at structured files , 1986, CHI 1986.

[7]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Quan Pan,et al.  Real-time and accurate segmentation of moving objects in dynamic scene , 2004, VSSN '04.

[9]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[10]  Rama Chellappa,et al.  A generic approach to simultaneous tracking and verification in video , 2002, IEEE Trans. Image Process..

[11]  Benjamin B. Bederson,et al.  Fisheye menus , 2000, UIST '00.

[12]  Timothy K. Shih,et al.  Real-time multiple tracking using a combined technique , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[13]  Ramana Rao,et al.  A focus+context technique based on hyperbolic geometry for visualizing large hierarchies , 1995, CHI '95.

[14]  Paul R. Calder,et al.  Multi-Perspective Images for Visualisation , 2001, VIP.

[15]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[16]  Ralph Arnote,et al.  Hong Kong (China) , 1996, OECD/G20 Base Erosion and Profit Shifting Project.

[17]  Anthony D. Worrall,et al.  Tracking with the EM Contour Algorithm , 2002, ECCV.

[18]  Andrew S. Glassner,et al.  Cubism and Cameras: Free-form Optics for Computer Graphics , 2000 .

[19]  M. Sheelagh T. Carpendale,et al.  Extending Distortion Viewing from 2D to 3D , 1997, IEEE Computer Graphics and Applications.

[20]  Larry S. Davis,et al.  M2Tracker: A Multi-view Approach to Segmenting and Tracking People in a Cluttered Scene Using Region-Based Stereo , 2002, ECCV.

[21]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[22]  Heidrun Schumann,et al.  Interactive Focus and Context Display of Large Raster Images , 2000, WSCG.

[23]  Shree K. Nayar,et al.  Generation of Perspective and Panoramic Video from Omnidirectional Video , 1997 .

[24]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[25]  M. Sheelagh T. Carpendale,et al.  3-dimensional pliable surfaces: for the effective presentation of visual information , 1995, UIST '95.

[26]  Roberto Cipolla,et al.  Real-Time Tracking of Multiple Articulated Structures in Multiple Views , 2000, ECCV.

[27]  Vidya Setlur,et al.  : Research Description Optimizing Computer Imagery for Communication , 2007 .