Contextualized Videos: Combining Videos with Environment Models to Support Situational Understanding

Multiple spatially-related videos are increasingly used in security, communication, and other applications. Since it can be difficult to understand the spatial relationships between multiple videos in complex environments (e.g. to predict a person's path through a building), some visualization techniques, such as video texture projection, have been used to aid spatial understanding. In this paper, we identify and begin to characterize an overall class of visualization techniques that combine video with 3D spatial context. This set of techniques, which we call contextualized videos, forms a design palette which must be well understood so that designers can select and use appropriate techniques that address the requirements of particular spatial video tasks. In this paper, we first identify user tasks in video surveillance that are likely to benefit from contextualized videos and discuss the video, model, and navigation related dimensions of the contextualized video design space. We then describe our contextualized video testbed which allows us to explore this design space and compose various video visualizations for evaluation. Finally, we describe the results of our process to identify promising design patterns through user selection of visualization features from the design space, followed by user interviews.

[1]  Steve Benford,et al.  Moving office: inhabiting a dynamic building , 2006, CSCW '06.

[2]  Min Chen,et al.  Visual Signatures in Video Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[3]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[4]  Melanie Tory,et al.  Visualization task performance with 2D, 3D, and combination displays , 2006, IEEE Transactions on Visualization and Computer Graphics.

[5]  Frank M. Shipman,et al.  Effects of presenting geographic context on tracking activity between cameras , 2007, CHI.

[6]  Niklas Elmqvist,et al.  A Taxonomy of 3D Occlusion Management Techniques , 2007, 2007 IEEE Virtual Reality Conference.

[7]  Supun Samarasekera,et al.  Video Flashlights: Real Time Rendering of Multiple Videosfor Immersive Model Visualization , 2002, Rendering Techniques.

[8]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[9]  Kristin A. Cook,et al.  Illuminating the Path: The Research and Development Agenda for Visual Analytics , 2005 .

[10]  Ravin Balakrishnan,et al.  Using deformations for browsing volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[11]  Suya You,et al.  3D video surveillance with Augmented Virtual Environments , 2003, IWVS '03.

[12]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[13]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[14]  Marilyn Tremaine,et al.  Understanding visualization through spatial ability differences , 2005, VIS 05. IEEE Visualization, 2005..

[15]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[16]  Donald H. House,et al.  On the optimization of visualizations of complex phenomena , 2005, VIS 05. IEEE Visualization, 2005..

[17]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.

[18]  Allison Woodruff,et al.  Guidelines for using multiple views in information visualization , 2000, AVI '00.

[19]  Min Chen,et al.  Video visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[20]  Hitendra K. Pillay,et al.  Cognitive load and mental rotation: structuring orthographic projection for learning and problem solving , 1994 .

[21]  Brian Christopher Smith,et al.  CU-SeeMe VR immersive desktop teleconferencing , 1997, MULTIMEDIA '96.

[22]  Melanie Tory Mental registration of 2D and 3D visualizations (an empirical study) , 2003, IEEE Visualization, 2003. VIS 2003..