Computing Realistic Images for Audience Interaction in Projection-Based Multi-view Display System

Stereoscopic multi-view system can provide multiple users with individual views of a virtual environment. But the existed systems can only present n (n≤6 currently) images, limited by its ratio to the refresh rate of display set, for users on a shared display set. To support more users, we propose two methods to cluster the users into k (k≤n) groups, so that users can perceive different stereoscopic images in different regions and the same image in the same region. The first method subdivides the virtual space into k=n fixed regions by Centroidal Voronoi Diagram (CVD) in the preprocessing step, where the centroid positions of CVD regions are used as viewpoints to render corresponding images. It runs fast because it only need to trace the positions of users and compute in which CVD regions they are locating in the running time, and the viewpoints can stay stabilized at some time. But it may lead to different views for users who are located in different regions while close to each other. The other method is designed to dynamically divide the virtual space into k≤n regions by k-means method in the running time, where the centroid positions of cluster blocks are used as viewpoints to render corresponding images. It can compute more effective viewpoints and more realistic images. As viewpoints are real-time computed according to the variable spatial-temporal information of users, the number of rendering images can be dynamic during the process, i.e., It is possible to be equal to or less than the maximum number of views the system can display, depending on the distribution of positions of moving users.

[1]  Margrit Betke,et al.  Evaluation of tracking methods for human-computer interaction , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[2]  Yong-Moo Kwon,et al.  Audience interaction for virtual reality theater and its implementation , 2001, VRST '01.

[3]  Vladimir Pavlovic,et al.  Real-Time Vision for Human-Computer Interaction , 2010 .

[4]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[6]  Bernd Fröhlich,et al.  The two-user Responsive Workbench: support for collaboration through individual views of a shared space , 1997, SIGGRAPH.

[7]  Sameer Singh,et al.  Video analysis of human dynamics - a survey , 2003, Real Time Imaging.

[8]  Guang Li,et al.  Sign Language Recognition and Translation with Kinect , 2013 .

[9]  Andrew Wilson,et al.  MirageTable: freehand interaction on a projected augmented reality tabletop , 2012, CHI.

[10]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[11]  Bernd Fröhlich,et al.  C1x6: a stereoscopic six-user display for co-located collaboration in shared virtual environments , 2011, SA '11.

[12]  Bernd Fröhlich,et al.  The Bent Pick Ray: An Extended Pointing Technique for Multi-User Interaction , 2006, 3D User Interfaces (3DUI'06).

[13]  Gunzburger,et al.  Advances in Studies and Applications of Centroidal Voronoi Tessellations , 2010 .

[14]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[15]  Pierre Alliez,et al.  CGAL - The Computational Geometry Algorithms Library , 2011 .

[16]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[17]  Chenglei Yang,et al.  Centroidal Voronoi Tessellation of Streamlines for Flow Visualization , 2013, 2013 10th International Symposium on Voronoi Diagrams in Science and Engineering.

[18]  Hamid K. Aghajan,et al.  Camera selection for tracking in distributed smart camera networks , 2014, TOSN.