IMPROVE: An innovative application for collaborative mobile mixed reality design review

In this paper we introduce an innovative application aiming at combining large, tablet-based and headmounted displays for collaborative mobile mixed reality design reviews. Our research and development is motivated by two use scenarios: automotive and architectural design review involving real users from Page/Park architects and Elasis FIAT. Our activities are supported by the EU IST project IMPROVE. It covers activities in the areas of: HMD development using unique OLED technology, markerless tracking, augmented reality rendering, image calibration for large tiled displays, collaborative tablet-based and projection wall oriented interaction and stereoscopic video streaming for mobile users. The paper gives an overview of the hardware and software developments within IMPROVE and concludes with results from first user test.

[1]  Rick Stevens,et al.  Using a Camera to Capture and Correct Spatial Photometric Variation in Multi-Projector Displays , 2003 .

[2]  Andrew W. Fitzgibbon,et al.  Markerless tracking using planar structures in the scene , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[3]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[4]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Raffaele de Amicis,et al.  Spacedesign: a mixed reality workspace for aesthetic industrial design , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Ruigang Yang,et al.  Camera Based Calibration Techniques for Seamless Flexible Multi-Projector Displays , 2004 .

[8]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[9]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[10]  David Eppstein,et al.  Optimized color gamuts for tiled displays , 2002, SCG '03.

[11]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[12]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[13]  J. Hoffmann,et al.  Implementing Multi-Viewer Time-Sequential Stereo Displays Based on Shuttered LCD Projectors , 2004 .

[14]  D. Reiners,et al.  Color consistency for digital multi-projector stereo display systems: the HEyeWall and the Digital CAVE , 2003 .

[15]  Holger Regenbrecht,et al.  Interaction in a collaborative augmented reality environment , 2002, CHI Extended Abstracts.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  StoneSoup Consulting.  Color and Brightness Appearance Issues in Tiled Displays , 2001 .

[19]  Aditi Majumder,et al.  Color nonuniformity in projection-based displays: analysis and solutions , 2004, IEEE Transactions on Visualization and Computer Graphics.

[20]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[21]  Raffaele de Amicis,et al.  Spacedesign: A Mixed Reality Workspace for Aesthetic Industrial Design , 2002, ISMAR.

[22]  Kai Li,et al.  Color gamut matching for tiled display walls , 2003 .

[23]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[24]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[25]  Aditi Majumder,et al.  Perceptual photometric seamlessness in projection-based tiled displays , 2005, TOGS.

[26]  Maureen C. Stone.  Color Balancing Experimental Projection Displays , 2001, Color Imaging Conference.

[27]  Dieter Schmalstieg,et al.  Designing Immersive Virtual Reality for Geometry Education , 2006, IEEE Virtual Reality Conference (VR 2006).

[28]  Greg Welch,et al.  Achieving color uniformity across multi-projector displays , 2000 .

[29]  Martin Bauer,et al.  Fata Morgana - a presentation system for product design , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.