Configuring Mixed Reality Environment

We present a practical framework for registering a mixed reality (MR) environment of an arbitrary number of agents. Each agent consists of a head mounted display (HMD), which consists of a pair of stereo cameras. Each agent is assumed to be moving freely in 3D space and multiple HMDs need not have a common field of view (FoV). We show that the plane at infinity and a common vertical vanishing point can be use to determine the exact orientation of all HMDs with respect to each other, and establish a common reference frame. Our method generalizes previous work which considers restricted camera motions. Using minimal assumptions, we are able to successfully demonstrate promising results on real data

[1]  Richard I. Hartley,et al.  Self-Calibration of Stationary Cameras , 1997, International Journal of Computer Vision.

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Reinhard Koch,et al.  Camera calibration with known rotation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Christopher O. Jaynes.  Multi-view calibration from planar motion trajectories , 2004, Image Vis. Comput..

[6]  Wu Zhong.  International Trends of Pattern Recognition Research A Brief Introduction to the 18th International Conference on Pattern Recognition , 2006 .

[7]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[10]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Harpreet S. Sawhney,et al.  Real-time wide area multi-camera stereo tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).