Panoramic video with predictive windows for telepresence applications

We describe the application of a predictive Kalman filter to the display of panoramic images. We discuss integrating a panoramic imaging system with prediction of viewing direction to create an effective telepresence system over low bandwidth links. Panoramic imaging using a reflective mirror surface offers an alternative to pan-tilt systems for obtaining a 360 degree field of view. Selecting a small window within a panoramic image allows a meaningful part of an image from a remote site to be seen at a higher refresh rate. Because of the delay in transmitting an image from a remote site, it is necessary to have additional image information available locally. This information can be used to simulate continuously flowing pictures with reduced apparent delay. Continuity in image viewing is achieved by predicting the next viewpoint of an operator and preemptively transmitting parts of an image. Experimental results are given to evaluate the proposed telepresence system.

[1]  J. Diebold.  Automation , 1955, Industry, Innovation and Infrastructure.

[2]  Warren Robinson,et al.  Synthetic Experience: A Proposed Taxonomy , 1992, Presence Teleoperators Virtual Environ..

[3]  Chris Shaw,et al.  On temporal-spatial realism in the virtual reality environment , 1991, UIST '91.

[4]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[5]  Ian D. Reid,et al.  The Active Recovery of 3D Motion Trajectories and Their Use in Prediction , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Richard P. Paul,et al.  Teleprogramming: Toward Delay-Invariant Remote Manipulation , 1992, Presence: Teleoperators & Virtual Environments.

[7]  Claude Pégard,et al.  A mobile robot using a panoramic view , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[8]  Thomas B. Sheridan.  Teleoperation, Telerobotics, and Telepresence: A Progress Report , 1992 .

[9]  Anup Basu,et al.  A conical mirror pipeline inspection system , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[10]  Anup Basu,et al.  Predictive windows for delay compensation in telepresence applications , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[11]  Susumu Tachi,et al.  Compensation of time lag between actual and virtual spaces by multi-sensor integration , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[12]  R. Paul,et al.  Teleprogramming: overcoming communication delays in remote manipulation , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[13]  Subbarayan Pasupathy,et al.  Predictive head movement tracking using a Kalman filter , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Shigang Li,et al.  Estimating camera motion precisely from omni-directional images , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[15]  Warren Robinett,et al.  Synthetic Experience:A Proposed Taxonomy , 1992, Presence: Teleoperators & Virtual Environments.