Online real-time presentation of virtual experiences forexternal viewers

Externally observing the experience of a participant in a virtual environment is generally accomplished by viewing an egocentric perspective. Monitoring this view can often be difficult for others to watch due to unwanted camera motions that appear unnatural and unmotivated. We present a novel method for reducing the unnaturalness of these camera motions by minimizing camera movement while maintaining the context of the participant's observations. For each time-step, we compare the parts of the scene viewed by the virtual participant to the parts of the scene viewed by the camera. Based on the similarity of these two viewpoints we next determine how the camera should be adjusted. We present two means of adjustment, one which continuously adjusts the camera and a second which attempts to stop camera movement when possible. Empirical evaluation shows that our method can produce paths that have substantially shorter travel distances, are easier to watch and maintain the original observations of the participant's virtual experience.

[1]  Chris Shaw,et al.  On temporal-spatial realism in the virtual reality environment , 1991, UIST '91.

[2]  Michael Gleicher,et al.  Re-cinematography: Improving the camerawork of casual video , 2008, TOMCCAP.

[3]  K. Ratakonda Real-time digital video stabilization for multi-media applications , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[4]  Sarp Ertürk,et al.  Real-Time Digital Image Stabilization Using Kalman Filters , 2002, Real Time Imaging.

[5]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[6]  Sung-Jea Ko,et al.  Robust digital image stabilization using the Kalman filter , 2009, IEEE Transactions on Consumer Electronics.

[7]  Chin-Teng Lin,et al.  Real-Time Digital Image Stabilization System Using Modified Proportional Integrated Controller , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Patrick Olivier,et al.  Virtual Camera Planning: A Survey , 2005, Smart Graphics.

[9]  Lorrie Faith Cranor,et al.  Are your participants gaming the system?: screening mechanical turk workers , 2010, CHI.

[10]  Amy E. Hawkins,et al.  Camera Keyframing using Linear Interpolation of Matrices , 2007 .

[11]  Huahai Yang,et al.  Exploring collaborative navigation:: the effect of perspectives on group performance , 2002, CVE '02.

[12]  Eric Foxlin,et al.  Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[13]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[14]  J. Dawes Do Data Characteristics Change According to the Number of Scale Points Used? An Experiment Using 5-Point, 7-Point and 10-Point Scales , 2008 .

[15]  In-So Kweon,et al.  System-on-Chip Solution of Video Stabilization for CMOS Image Sensors in Hand-Held Devices , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Lance Williams,et al.  Casting curved shadows on curved surfaces , 1978, SIGGRAPH.

[17]  Michael Gleicher,et al.  Effective Replays and Summarization of Virtual Experiences , 2012, IEEE Transactions on Visualization and Computer Graphics.

[18]  Shang-Hong Lai,et al.  A robust real-time video stabilization algorithm , 2006, J. Vis. Commun. Image Represent..

[19]  Marc Alexa,et al.  Linear combination of transformations , 2002, ACM Trans. Graph..

[20]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[21]  Daniel Thalmann,et al.  The benefits of third-person perspective in virtual and augmented reality? , 2006, VRST '06.

[22]  Suya You,et al.  Fusion of vision and gyro tracking for robust augmented reality registration , 2001, Proceedings IEEE Virtual Reality 2001.

[23]  David D Pothier,et al.  The Use of Real-Time Image Stabilization and Augmented Reality Eyewear in the Treatment of Oscillopsia , 2012, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[24]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[25]  C. W. Cummings,et al.  Cummings otolaryngology--head & neck surgery , 2010 .