First Person Omnidirectional Video: System Design and Implications for Immersive Experience

Fully recording and sharing an immersive experience is one of the ultimate goals of media technology. As extensive technical evolution, omnidirectional video is one of promising media to capture an immersive experience. First person omnidirectional video provides a unique experience of world through someone else's perspective. However, difficulties in wearable camera design and cybersickness induced by shaky video has been obstacle to explore applications of first person omnidirectional video. In this research, we introduce the design and implementation of "JackIn Head" a system including a wearable omnidirectional camera and image stabilization to alleviate cybersickness. Our evaluation revealed the alleviation of cybersickness. Then we report the series of workshops to explore user experience and applications in actual use cases such as virtual travel and virtual sports. We have compiled design implications about cybersickness and motion, immersive sensation, visualization and behavior data of spectators in experience with first person omnidirectional video.

[1]  Geoff A. W. West,et al.  Omnidirectional video stabilisation on a virtual camera using sensor fusion , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[2]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[3]  Kris Luyten,et al.  Multi-viewer gesture-based interaction for omni-directional video , 2014, CHI.

[4]  Louise Barkhuus,et al.  Panoramic video: design challenges and implications for content interaction , 2013, EuroITV.

[5]  Lizzy Bleumers,et al.  Seeing the bigger picture: a user perspective on 360° TV , 2012, EuroITV.

[6]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[7]  Ulrich Neumann,et al.  Immersive panoramic video , 2000, ACM Multimedia.

[8]  Hrvoje Benko,et al.  Multi-point interactions with immersive omnidirectional visualizations in a dome , 2010, ITS '10.

[9]  Pascal Vasseur,et al.  Rotation estimation and vanishing point extraction by omnidirectional vision in urban environment , 2012, Int. J. Robotics Res..

[10]  Javier Ruiz Hidalgo,et al.  Gesture Interaction with Rich TV Content in the Social Setting , 2013, CHI 2013.

[11]  Julie M. Drexler,et al.  Research in visually induced motion sickness. , 2010, Applied ergonomics.

[12]  Jens Spille,et al.  Towards a format-agnostic approach for production, delivery and rendering of immersive media , 2013, MMSys.

[13]  Yasushi Yagi,et al.  Wearable imaging system for capturing omnidirectional movies from a first-person perspective , 2009, VRST '09.

[14]  Teresa Chambel,et al.  Get around 360° hypervideo , 2010, MindTrek.

[15]  Philippe Bekaert,et al.  The pleasure of being (there?): an explorative study into the effects of presence and identification on the enjoyment of an interactive theatrical performance using omnidirectional video , 2014, AI & SOCIETY.

[16]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Tarak Gandhi,et al.  Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera , 2005, Machine Vision and Applications.

[18]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Hideki Koike,et al.  Human-centric panoramic imaging stitching , 2012, AH '12.

[20]  P. Howarth,et al.  The occurrence of virtual simulation sickness symptoms when an HMD was used as a personal viewing system , 1997 .

[21]  Hans J. Schneebeli,et al.  A general approach for egomotion estimation with omnidirectional images , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[22]  Louise Barkhuus,et al.  Watching the footwork: second screen interaction at a dance and music performance , 2014, CHI.

[23]  Shree K. Nayar,et al.  Ego-motion and omnidirectional cameras , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[24]  Emanuele Menegatti,et al.  Visual Gyroscope for Omnidirectional Cameras , 2012, IAS.

[25]  Richard Szeliski,et al.  First-person hyper-lapse videos , 2014, ACM Trans. Graph..

[26]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[27]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .