SuppleView: Rotation-Based Browsing Method by Changing Observation Angle of View for an Actor in Existing Videos

In this paper, we proposed the rotation based browsing method for video learning in personal training. SuppleView, which is flexible in respect of the user's physical position while viewing a video, enables coordinate translation free viewing between an observer and an actor. Previous work on video learning have not enough explored the limitation on the observation angle, although its angle effects for observer's comprehension and caused only in video learning not in observation with the actual trainer. The method solve this basic limitation by inferring the 3D pose of frames in a video. Based on those poses, we create an virtual agent with 3D model as an actor of movements, that is same with the movement in an original 2D video. The system transition for the two actors depends on the physical rotation of the user's head so that the angle of view for observing the actor also changes. Hence, the content rendering in proposed viewer could be provided to trainees as in kind-full form for their observation in the point of an observation angle of view. We report the method overview and our prototyping to show the proof of concept.

[1]  Yang-Sheng Chen,et al.  My Tai-Chi coaches: an augmented-learning tool for practicing Tai-Chi Chuan , 2017, AH.

[2]  Daniel Medeiros,et al.  SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback , 2016, IUI.

[3]  Hrvoje Benko,et al.  LightGuide: projected visualizations for hand movement guidance , 2012, CHI.

[4]  Frank Vetere,et al.  Onebody: Remote Posture Guidance System using First Person View in Virtual Environment , 2016, NordiCHI.

[5]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[6]  Hongsong Li,et al.  OutsideMe: Augmenting Dancer's External Self-Image by Using A Mixed Reality System , 2015, CHI Extended Abstracts.

[7]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[8]  Xing-Dong Yang,et al.  Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises , 2015, CHI.

[9]  Iasonas Kokkinos,et al.  DensePose: Dense Human Pose Estimation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Hans-Peter Seidel,et al.  VNect , 2017, ACM Trans. Graph..

[11]  D. Perrett,et al.  Imitation, mirror neurons and autism , 2001, Neuroscience & Biobehavioral Reviews.

[12]  Jitendra Malik,et al.  End-to-End Recovery of Human Shape and Pose , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Yi-Ping Hung,et al.  AR-Arm: Augmented Visualization for Guiding Arm Movement in the First-Person Perspective , 2016, AH.