[POSTER] Deformed Reality: Proof of Concept and Preliminary Results

We introduce “Deformed Reality”, a new paradigm to interactively manipulate objects in a scene in a deformable manner. Using the core principle of augmented reality to estimate rigid pose over time, our method enables the user to deform the targeted object while it is being rendered with its natural texture, giving the sense of a real-time object editing in user environment. The presented results show that our method can open new ways of using augmented reality by not only augmenting the scene but also interacting with it in a non-rigid manner.

[1]  Leonard McMillan,et al.  Stable real-time deformations , 2002, SCA '02.

[2]  Éric Marchand,et al.  Augmenting markerless complex 3D objects by combining geometrical and color edge information , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[3]  Tobias Höllerer,et al.  Real-time hand interaction for augmented reality on mobile phones , 2013, IUI '13.

[4]  Yaser Sheikh,et al.  3D object manipulation in a single photograph using stock 3D models , 2014, ACM Trans. Graph..

[5]  Éric Marchand,et al.  Combining complementary edge, keypoint and color features in model-based tracking for highly dynamic scenes , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).