Learning to create 3D models via an augmented reality smartphone interface

The ordinary way of creating 3D models (a.k.a. 3D modeling) requires people to sit in front of the computer for a long time working with professional software. The license fees of these software are expensive, and it is very time consuming and not easy to learn. Teachers sometimes find difficult to teach students the concept of 3D modeling because the newbies need to spend a lot of time to familiarize with the tool interface beforehand. In this paper, we introduce a mobile application that assists students to learn 3D modeling skills and concepts. We provide a natural modeling style with the aid of Augmented Reality (AR). Through a smartphone user interface, the user builds a model with primitive blocks in a "bottom-up" manner like "LEGO" bricks. These blocks are visualized on the printed marker cards that allow users to manipulate (rotate, translate, etc.) them in the same way of manipulating real building blocks. User studies have been conducted and we have identified some aspects that help people to model 3D objects.

[1]  Frédéric Vignat,et al.  Adding Physical Properties to 3D Models in Augmented Reality for Realistic Interactions Experiments , 2013, VARE.

[2]  Markus Santoso,et al.  ARkanoid: Development of 3D Game and Handheld Augmented Reality , 2012 .

[3]  Jason W. P. Ng,et al.  iARBook: An Immersive Augmented Reality system for education , 2014, 2014 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE).

[4]  Jeff K. T. Tang,et al.  AR interior designer: Automatic furniture arrangement using spatial and functional relationships , 2014, 2014 International Conference on Virtual Systems & Multimedia (VSMM).

[5]  Kari Pulli,et al.  Mobile 3D Graphics With OpenGL ES and M3G , 2007 .

[6]  Ferruccio Mandorli,et al.  A Framework to Support 3D Explicit Modeling Education and Practice , 2014 .

[7]  Alexandro Simonetti Ibañez,et al.  Vuforia v1.5 SDK: Analysis and evaluation of capabilities , 2013 .

[8]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[9]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[10]  Andruid Kerne,et al.  ZeroTouch: an optical multi-touch and free-air interaction architecture , 2012, CHI.

[11]  Jordan Tewell,et al.  Emerging Human-Toy Interaction Techniques with Augmented and Mixed Reality , 2015 .

[12]  Nancy Diniz,et al.  An approach to 3D digital design free hand form generation , 2004 .

[13]  Takeo Igarashi,et al.  Situated modeling: a shape-stamping interface with tangible primitives , 2012, Tangible and Embedded Interaction.

[14]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[15]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[16]  Takeo Igarashi,et al.  Adaptive unwrapping for interactive texture painting , 2001, I3D '01.

[17]  Prasad Renukdas,et al.  Markerless Augmented Reality Android App For Interior Decoration , 2013 .

[18]  Ryan Henson Creighton Unity 3D game development by example : beginner's guide: lite : get up and running as a Unity game developer , 2010 .