SnapBlocks: a snapping interface for assembling toy blocks with XBOX Kinect

Toy blocks can help the children develop various skills, such as spatial, mathematical, creative problem solving etc. In this paper, we developed a computer aided system for child to play blocks with a computer in a natural and intuitive way using the Kinect. We design a set of intuitive body gestures that allow the user to naturally control and navigate 3D toy blocks in a virtual environment. To conquer the imprecise interaction with Kinect, we propose a snapping interface, which automatically computes the optimal location and orientation of the to-be-assembled block. This interface can significantly reduce the user’s burden for fine tuning the blocks at the desired locations, which is often tedious and time consuming. As a result, the user can fully immerse him/herself in the game and construct a complicated structure easily. The experimental results and positive feedback from users demonstrate the efficacy of our approach to virtual assembly of building blocks.

[1]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[2]  Kun Zhou,et al.  An interactive approach to semantic modeling of indoor scenes with an RGBD camera , 2012, ACM Trans. Graph..

[3]  Niloy J. Mitra,et al.  Shadow art , 2009, SIGGRAPH 2009.

[4]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[5]  Ke Xie,et al.  A search-classify approach for cluttered indoor scene understanding , 2012, ACM Trans. Graph..

[6]  Sara McMains,et al.  Evaluation of drawing on 3D surfaces with haptics , 2004, IEEE Computer Graphics and Applications.

[7]  Takeo Igarashi,et al.  Plushie: an interactive design system for plush toys , 2007, ACM Trans. Graph..

[8]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[9]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.

[10]  Deep Window – 3D virtual camera control with a tablet and depth camera , 2010 .

[11]  Leonidas J. Guibas,et al.  Acquiring 3D indoor environments with variability and repetition , 2012, ACM Trans. Graph..

[12]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[13]  Jeff Rose,et al.  Rotating virtual objects with real handles , 1999, TCHI.

[14]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, SIGGRAPH 2010.

[15]  Andrew D. Wilson.  Using a depth camera as a touch sensor , 2010, ITS '10.

[16]  Tony DeRose,et al.  Eden: a professional multitouch tool for constructing virtual organic environments , 2011, CHI.

[17]  T. P. Wright,et al.  Factors affecting the cost of airplanes , 1936 .

[18]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[19]  J. Mitani,et al.  Making papercraft toys from meshes using strip-based approximate unfolding , 2004, SIGGRAPH 2004.

[20]  Chi-Keung Tang,et al.  Make it home: automatic optimization of furniture arrangement , 2011, ACM Trans. Graph..

[21]  Wilmot Li,et al.  Illustrating how mechanical assemblies work , 2010, CACM.

[22]  Mark Pauly,et al.  Realtime performance-based facial animation , 2011, ACM Trans. Graph..

[23]  Chi-Wing Fu,et al.  Making burr puzzles from 3D models , 2011, ACM Trans. Graph..

[24]  Shi-Min Hu,et al.  Popup: automatic paper architectures from 3D models , 2010, ACM Trans. Graph..

[25]  Y. Rogers,et al.  Interaction Design , 2002 .

[26]  Shi-Min Hu,et al.  Structure recovery by part assembly , 2012, ACM Trans. Graph..