Interactive 3D animation system based on touch interface and efficient creation tools

Recently importance of tablet devices with touch interface increases significantly, because they attract not only mobile phone users, but also people of all generations including small kids to elderly people. One key technology on those devices is 3D graphics; some of them exceed the ability of desktop PCs. Although currently 3D graphics are only used for game applications, it also has a great potential for other purposes. For example, an interactive 3D animation system for tablet devices has been developed recently and attracts many people. With the system, multiple 3D animations are played depending on view direction and user's gesture input. However, the system still has two critical issues: the first one is a complicated process for data creation, and the other is a conflict on several gestures overlapped at the same position. In the paper, the first issue is solved by using a realtime range sensor and the second one is solved by considering the relationship between the 3D object and the input 2D gesture. The effectiveness of the system was proved by making the real system and creating and manipulating the actual 3D animations.

[1]  Ulrich Neumann,et al.  A Framework for Gesture Interface Design , 2007, J. Multim..

[2]  P. Cole OpenGL ES SC - open standard embedded graphics API for safety critical applications , 2005, 24th Digital Avionics Systems Conference.

[3]  Maneesh Agrawala,et al.  3D puppetry: a kinect-based interface for 3D animation , 2012, UIST.

[4]  Joaquim A. Jorge,et al.  Modeling On and Above a Stereoscopic Multitouch Display , 2012 .

[5]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[6]  Yukiko Kawai,et al.  Efficient meta-information annotation and view-dependent representation system for 3D objects on the Web , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Shinya Fukumoto,et al.  Interactive 3D Animation System for Web3D , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[9]  Thomas P. Moran,et al.  Guided gesture support in the paper PDA , 2001, UIST '01.

[10]  Wen-Hui Chen,et al.  A generic framework for the design of visual-based gesture control interface , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[11]  Martin Hachet,et al.  Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs , 2012, Comput. Graph..

[12]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[13]  Kiyoharu Aizawa,et al.  Motion Segmentation for Time-Varying Mesh Sequences Based on Spherical Registration , 2009, EURASIP J. Adv. Signal Process..

[14]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.