Novel interfaces for modeling and painting

The last decade witnessed the rapid development of interaction techniques. There has been a growing number of interactive devices, such as multi-touch displays, motion sensing input devices and voice input devices. Among them, touch based hardware are becoming more and more powerful in terms of screen size, resolution, accuracy, as well as the number of touch points, while the prices are dropping quickly. More and more electronic devices have emerged with touch screens, including smart phones, tablet PCs, GPS devices, ATM machines, various information and ticketing systems, etc. Compared to traditional WIMP interfaces that require the user to input information indirectly with IO devices, such as mice, touch-based interfaces, including multi-touch and sketch-based interfaces, allow the user to interact with the content directly using fingers and pens; a technique which has proved to be extremely intuitive and easy to learn. Additionally, multi-touch based interfaces can be more efficient than mouse-based interfaces and have great potential to facilitate collaboration among multiple people. Also, sketch-based interfaces can be very intuitive due to the simple sketch-based input and physical direct manipulation with the input screen. Because of the application-driven nature of computer graphics and the difficulty of visualizing and manipulating various aspects of computer graphics, including geometry creation, editing and so on, the interface and interaction method of applications play an important role in computer graphics applications. However, there are relatively few successful applications have been presented which have exploited novel interfaces in computer graphics applications due to the complexity of such applications. In this thesis, we demonstrate three graphics applications that use novel interfaces to improve the user interaction in terms of efficiency and intuitiveness. By conducting user studies for the specified applications and tasks, we also explore some touch interaction principles that

[1]  S. Feiner,et al.  Rubbing the Fisheye: Precise Touch-Screen Interaction with Gestures and Fisheye Views , 2003 .

[2]  Jun Rekimoto,et al.  HoloWall: designing a finger, hand, body, and object sensitive wall , 1997, UIST '97.

[3]  Ryan Schmidt,et al.  Stroke Parameterization , 2013, Comput. Graph. Forum.

[4]  C. Grimm,et al.  Interactive decal compositing with discrete exponential maps , 2006, SIGGRAPH 2006.

[5]  Shi-Qing Xin,et al.  Efficiently computing geodesic offsets on triangle meshes by the extended Xin-Wang algorithm , 2011, Comput. Aided Des..

[6]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[7]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[8]  Tovi Grossman,et al.  The design and evaluation of multitouch marking menus , 2010, CHI.

[9]  HanrahanPat,et al.  Direct WYSIWYG painting and texturing on 3D shapes , 1990 .

[10]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[11]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[12]  Ying He,et al.  Parallel and accurate Poisson disk sampling on arbitrary surfaces , 2011, SA '11.

[13]  Patrick Baudisch,et al.  Snap-and-go: helping users align objects without the modality of traditional snapping , 2005, CHI.

[14]  Ayellet Tal,et al.  FlexiStickers: photogrammetric texture mapping using casual images , 2009, SIGGRAPH 2009.

[15]  A. Miyake,et al.  The Cambridge Handbook of Visuospatial Thinking , 2005 .

[16]  Bernd Fröhlich,et al.  Two-handed direct manipulation on the responsive workbench , 1997, SI3D.

[17]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[18]  Shi-Qing Xin,et al.  Interactive Applications for Sketch-Based Editable Polycube Map , 2013, IEEE Transactions on Visualization and Computer Graphics.

[19]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[20]  Daniel J. Wigdor,et al.  Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces , 2011, CHI.

[21]  Xue-Cheng Tai,et al.  A Level Set Formulation of Geodesic Curvature Flow on Simplicial Surfaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[22]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[23]  Ravin Balakrishnan,et al.  EverybodyLovesSketch: 3D sketching for a broader audience , 2009, UIST '09.

[24]  Renaud Blanch,et al.  Semantic pointing: improving target acquisition with control-display ratio adaptation , 2004, CHI.

[25]  Qian Sun,et al.  Texture brush: an interactive surface texturing interface , 2013, I3D '13.

[26]  Pedro V. Sander,et al.  Multi-Chart Geometry Images , 2003, Symposium on Geometry Processing.

[27]  Ricardo Langner,et al.  Grids & guides: multi-touch layout and alignment tools , 2011, CHI.

[28]  Yotam I. Gingold,et al.  A direct texture placement and editing interface , 2006, UIST.

[29]  Leonidas J. Guibas,et al.  Non-Rigid Registration Under Isometric Deformations , 2008 .

[30]  Daniel Vogel,et al.  Hand occlusion on a multi-touch tabletop , 2012, CHI.

[31]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[32]  John F. Hughes,et al.  Multi-finger cursor techniques , 2006, Graphics Interface.

[33]  Wang Hui-nan.  Multi-Finger Gestural Interaction with 3D Volumetric Displays , 2008 .

[34]  Yiying Tong,et al.  Geodesics-based one-to-one parameterization of 3D triangle meshes , 2005, IEEE MultiMedia.

[35]  Lijun Tang,et al.  Creating touch-screens anywhere with interactive projected displays , 2003, MULTIMEDIA '03.

[36]  Olga Sorkine-Hornung,et al.  Bounded biharmonic weights for real-time deformation , 2011, Commun. ACM.

[37]  Chi-Wing Fu,et al.  A multi-touch interface for fast architectural sketching and massing , 2013, CHI.

[38]  Xiaojun Bi,et al.  Magic desk: bringing multi-touch surfaces into desktop work , 2011, CHI.

[39]  Chi-Wing Fu,et al.  Efficiently Computing Exact Geodesic Loops within Finite Steps , 2012, IEEE Transactions on Visualization and Computer Graphics.

[40]  Jonathan Gibbs,et al.  Painting and rendering textures on unparameterized models , 2002, ACM Trans. Graph..

[41]  Radomír Mech,et al.  Self-organizing tree models for image synthesis , 2009, ACM Trans. Graph..

[42]  Sylvain Lefebvre,et al.  Texture sprites: texture elements splatted on surfaces , 2005, I3D '05.

[43]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[44]  A. Polyanin,et al.  Handbook of Exact Solutions for Ordinary Differential Equations , 1995 .

[45]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[46]  Stefan Jeschke,et al.  Rendering surface details with diffusion curves , 2009, SIGGRAPH 2009.

[47]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[48]  Ronald E. Anderson.  Social Impacts of Computing: Codes of Professional Ethics , 1992 .

[49]  Yijie Han,et al.  Shortest paths on a polyhedron , 1990, SCG '90.

[50]  Jefferson Y. Han.  Multi-touch interaction wall , 2006, SIGGRAPH '06.

[51]  Steven K. Feiner,et al.  Cross-dimensional gestural interaction techniques for hybrid immersive environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[52]  Shi-Qing Xin,et al.  Editable polycube map for GPU-based subdivision surfaces , 2011, SI3D.

[53]  Pascal Barla,et al.  Diffusion curves: a vector representation for smooth-shaded images , 2008, ACM Trans. Graph..

[54]  Chi-Wing Fu,et al.  LayerPaint: a multi-layer interactive 3D painting interface , 2010, CHI.

[55]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[56]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[57]  Francis K. H. Quek,et al.  iPhone/iPod Touch as Input Devices for Navigation in Immersive Virtual Environments , 2009, 2009 IEEE Virtual Reality Conference.

[58]  Robert St. Amant,et al.  HabilisDraw DT: a bimanual tool-based direct manipulation drawing environment , 2004, CHI EA '04.

[59]  Björn Hartmann,et al.  Two-handed marking menus for multitouch devices , 2011, TCHI.

[60]  Marc Levoy,et al.  3D painting on scanned surfaces , 1995, I3D '95.

[61]  Abhishek Ranjan,et al.  Interacting with large displays from a distance with vision-tracked multi-finger gestural input , 2005, SIGGRAPH '06.

[62]  Laurent D. Cohen,et al.  Geodesic Remeshing Using Front Propagation , 2003, International Journal of Computer Vision.

[63]  Tamy Boubekeur,et al.  GeoBrush: Interactive Mesh Geometry Cloning , 2011, Comput. Graph. Forum.

[64]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[65]  Kup-Sze Choi,et al.  Fast Rendering of Diffusion Curves with Triangles , 2012, IEEE Computer Graphics and Applications.

[66]  Mark Billinghurst,et al.  MozArt: a multimodal interface for conceptual 3D modeling , 2011, ICMI '11.

[67]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[68]  Abigail Sellen,et al.  Two-handed input in a compound task , 1994, CHI 1994.

[69]  Ivan Poupyrev,et al.  Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects , 2012, CHI.

[70]  Michael Garland,et al.  Similarity-Based Surface Modelling Using Geodesic Fans , 2004, Symposium on Geometry Processing.

[71]  Joseph S. B. Mitchell,et al.  The Discrete Geodesic Problem , 1987, SIAM J. Comput..

[72]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[73]  Tony DeRose,et al.  Eden: a professional multitouch tool for constructing virtual organic environments , 2011, CHI.

[74]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[75]  Abigail Sellen,et al.  At home with surface computing? , 2012, CHI.

[76]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[77]  Clifton Forlines,et al.  DTLens: multi-user tabletop spatial data exploration , 2005, UIST.

[78]  Shumin Zhai,et al.  High precision touch screen interaction , 2003, CHI '03.

[79]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.

[80]  Ömer Akin,et al.  Strategic use of representation in architectural massing , 2004 .

[81]  Tovi Grossman,et al.  The design and evaluation of multi-finger mouse emulation techniques , 2009, CHI.

[82]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[83]  William Buxton,et al.  Issues and techniques in touch-sensitive tablet input , 1985, SIGGRAPH '85.

[84]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.

[85]  Stephen Lin,et al.  Diffusion curve textures for resolution independent texture mapping , 2012, ACM Trans. Graph..

[86]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[87]  Yang Li,et al.  Gesture coder: a tool for programming multi-touch gestures by demonstration , 2012, CHI.

[88]  John Karat,et al.  A Comparison of Menu Selection Techniques: Touch Panel, Mouse and Keyboard , 1986, Int. J. Man Mach. Stud..

[89]  Shi-Qing Xin,et al.  Constant-time O(1) all pairs geodesic distance query on triangle meshes , 2011, SA '11.

[90]  Xing-Dong Yang,et al.  See me, see you: a lightweight method for discriminating user touches on tabletop displays , 2012, CHI.

[91]  Takeo Igarashi,et al.  Vignette: interactive texture design and manipulation with freeform gestures for pen-and-ink illustration , 2012, CHI.

[92]  Wendy E. Mackay,et al.  BiTouch and BiPad: designing bimanual interaction for hand-held tablets , 2012, CHI.

[93]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[94]  Daniel J. Wigdor,et al.  Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations , 2011, CHI.

[95]  Kenneth C. Smith,et al.  A multi-touch three dimensional touch-sensitive tablet , 1985, CHI '85.

[96]  J. Koenderink,et al.  The internal representation of solid shape with respect to vision , 1979, Biological Cybernetics.

[97]  J A Sethian,et al.  Computing geodesic paths on manifolds. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[98]  Daniel J. Wigdor,et al.  Designing user interfaces for multi-touch and gesture devices , 2009, CHI Extended Abstracts.

[99]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[100]  Francine Chen,et al.  Multi-touch document folding: gesture models, fold directions and symmetries , 2011, CHI.

[101]  Kok-Lim Low,et al.  SandCanvas: a multi-touch art medium inspired by sand animation , 2011, CHI.

[102]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[103]  Alla Sheffer,et al.  Matchmaker: constructing constrained texture maps , 2003, ACM Trans. Graph..

[104]  Andrew Nealen,et al.  Volumetric modeling with diffusion surfaces , 2010, SIGGRAPH 2010.

[105]  Peter Wonka,et al.  A GPU Laplacian solver for diffusion curves and Poisson image editing , 2009, ACM Transactions on Graphics.

[106]  Tony DeRose,et al.  Multiresolution analysis of arbitrary meshes , 1995, SIGGRAPH.

[107]  Shi-Qing Xin,et al.  Improving Chen and Han's algorithm on the discrete geodesic problem , 2009, TOGS.

[108]  Beryl Plimmer,et al.  Origami simulator: a multi-touch experience , 2009, CHI Extended Abstracts.

[109]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[110]  Pierre Dillenbourg,et al.  Multi-finger interactions with papers on augmented tabletops , 2009, TEI.

[111]  Ravin Balakrishnan,et al.  The role of kinesthetic reference frames in two-handed input performance , 1999, UIST '99.

[112]  Andruid Kerne,et al.  ZeroTouch: an optical multi-touch and free-air interaction architecture , 2012, CHI.

[113]  Hans Køhling Pedersen.  A framework for interactive texturing on curved surfaces , 1996, SIGGRAPH.

[114]  Rui Wang,et al.  A Ray Tracing Approach to Diffusion Curves , 2011, EGSR '11.

[115]  Ben Shneiderman,et al.  Selection devices for user of an electronic encyclopedia: An empirical comparison of four possibilities , 1988, Inf. Process. Manag..