Kinesthetically Augmented Mid-Air Sketching of Multi-Planar 3D Curve-Soups

We present haptics-enabled mid-air interactions for sketching collections of three-dimensional planar curves—3D curve-soups— as a means for 3D design conceptualization. Haptics-based midair interactions have been extensively studied for modeling of surfaces and solids. The same is not true for modeling curves; there is little work that explores spatiality, tangibility, and kinesthetics for curve modeling, as seen from the perspective of 3D sketching for conceptualization. We study pen-based mid air interactions for free-form curve input from the perspective of manual labor, controllability, and kinesthetic feedback. For this, we implemented a simple haptics-enabled workflow for users to draw and compose collections of planar curves on a force-enabled virtual canvas. We introduce a novel force-feedback metaphor for curve drawing, and investigate three novel rotation techniques within our workflow for both controlled and free-form sketching tasks.

[1]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[2]  Dominique Bechmann,et al.  Influence of degrees of freedom's manipulation on performances during orientation tasks in virtual reality environments , 2009, VRST '09.

[3]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[4]  Chris Hand,et al.  A Survey of 3D Interaction Techniques , 1997, Comput. Graph. Forum.

[5]  Ben Jonson,et al.  Design ideation: the conceptual sketch in the digital age , 2005 .

[6]  Ravin Balakrishnan,et al.  EverybodyLovesSketch: 3D sketching for a broader audience , 2009, UIST '09.

[7]  Rubaiat Habib Kazi,et al.  Experimental Evaluation of Sketching on Surfaces in VR , 2017, CHI.

[8]  Andrew Roberts,et al.  3-Draw: a tool for designing 3D shapes , 1991, IEEE Computer Graphics and Applications.

[9]  Abhishek Ranjan,et al.  A suggestive interface for image guided 3D sketching , 2004, CHI.

[10]  Pieter Jan Stappers,et al.  Toward Electronic Napkins and Beermats: Computer Support for Visual Ideation Skills , 1999, Visual Representations and Interpretations.

[11]  Joseph J. LaViola,et al.  3D spatial interaction: applications for art, design, and science , 2011, SIGGRAPH '11.

[12]  Holly E. Rushmeier,et al.  The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[13]  Thomas Massie.  A Tangible Goal for 3D Modeling , 1998, IEEE Computer Graphics and Applications.

[14]  Kiyoshi Kiyokawa,et al.  Mesh-Grab and Arcball-3D: Ray-based 6-DOF Object Manipulation , 2013, APCHI.

[15]  Adrien Bousseau,et al.  True2Form: 3D curve networks from 2D sketches via selective regularization , 2014, ACM Trans. Graph..

[16]  Andrew S. Forsberg,et al.  Two pointer input for 3D interaction , 1997, SI3D.

[17]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[18]  Johann Habakuk Israel,et al.  Investigating three-dimensional sketching for early conceptual design - Results from expert discussions and user studies , 2009, Comput. Graph..

[19]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[20]  Levent Burak Kara,et al.  Sketch-based surface design using malleable curve networks , 2012, Comput. Graph..

[21]  Charlie C. L. Wang.  Drawing on Air: Input Techniques for Controlled 3D Line Illustration , 2007 .

[22]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[23]  Ian Oakley,et al.  Putting the feel in ’look and feel‘ , 2000, CHI.

[24]  Ehud Sharlin,et al.  Napkin sketch: handheld mixed reality 3D sketching , 2008, VRST '08.

[25]  William Buxton,et al.  Digital tape drawing , 1999, UIST '99.

[26]  C. Holt.  Author's retrospective on ‘Forecasting seasonals and trends by exponentially weighted moving averages’ , 2004 .

[27]  Ravin Balakrishnan,et al.  Elasticurves: exploiting stroke dynamics and inertia for the real-time neatening of sketched 2D curves , 2011, UIST '11.

[28]  Ming C. Lin,et al.  ArtNova: touch-enabled 3D model design , 2002, Proceedings IEEE Virtual Reality 2002.

[29]  Dominique Bechmann,et al.  Dynamic decomposition and integration of degrees of freedom for 3-D positioning , 2010, VRST '10.

[30]  Michael F. Deering,et al.  HoloSketch: a virtual reality sketching/animation tool , 1995, TCHI.

[31]  Thomas Baudel,et al.  A mark-based interaction paradigm for free-hand drawing , 1994, UIST '94.

[32]  Andrew S. Forsberg,et al.  UniCam—2D gestural camera controls for 3D environments , 1999, SI3D.

[33]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[34]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[35]  Wolfgang Stuerzlinger,et al.  3D Scene Manipulation with 2D Devices and Constraints , 2001, Graphics Interface.

[36]  Gudrun Albrecht,et al.  Haptic manipulation of rational parametric planar cubics using shape constraints , 2010, SAC '10.

[37]  Karthik Ramani,et al.  Tracing and sketching performance using blunt-tipped styli on direct-touch tablets , 2014, AVI.

[38]  Martin Hachet,et al.  Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[39]  Timothy S. Miller,et al.  An insidious Haptic invasion: adding force feedback to the X desktop , 1998, UIST '98.

[40]  Frank Van Reeth,et al.  Improving Sketching by Utilizing Haptic Feedback , 2002 .