Elastylus: flexible haptic painting stylus

Recently, the use of digital styluses is challenged by air painting applications such as Painter Freestyle [Sutton 2013], Ethereal for Photoshop (http://drivenpixels.com/ethereal), and Fantasia Painter (https://apps.leapmotion.com/apps/fantasia-painter/windows). By utilizing the hand tracking capability of Leap Motion controller, these applications show that painting in the air using hands movement is much more flexible in artistic improvisation due to high degrees of freedom (DoFs) to control virtual brushes. Nevertheless, air painting is still premature to eliminate styluses because it lacks of some important features of modern digitizers, including 1) the tight overlap of operating and displaying planes to achieve WYSIWYG, 2) the natural analogy of physical painting brush to lower the learning curve, and 3) the possibility of complex haptic feedbacks from the canvas for intuitive fine control of brush strokes. Moreover, without holding a stylus and touching the canvas, its difficult to control brush movement accurately and steadily, which may lead to unexpected stroke jittering.

[1]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[2]  Hiroyuki Shinoda,et al.  HaptoMime: mid-air haptic interaction with a floating virtual screen , 2014, UIST.

[3]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[4]  Hiroshi Ishii,et al.  Beyond: collapsible tools and gestures for computational design , 2010, CHI EA '10.

[5]  Osamu Oshiro,et al.  Haptylus: haptic stylus for interaction with virtual objects behind a touch screen , 2014, SIGGRAPH ASIA Emerging Technologies.

[6]  Michael Rohs,et al.  Let me grab this: a comparison of EMS and vibration for haptic feedback in free-hand interaction , 2014, AH.

[7]  Masahiko Inami,et al.  ImpAct: Immersive haptic stylus to enable direct touch and manipulation for surface computing , 2010, CIE.

[8]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[9]  Yuriko Suzuki,et al.  Air jet driven force feedback in virtual reality , 2005, IEEE Computer Graphics and Applications.

[10]  Luv Kohli Warping virtual space for low-cost haptic feedback , 2013, I3D '13.

[11]  Mary C. Whitton,et al.  Redirected touching: The effect of warping space on task performance , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[12]  Sho Kamuro,et al.  Pen de touch , 2009, SIGGRAPH '09.

[13]  Jeremy Sutton Air painting with Corel Painter Freestyle and the leap motion controller: a revolutionary new way to paint! , 2013, SIGGRAPH '13.