inTouch: interactive multiresolution modeling and 3D painting with a haptic interface

We present an intuitive 3D interface for interactively editing and painting a polygonal mesh using a force feedback device. An artist or a designer can use the system to create and refine a three-dimensional multiresolution polygonal mesh. Its appearance can be further enhanced by directly painting onto its surface. The system allows users to naturally create complex forms and patterns not only aided by visual feedback, but also by their sense of touch.

[1]  Thomas Massie.  A Tangible Goal for 3D Modeling , 1998, IEEE Computer Graphics and Applications.

[2]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[3]  Warren Robinett,et al.  Implementation of flying, scaling and grabbing in virtual worlds , 1992, I3D '92.

[4]  Tony DeRose,et al.  Subdivision surfaces in character animation , 1998, SIGGRAPH.

[5]  Marc Levoy,et al.  Fitting smooth surfaces to dense polygon meshes , 1996, SIGGRAPH.

[6]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[7]  Andrei Khodakovsky,et al.  Fine level feature editing for subdivision surfaces , 1999, SMA '99.

[8]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[9]  Elaine Cohen,et al.  Painting textures with a haptic interface , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[10]  Kenneth I. Joy,et al.  Free-form deformations with lattices of arbitrary topology , 1996, SIGGRAPH.

[11]  Peter Schröder,et al.  Interactive multiresolution mesh editing , 1997, SIGGRAPH.

[12]  Vernon L. Chi,et al.  Surface modification tools in a virtual environment interface to a scanning probe microscope , 1995, I3D '95.

[13]  Sarah Gibson,et al.  Beyond Volume Rendering: Visualization, Haptic Exploration, and Physical Modeling of Voxel-based Objects , 1995 .

[14]  Ming C. Lin,et al.  A framework for fast and accurate collision detection for haptic interaction , 1998, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[15]  John M. Hollerbach,et al.  Haptic manipulation of virtual mechanisms from mechanical CAD designs , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[16]  Malcolm A. Sabin,et al.  Non-uniform recursive subdivision surfaces , 1998, SIGGRAPH.

[17]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[18]  Randy F. Pausch,et al.  Navigation and locomotion in virtual worlds via flight into hand-held miniatures , 1995, SIGGRAPH.

[19]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[20]  Marc Levoy,et al.  3D painting on scanned surfaces , 1995, I3D '95.

[21]  Sabine Coquillart,et al.  Extended free-form deformation: a sculpturing tool for 3D geometric modeling , 1990, SIGGRAPH.

[22]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[23]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[24]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[25]  Anne Verroust-Blondet,et al.  Interactive texture mapping , 1993, SIGGRAPH.

[26]  Elaine Cohen,et al.  A framework for efficient minimum distance computations , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[27]  F. Brooks,et al.  Force display in molecular docking , 1990 .

[28]  Bernd Fröhlich,et al.  The two-user Responsive Workbench: support for collaboration through individual views of a shared space , 1997, SIGGRAPH.

[29]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[30]  J. Edward Colgate,et al.  Issues in the haptic display of tool use , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[31]  Hong Qin,et al.  D-NURBS: A Physics-Based Framework for Geometric Design , 1996, IEEE Trans. Vis. Comput. Graph..

[32]  Gershon Elber,et al.  Three-dimensional freeform sculpting via zero sets of scalar trivariate functions , 2000, Comput. Aided Des..

[33]  Jean Schweitzer,et al.  Analysis and application of subdivision surfaces , 1996 .

[34]  Mary C. Whitton,et al.  Designing and Building the PIT: a Head-Tracked Stereo Workspace for Two Users , 1998 .

[35]  HanrahanPat,et al.  Direct WYSIWYG painting and texturing on 3D shapes , 1990 .

[36]  Bernd Fröhlich,et al.  Two-handed direct manipulation on the responsive workbench , 1997, SI3D.

[37]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[38]  David R. Forsey,et al.  Hierarchical B-spline refinement , 1988, SIGGRAPH.

[39]  V. Leitáo,et al.  Computer Graphics: Principles and Practice , 1995 .

[40]  Gerald Farin,et al.  Curves and surfaces for computer aided geometric design , 1990 .

[41]  Alyn P. Rockwood,et al.  A generalized de Casteljau approach to 3D free-form deformation , 1994, SIGGRAPH.

[42]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[43]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.

[44]  Tony DeRose,et al.  Multiresolution analysis of arbitrary meshes , 1995, SIGGRAPH.

[45]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[46]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.