Image-based non-photorealistic rendering for realtime virtual sculpting

This paper discusses a real-time virtual sculpting system in a non-photorealistic manner. Up till now, a majority of researchers pursuing virtual sculpting have highlighted the physical fidelity of simulation, with approaches for realizing photorealism being principal specialized contributions. We aim at capitalizing on the strengths of non-photorealistic rendering with respect to aesthetics, expression and computing expense. By means of touch-enabled manipulation, the haptic interaction is conducted to form the deformable surfaces, and the edge extraction is employed to stress boundaries. Afterwards, we utilize anisotropic diffusion to lessen unimportant details as well as a fresh inverse Gaussian bilateral filter for spot removal. Processed in a spatiotemporal style, the non-photorealistic rendering works to maintain coherence in time. Moreover, the parallel realization of the system put forward on graphics hardware (GPU) guarantees real-time behavior.

[1]  Pascal Barla,et al.  Structure-preserving manipulation of photographs , 2007, NPAR '07.

[2]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[3]  Phillipp Meister.  Intelligence The Eye The Brain And The Computer , 2016 .

[4]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[5]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[6]  Li Li,et al.  Photorealistic rendering for augmented reality using environment illumination , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[7]  Mark Brown,et al.  MRI: Basic Principles and Applications, 3rd edition , 2004 .

[8]  Barbara J. Meier.  Painterly rendering for animation , 1996, SIGGRAPH.

[9]  Arie E. Kaufman,et al.  Haptic sculpting of dynamic surfaces , 1999, SI3D.

[10]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[11]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[12]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Hong Qin,et al.  Virtual clay: a real-time sculpting system with haptic toolkits , 2001, I3D '01.

[14]  Xiaogang Jin,et al.  Real-time feature-aware video abstraction , 2008, The Visual Computer.

[15]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[16]  P. Sunna,et al.  SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia , 2005 .

[17]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[18]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[19]  Seungyong Lee,et al.  Flow-Based Image Abstraction , 2009, IEEE Transactions on Visualization and Computer Graphics.

[20]  L. Verlet.  Computer "Experiments" on Classical Fluids. II. Equilibrium Correlation Functions , 1968 .

[21]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[22]  M. Gary Sayed,et al.  MRI BASIC PRINCIPLES AND APPLICATIONS , 1997 .

[23]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[24]  Hong Qin,et al.  A novel haptics-based interface and sculpting system for physics-based geometric design , 2001, Comput. Aided Des..

[25]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[26]  M. Billinghurst,et al.  More sketchy, more AR, more fun! , 2005, SIGGRAPH '05.

[27]  John P. Collomosse,et al.  Stroke surfaces: temporally coherent artistic animations from video , 2005, IEEE Transactions on Visualization and Computer Graphics.

[28]  Michael Cohen,et al.  Video tooning , 2004, SIGGRAPH 2004.

[29]  Dirk Bartz,et al.  Stylized augmented reality for improved immersion , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[30]  Dirk Bartz,et al.  Reality tooning: fast non-photorealism for augmented video streams , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[31]  Masatake Higashi,et al.  Application of haptic navigation to modify free-form surfaces through specified points and curves , 2002, SMA '02.

[32]  Stuart Ferguson,et al.  A hitchhiker's guide to virtual reality , 2007 .

[33]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .