RealPot: an immersive virtual pottery system with handheld haptic devices

We present RealPot, an immersive virtual pottery system with haptic feedback for pottery simulation training using hand-held motion controllers. Our system consists of two major components: an automatic mesh generator and an interactive model editor. The mesh generator can procedurally generate realistic clay meshes by adding Perlin Noise. With the interactive pottery model editor, the user can shape the virtual clay intuitively with a series of bimanual interactions. Based on real-life pottery, a high realism pottery creation workflow was developed and a haptic model was proposed. Our user study investigated how haptic fidelity can impact usability in virtual pottery, and compared our system with a representative work of barehand-based virtual pottery systems. The results of our study reveal that haptic fidelity significantly affects performance and user experience. In addition, the results indicate that our system offers significantly accuracy, presence and usability compared with barehand-based virtual pottery experience.

[1]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[2]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[3]  Hiroaki Nishino,et al.  An interactive 3D interface for a virtual ceramic art work environment , 1997, Proceedings. International Conference on Virtual Systems and MultiMedia VSMM '97 (Cat. No.97TB100182).

[4]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[5]  Mehdi Bennis,et al.  Toward Interconnected Virtual Reality: Opportunities, Challenges, and Enablers , 2016, IEEE Communications Magazine.

[6]  Byeong-jun Han,et al.  Virtual pottery: a virtual 3D audiovisual interface using natural hand motions , 2013, Multimedia Tools and Applications.

[7]  Prasun Dewan,et al.  A General Multi-User Undo/Redo Model , 1995, ECSCW.

[8]  Gerard Jounghyun Kim,et al.  AR Pottery: Experiencing Pottery Making in the Augmented Space , 2007, HCI.

[9]  Md Zakirul Alam Bhuiyan,et al.  A Secure IoT Service Architecture With an Efficient Balance Dynamics Based on Cloud and Edge Computing , 2019, IEEE Internet of Things Journal.

[10]  Joseph J. LaViola,et al.  3D spatial interaction: applications for art, design, and science , 2011, SIGGRAPH '11.

[11]  Jörg Müller,et al.  Cuenesics: using mid-air gestures to select items on interactive public displays , 2014, MobileHCI '14.

[12]  Gautam Kumar,et al.  Wheel-throwing in digital space using number-theoretic approach , 2011, Int. J. Arts Technol..

[13]  Doug A. Bowman,et al.  Evaluating Display Fidelity and Interaction Fidelity in a Virtual Reality Game , 2012, IEEE Transactions on Visualization and Computer Graphics.

[14]  Emiko Charbonneau,et al.  The Wiimote and Beyond: Spatially Convenient Devices for 3D User Interfaces , 2010, IEEE Computer Graphics and Applications.

[15]  Peter Schröder,et al.  Surface drawing: creating organic 3D shapes with the hand and tangible tools , 2001, CHI.

[16]  Hong Qin,et al.  Virtual clay: a real-time sculpting system with haptic toolkits , 2001, I3D '01.

[17]  Fumihisa Shibata,et al.  A brush device with visual and haptic feedback for virtual painting of 3D virtual objects , 2018, Virtual Reality.

[18]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[19]  Karthik Ramani,et al.  Extracting hand grasp and motion for intent expression in mid-air shape deformation: A concrete and iterative exploration through a virtual pottery application , 2016, Comput. Graph..

[20]  Cecil Piya,et al.  Handy-Potter: Rapid Exploration of Rotationally Symmetric Shapes Through Natural Hand Motions , 2013, J. Comput. Inf. Sci. Eng..

[21]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[22]  Li Li,et al.  The Accuracy and Precision of Position and Orientation Tracking in the HTC Vive Virtual Reality System for Scientific Research , 2017, i-Perception.

[23]  Arjan Kuijper,et al.  Exploration of Natural Free-Hand Interaction for Shape Modeling Using Leap Motion Controller , 2016, 2016 International Conference on Cyberworlds (CW).

[24]  Jingwen Li,et al.  DigiClay: An Interactive Installation for Virtual Pottery using Motion Sensing Technology , 2018, ICVR 2018.

[25]  Marc Levoy,et al.  3D painting on scanned surfaces , 1995, I3D '95.

[26]  Ravin Balakrishnan,et al.  An interface for virtual 3D sculpting via physical proxy , 2006, GRAPHITE '06.

[27]  Pierre Alliez,et al.  Polygon Mesh Processing , 2010 .

[28]  Karthik Ramani,et al.  A gesture-free geometric approach for mid-air expression of design intent in 3D virtual pottery , 2015, Comput. Aided Des..

[29]  George Pavlidis,et al.  Qp: A tool for generating 3D models of ancient Greek pottery , 2009 .

[30]  Karthik Ramani,et al.  zPots: a virtual pottery experience with spatial interactions using the leap motion device , 2014, CHI Extended Abstracts.

[31]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .