Perceptually Augmented Simulator Design

Training simulators have proven their worth in a variety of fields, from piloting to air-traffic control to nuclear power station monitoring. Designing surgical simulators, however, poses the challenge of creating trainers that effectively instill not only high-level understanding of the steps to be taken in a given situation, but also the low-level “muscle-memory” needed to perform delicate surgical procedures. It is often impossible to build an ideal simulator that perfectly mimics the haptic experience of a surgical procedure, but by focussing on the aspects of the experience that are perceptually salient we can build simulators that effectively instill learning. We propose a general method for the design of surgical simulators that augment the perceptually salient aspects of an interaction. Using this method, we can increase skill-transfer rates without requiring expensive improvements in the capability of the rendering hardware or the computational complexity of the simulation. In this paper, we present our decomposition-based method for surgical simulator design, and describe a user-study comparing the training effectiveness of a haptic-search-task simulator designed using our method versus an unaugmented simulator. The results show that perception-based task decomposition can be used to improve the design of surgical simulators that effectively impart skill by targeting perceptually significant aspects of the interaction.

[1]  Susan J. Lederman,et al.  Intelligent exploration by the human hand , 1990 .

[2]  S. E. Salcudean,et al.  On the Emulation of Stiff Walls and Static Friction with a Magnetically Levitated Input/Output Devic , 1997 .

[3]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[4]  Gavan Lintern,et al.  Part-Task Training for Tracking and Manual Control , 1985 .

[5]  K. E. Overvliet,et al.  Haptic search with finger movements: using more fingers does not necessarily reduce search times , 2007, Experimental Brain Research.

[6]  Dorothy M. Fragaszy,et al.  Hand preferences for a haptic searching task by tufted capuchins (Cebus apella) , 1996, International Journal of Primatology.

[7]  Susan J. Lederman,et al.  Perceiving Texture through a Probe , 2002 .

[8]  Roberta L Klatzky,et al.  Haptic processing of the location of a known property: does knowing what you've touched tell you where it is? , 2004, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[9]  Dinesh K. Pai,et al.  Perceptually augmented simulator design through decomposition , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[10]  Dinesh K. Pai,et al.  Perceptual Rendering for Learning Haptic Skills , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[11]  E. Gobbetti,et al.  Catheter insertion simulation with co-registered direct volume rendering and haptic feedback. , 2000, Studies in health technology and informatics.

[12]  Vincent Hayward,et al.  On the Synthesis of Haptic Textures , 2008, IEEE Transactions on Robotics.

[13]  Elizabeth A. Croft,et al.  Haptic rendering of rigid contacts using impulsive and penalty forces , 2005, IEEE Transactions on Robotics.

[14]  Michael D. Williams,et al.  Toward event-based haptics: rendering contact using open-loop force pulses , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[15]  Katherine J. Kuchenbecker,et al.  Event-based haptics and acceleration matching: portraying and assessing the realism of contact , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[16]  Charles A. Baker,et al.  Target Recognition on Complex Displays1 , 1960 .

[17]  Roberta L. Klatzky,et al.  Comparison of 3-D haptic peg-in-hole tasks in real and virtual environments , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[18]  R. Klatzky,et al.  Relative availability of surface and object properties during early haptic processing. , 1997, Journal of experimental psychology. Human perception and performance.