Neural Network Mapping and Clustering of Elastic Behavior From Tactile and Range Imaging for Virtualized Reality Applications

To fully reach its potential, virtualized reality needs to go beyond the modeling of rigid bodies and introduce accurate representations of deformable objects. This paper explores neural networks and vision-based and tactile measurement strategies to investigate the intricate processes of acquisition and mapping of properties characterizing deformable objects. An original composite neural network framework is applied to guide the tactile probing by clustering measurements representing uniform elasticity regions and, therefore, direct sensors toward areas of elasticity transitions where higher sampling density is required. The network characterizes the relationship between surface deformation and forces that are exemplified in nonrigid bodies. Beyond serving as a planner for the acquisition of measurements, the proposed composite neural architecture allows the encoding of the complex force/deformation relationship without the need for sophisticated mathematical modeling tools. Experimental results prove the validity and the feasibility of the proposed approach.

[1]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[2]  Hiromi T. Tanaka,et al.  A vision-based haptic exploration , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  A.-M. Cretu,et al.  A Composite Neural Gas-Elman Network that Captures Real-World Elastic Behavior of 3D Objects , 2006, 2006 IEEE Instrumentation and Measurement Technology Conference Proceedings.

[4]  Mariano Alcañiz Raya,et al.  A new approach for the real-time simulation of tissue deformations in surgery simulation , 2001, Comput. Methods Programs Biomed..

[5]  Martin T. Hagan,et al.  Neural network design , 1995 .

[6]  Jingfeng Jiang,et al.  A finite-element approach for Young's modulus reconstruction , 2003, IEEE Transactions on Medical Imaging.

[7]  Roger W. Brockett,et al.  The performance of a deformable-membrane tactile sensor: basic results on geometrically-defined tasks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[8]  Ana-Maria Cretu,et al.  Neural-network-based adaptive sampling of three-dimensional-object surface elastic properties , 2006, IEEE Transactions on Instrumentation and Measurement.

[9]  Bradley J. Nelson,et al.  Modeling elastic objects with neural networks for vision-based force measurement , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Mingxi Wan,et al.  Elasticity measurement of soft tissue using shear acoustic wave and real-time movement estimating based on PCA neural network , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[11]  Ana-Maria Cretu,et al.  Neural-network-based models of 3-D objects for virtualized reality: a comparative study , 2006, IEEE Transactions on Instrumentation and Measurement.

[12]  Roger W. Brockett,et al.  Reconstructing the Shape of a Deformable Membrane from Image Data , 2000, Int. J. Robotics Res..

[13]  Dinesh K. Pai,et al.  Scanning physical interaction behavior of 3D objects , 2001, SIGGRAPH.

[14]  Somsak Swaddiwudhipong,et al.  Artificial neural network model for material characterization by indentation , 2004 .

[15]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[16]  Naoki Kawakami,et al.  Evaluation of a vision-based tactile sensor , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[17]  Emil M. Petriu,et al.  Neural Network Mapping and Clustering of Elastic Behavior From Tactile and Range Imaging for Virtualized Reality Applications , 2008, IEEE Transactions on Instrumentation and Measurement.

[18]  A.-M. Cretu,et al.  Adaptive acquisition of virtualized deformable objects with a neural gas network , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[19]  James Noyes,et al.  Neural Network Training , 1996 .

[20]  Masahiko Inami,et al.  A Vision-based Tactile Sensor , 2001 .

[21]  Hiromi T. Tanaka,et al.  Extracting rheological properties of deformable objects with Haptic vision , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[22]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[23]  G. K. Ananthasuresh,et al.  Vision-based sensing of forces in elastic objects , 2001 .

[24]  Gábor Székely,et al.  Realistic force feedback for virtual reality based diagnostic surgery simulators , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[25]  Christian Laugier,et al.  Towards a realistic echographic simulator with force feedback , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).