Deformable Model-Based Methods for Shape Control of a Haptic Jamming Surface

Haptic Jamming, the approach of simultaneously controlling mechanical properties and surface deformation of a tactile display via particle jamming and pneumatics, shows promise as a tangible, shape-changing human-computer interface. Previous research introduced device design and described the force-displacement interactions for individual jamming cells. The work in this article analyzes the shape output capabilities of a multi-cell array. A spring-mass deformable body simulation combines models of the three actuation inputs of a Haptic Jamming surface: node pinning, chamber pressurization, and cell jamming. Surface measurements of a 12-cell prototype from a depth camera fit the mass and stiffness parameters to the device during pressurization tests and validate the accuracy of the model for various actuation sequences. The simulator is used to develop an algorithm that generates a sequence of actuation inputs for a Haptic Jamming array of any size in order to match a desired surface output shape. Data extracted from topographical maps and three-dimensional solid object models are used to evaluate the shape-matching algorithm and assess the utility of increasing array size and resolution. Results show that a discrete Laplace operator applied to the input is a suitable predictor of the correlation coefficient between the desired shape and the device output.

[1]  Lucas J. van Vliet,et al.  A nonlinear laplace operator as edge detector in noisy images , 1989, Comput. Vis. Graph. Image Process..

[2]  Helmut Neuschmied,et al.  Evaluating Pointing Accuracy on Kinect V 2 Sensor , 2014 .

[3]  L. Sentis,et al.  The CHAI Libraries , 2003 .

[4]  Kaspar Althoefer,et al.  Multi-fingered haptic palpation utilizing granular jamming stiffness feedback actuators , 2014 .

[5]  Mikhail Belkin,et al.  Discrete laplace operator on meshed surfaces , 2008, SCG '08.

[6]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[7]  Yang Chen,et al.  Fitting a surface to 3-D points using an inflating balloon model , 1994, Proceedings of 1994 IEEE 2nd CAD-Based Vision Workshop.

[8]  Karol Miller,et al.  Real-Time Nonlinear Finite Element Computations on GPU - Application to Neurosurgical Simulation. , 2010, Computer methods in applied mechanics and engineering.

[9]  Wayne J. Book,et al.  Control concepts for digital clay , 2003 .

[10]  Wayne J. Book,et al.  Command Generation Techniques for a Pin Array Using the SVD and the SNMF , 2012, SyRoCo.

[11]  Hervé Delingette,et al.  Personalization of Cardiac Motion and Contractility From Images Using Variational Data Assimilation , 2012, IEEE Transactions on Biomedical Engineering.

[12]  Allison M. Okamura,et al.  Haptic jamming: A deformable geometry, variable stiffness tactile display using pneumatics and particle jamming , 2013, 2013 World Haptics Conference (WHC).

[13]  Ignacio Llamas,et al.  Finger Sculpting with Digital Clay , 2002 .

[14]  Geoff Wyvill,et al.  Data structure forsoft objects , 1986, The Visual Computer.

[15]  Andrea Mazzone,et al.  Sketching the future of the SmartMesh wide area haptic feedback device by introducing the controlling concept for such a deformable multi-loop mechanism , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[16]  John Kenneth Salisbury,et al.  Point clouds can be represented as implicit surfaces for constraint-based haptic rendering , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Stefan Klare,et al.  The Formable Object: A 24-Degree-of-Freedom Shape-Rendering Interface , 2015, IEEE/ASME Transactions on Mechatronics.

[18]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[19]  Oussama Khatib,et al.  Identifying physical properties of deformable objects by using particle filters , 2008, 2008 IEEE International Conference on Robotics and Automation.

[20]  Warren S. Grundfest,et al.  Optimization of a Pneumatic Balloon Tactile Display for Robot-Assisted Surgery Based on Human Perception , 2008, IEEE Transactions on Biomedical Engineering.

[21]  Francois Conti,et al.  The CHAI Libraries , 2003 .

[22]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[23]  Jernej Barbic,et al.  FEM simulation of 3D deformable solids: a practitioner's guide to theory, discretization and model reduction , 2012, SIGGRAPH '12.

[24]  Allison M. Okamura,et al.  Controllable Surface Haptics via Particle Jamming and Pneumatics , 2015, IEEE Transactions on Haptics.

[25]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2005, Eurographics.

[26]  Uwe D. Hanebeck,et al.  Template matching using fast normalized cross correlation , 2001, SPIE Defense + Commercial Sensing.

[27]  Daniela Giorgi,et al.  Discrete Laplace-Beltrami operators for shape analysis and segmentation , 2009, Comput. Graph..

[28]  P. M. Taylor,et al.  A sixty-four element tactile display using shape memory alloy wires , 1998 .

[29]  Mariano Alcañiz Raya,et al.  Real-time deformable models for surgery simulation: a survey , 2005, Comput. Methods Programs Biomed..

[30]  Christian Duriez,et al.  Control of elastic soft robots based on real-time finite element method , 2013, 2013 IEEE International Conference on Robotics and Automation.

[31]  Jérémie Dequidt,et al.  Introducing Interactive Inverse FEM Simulation and Its Application for Adaptive Radiotherapy , 2014, MICCAI.

[32]  Christian Duriez,et al.  GPU-based real-time soft tissue deformation with cutting and haptic feedback. , 2010, Progress in biophysics and molecular biology.

[33]  Allison M. Okamura,et al.  Perception of a Haptic Jamming display: Just noticeable differences in stiffness and geometry , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[34]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.