Mapping stiffness perception in the brain with an fMRI-compatible particle-jamming haptic interface

We demonstrate reliable neural responses to changes in haptic stiffness perception using a functional magnetic resonance imaging (fMRI) compatible particle-jamming haptic interface. Our haptic interface consists of a silicone tactile surface whose stiffness we can control by modulating air-pressure in a sub-surface pouch of coarsely ground particles. The particles jam together as the pressure decreases, which stiffens the surface. During fMRI acquisition, subjects performed a constant probing task, which involved continuous contact between the index fingertip and the interface and rhythmic increases and decreases in fingertip force (1.6 Hz) to probe stiffness. Without notifying subjects, we randomly switched the interface's stiffness (switch time, 300-500 ms) from soft (200 N/m) to hard (1400 N/m). Our experiment design's constant motor activity and cutaneous tactile sensation helped disassociate neural activation for both from stiffness perception, which helped localized it to a narrow region in somatosensory cortex near the supra-marginal gyrus. Testing different models of neural activation, we found that assuming indepedent stiffness-change responses at both soft-hard and hard-soft transitions provides the best explanation for observed fMRI measurements (three subjects; nine four-minute scan runs each). Furthermore, we found that neural activation related to stiffness-change and absolute stiffness can be localized to adjacent but disparate anatomical locations. We also show that classical finger-tapping experiments activate a swath of cortex and are not suitable for localizing stiffness perception. Our results demonstrate that decorrelating motor and sensory neural activation is essential for characterizing somatosensory cortex, and establish particle-jamming haptics as an attractive low-cost method for fMRI experiments.

[1]  Allison M. Okamura,et al.  Haptic jamming: A deformable geometry, variable stiffness tactile display using pneumatics and particle jamming , 2013, 2013 World Haptics Conference (WHC).

[2]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[3]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[4]  Etienne Burdet,et al.  A 2-DOF fMRI compatible haptic interface to investigate the neural control of arm movements , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[5]  Yasmin L. Hashambhoy,et al.  Neural Correlates of Reach Errors , 2005, The Journal of Neuroscience.

[6]  R. Gassert,et al.  A Versatile MRI/fMRI Compatible Spherical 2-DOF Haptic Interface , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[7]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[8]  Oussama Khatib,et al.  Haptic fMRI: Combining functional neuroimaging with haptics for studying the brain's motor control representation , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Y. Lamarre,et al.  Unmyelinated tactile afferents signal touch and project to insular cortex , 2002, Nature Neuroscience.

[10]  Roberta L. Klatzky,et al.  What vs. where in touch: an fMRI study , 2005, NeuroImage.

[11]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[12]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[13]  B. Krauss,et al.  A Comparative fMRI Study of Cortical Representations for Thermal Painful, Vibrotactile, and Motor Performance Tasks , 1999, NeuroImage.

[14]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[15]  Marko Munih,et al.  fMRI compatible haptic interface system , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[16]  Jonathan Winawer,et al.  GLMdenoise: a fast, automated technique for denoising task-based fMRI data , 2013, Front. Neurosci..

[17]  Antonio Frisoli,et al.  Design of a new fMRI compatible haptic interface , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[18]  Kiyoyuki Chinzei,et al.  MRI-Compatible Robotics , 2008, IEEE Engineering in Medicine and Biology Magazine.

[19]  Allison M. Okamura,et al.  Perception of a Haptic Jamming display: Just noticeable differences in stiffness and geometry , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[20]  R. Riener,et al.  Comparison of MRI-Compatible Mechatronic Systems With Hydrodynamic and Pneumatic Actuation , 2008, IEEE/ASME Transactions on Mechatronics.