FMRI Compatible Sensing Glove for Hand Gesture Monitoring

Here we describe and validate a fabric sensing glove for hand finger movement monitoring. After a quick calibration procedure, and by suitably processing of the outputs of the glove, it is possible to estimate hand joint angles in real time. Moreover, we tested the fMRI compatibility of the glove and ran a pilot fMRI experiment on the neural correlates of handshaking during human-to-human and human-to-robot interactions. Here we describe how the glove can be used to monitor correct task execution and to improve modeling of the expected hemodynamic responses during fMRI experimental paradigms.

[1]  Enzo Pasquale Scilingo,et al.  Neural correlates of human-robot handshaking , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[2]  Takeo Kanade,et al.  An MR-Compatible Optical Force Sensor for Human Function Modeling , 2004, MICCAI.

[3]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[4]  Joseph Hidler,et al.  MR compatible force sensing system for real-time monitoring of wrist moments during fMRI testing , 2006, Journal of Neuroscience Methods.

[5]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[6]  Jing Z. Liu,et al.  Simultaneous measurement of human joint force, surface electromyograms, and functional MRI-measured brain activation , 2000, Journal of Neuroscience Methods.

[7]  Andrea Gaggioli,et al.  Affective Robot for Elderly Assistance , 2009, Annual Review of Cybertherapy and Telemedicine.

[8]  Martin Buss,et al.  An HMM approach to realistic haptic human-robot interaction , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[9]  Enzo Pasquale Scilingo,et al.  Strain sensing fabric for hand posture and gesture monitoring , 2005, IEEE Transactions on Information Technology in Biomedicine.

[10]  Pierre Hellier,et al.  Level Set Methods in an EM Framework for Shape Classification and Estimation , 2004, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[11]  P. Pietrini,et al.  Sensing Glove for Brain Studies: Design and Assessment of Its Compatibility for fMRI With a Robust Test , 2008, IEEE/ASME Transactions on Mechatronics.

[12]  J. Åström,et al.  Handshaking, Personality, and Psychopathology in Psychiatric Patients, a Reliability and Correlational Study , 1993, Perceptual and motor skills.

[13]  J. Schenck.  Safety of Strong, Static Magnetic Fields , 2000, Journal of magnetic resonance imaging : JMRI.

[14]  K. Sugimura,et al.  Preoperative local staging of rectal carcinoma with MR imaging and a rectal balloon , 1993, Journal of magnetic resonance imaging : JMRI.

[15]  Yijun Liu,et al.  A full-size MRI-compatible keyboard response system , 2005, NeuroImage.

[16]  F Barkhof,et al.  fMRI of visual encoding: Reproducibility of activation , 1999, Human brain mapping.

[17]  Manuel Ferre.  Haptics: Perception, Devices and Scenarios, 6th International Conference, EuroHaptics 2008, Madrid, Spain, June 10-13, 2008, Proceedings , 2008, EuroHaptics.

[18]  P. Röschmann,et al.  Susceptibility artefacts in NMR imaging. , 1985, Magnetic resonance imaging.

[19]  田代 郁.  World Haptics 2009 , 2009 .

[20]  J Sijbers,et al.  Estimation of the noise in magnitude MR images. , 1998, Magnetic resonance imaging.

[21]  Rainer Goebel,et al.  Resistance-based high resolution recording of predefined 2-dimensional pen trajectories in an fMRI setting , 2006, Journal of Neuroscience Methods.

[22]  W. Chaplin,et al.  Handshaking, gender, personality, and first impressions. , 2000, Journal of personality and social psychology.

[23]  S. Rombouts,et al.  Test-retest analysis with functional MR of the activated area in the human visual cortex. , 1997, AJNR. American journal of neuroradiology.

[24]  Mel Slater,et al.  The Effect of Haptic Feedback on Basic Social Interaction within Shared Virtual Environments , 2008, EuroHaptics.

[25]  Rachid Alami,et al.  A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[26]  Claudia-Adina Dragos,et al.  Stable and optimal fuzzy control of a laboratory Antilock Braking System , 2010, 2010 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[27]  A. Takanishi,et al.  On the development of the bioinstrumentation system WB-1R for the evaluation of human-robot interaction - Head and hands motion capture systems - , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[28]  Minoru Hashimoto,et al.  Synchronization based control using online design of dynamics and its application to human-robot interaction , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[29]  Sang Ryong Kim,et al.  Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people's loneliness in human-robot interaction , 2006, Int. J. Hum. Comput. Stud..

[30]  R. Igliozzi,et al.  An android for enhancing social skills and emotion recognition in people with autism , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  R. Gassert,et al.  MRI/fMRI-compatible robotic system with force feedback for interaction with human motion , 2006, IEEE/ASME Transactions on Mechatronics.

[32]  Pedro Montoya,et al.  Affective modulation of somatosensory-evoked potentials elicited by tactile stimulation , 2006, Brain Research.

[33]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[34]  計測自動制御学会.  SICE annual conference , 2002 .

[35]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[36]  M. Jindai,et al.  Development of a shake-motion leading model for human-robot handshaking , 2008, 2008 SICE Annual Conference.

[37]  C. Heyes,et al.  Intact automatic imitation of human and robot actions in autism spectrum disorders , 2007, Proceedings of the Royal Society B: Biological Sciences.