The illusion box of Syndactyly: Setup and ad hoc algorithm to induce virtual fingers webbing

Inclusion of the prosthesis in the body schema lets the device felt by the user as an extension of the self and consequently improves its performance and acceptability. Two paradigmatic models that faced the issue of the illusory embodiment, the rubber hand illusion and the mirror box, revealed that such process goes in parallel with changes in the activity of cortical sensorimotor areas devoted to the limb and that a key factor is represented by the visual inflow that overrides the mismatching kinesthesia. In spite of that, vision alone is not able to trigger prosthesis embodiment in amputees everyday-life. In order to disentangle the contributes of visual and proprioceptive feedback in the induction of sensorimotor plasticity we develop the Illusion Box of Syndactyly that, through an ad hoc algorithm, produces an index-middle finger illusory fingers webbing. The algorithm works in realtime and, trough background difference, it segments the hands, recognizes the fingers and produces the virtual syndactyly. We perform preliminary tests on a healthy subject, suggesting that the setup is robust and efficient to induce the illusion.

[1]  Jakub Segen,et al.  Gesture VR: vision-based 3D hand interace for spatial interaction , 1998, MULTIMEDIA '98.

[2]  P. Rossini,et al.  Double nerve intraneural interface implant on a human amputee for robotic hand control , 2010, Clinical Neurophysiology.

[3]  V. Ramachandran,et al.  Synaesthesia in phantom limbs induced with mirrors , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[4]  M. Merzenich,et al.  Reorganization of somatosensory area 3b representations in adult owl monkeys after digital syndactyly. , 1991, Journal of neurophysiology.

[5]  J. Rothwell,et al.  Noninvasive in vivo assessment of cholinergic cortical circuits in AD using transcranial magnetic stimulation , 2002, Neurology.

[6]  Paolo Maria Rossini,et al.  Neuroplasticity in amputees: Main implications on bidirectional interfacing of cybernetic hand prostheses , 2009, Progress in Neurobiology.

[7]  J. Kaas Plasticity of sensory and motor maps in adult mammals. , 1991, Annual review of neuroscience.

[8]  Hidenao Fukuyama,et al.  Human Motor Plasticity Induced by Mirror Visual Feedback , 2012, The Journal of Neuroscience.

[9]  Paolo Maria Rossini,et al.  Temporal dynamics of plastic changes in human primary somatosensory cortex after finger webbing. , 2007, Cerebral cortex.

[10]  P M Rossini,et al.  A neurally-interfaced hand prosthesis tuned inter-hemispheric communication. , 2012, Restorative neurology and neuroscience.

[11]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[12]  A. Karni,et al.  Daytime sleep condenses the time course of motor memory consolidation , 2007, Nature Neuroscience.