Supporting Trembling Hand Typing Using Optical See-Through Mixed Reality

A tremor is an involuntary rhythmic shaking movement of the muscles, which reduces the precision of hand and finger movements. It is difficult for individuals with hand tremors to type accurately using small- and high-density targets, such as keyboard. This research proposes an optical see-through mixed reality system that reduces hand tremors so that the individual can type steadily. The system virtually stabilizes the individual’s hand tremors by optically overlapping the trembling hand with a stabilized virtual hand to produce a realistic typing sensation without any tremors. The simulation experiments proved that the system supports trembling hand typing. By comprehensively investigating both the objective (time and error ratios) and the subjective (the sense of ownership, agency, and pertinence) aspects, the system with a virtual:real intensity ratio of 0.75:0.25 was found to be optimal.

[1]  R. Bhidayasiri Differential diagnosis of common tremor syndromes , 2005, Postgraduate Medical Journal.

[2]  Marjolein P. M. Kammers,et al.  What is embodiment? A psychometric approach , 2008, Cognition.

[3]  Ferran Argelaguet,et al.  The role of interaction in virtual embodiment: Effects of the virtual hand representation , 2016, 2016 IEEE Virtual Reality (VR).

[4]  Sophie Jörg,et al.  Need a hand?: how appearance affects the virtual hand illusion , 2016, SAP.

[5]  Christopher M. Schlick,et al.  Design pattern TRABING: touchscreen-based input technique for people affected by intention tremor , 2010, EICS '10.

[6]  David R Williams,et al.  My hands shake--classification and treatment of tremor. , 2009, Australian family physician.

[7]  Enrico Rukzio,et al.  Towards improving touchscreen input speed and accuracy on smartphones for tremor affected persons , 2016, UbiComp Adjunct.

[8]  Ye Yuan,et al.  Is the rubber hand illusion induced by immersive virtual reality? , 2010, 2010 IEEE Virtual Reality Conference (VR).

[9]  Shari Trewin,et al.  Physical accessibility of touchscreen smartphones , 2013, ASSETS.

[10]  Dietrich Haubenberger,et al.  Genome-wide association study in essential tremor identifies three new loci , 2016, Brain : a journal of neurology.

[11]  Jeffrey P. Bigham,et al.  Enhancing Android accessibility for users with hand tremor by reducing fine pointing and steady tapping , 2015, W4A.

[12]  Maria V. Sanchez-Vives,et al.  Virtual Hand Illusion Induced by Visuomotor Correlations , 2010, PloS one.

[13]  Adriana de Souza e Silva,et al.  Digital cityscapes : merging digital and urban playspaces , 2009 .

[14]  Yvonne de Kort,et al.  Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality , 2006, PRESENCE: Teleoperators and Virtual Environments.

[15]  Jeremy D. Thorne,et al.  Interplay of Agency and Ownership: The Intentional Binding and Rubber Hand Illusion Paradigm Combined , 2014, PloS one.

[16]  Kosuke Sato,et al.  A Typing Assist System Considering Involuntary Hand Tremor , 2016 .

[17]  W. Poewe,et al.  Prevalence of movement disorders in men and women aged 50–89 years (Bruneck Study cohort): a population-based study , 2005, The Lancet Neurology.

[18]  Paul Crawford,et al.  Differentiation and diagnosis of tremor. , 2011, American family physician.

[19]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.