The role of kinesthetic reference frames in two-handed input performance

We present experimental work which explores how the match (or mismatch) between the input space of the hands and the output space of a graphical display influences two-handed input performance. During interaction with computers, a direct correspondence between the input and output spaces is often lacking. Not only are the hands disjoint from the display space, but the reference frames of the hands may in fact be disjoint from one another if two separate input devices (e.g. two mice) are used for two-handed input. In general, we refer to the workspace and origin within which the hands operate as kinesthetic reference frames. Our goal is to better understand how an interface designer's choice of kinesthetic reference frames influences a user's ability to coordinate two-handed movements, and to explore how the answer to this question may depend on the availability of visual feedback. Understanding this issue has implications for the design of two-handed interaction techniques and input devices, as well as for the reference principle of Guiard's Kinematic Chain model of human bimanual action. Our results suggest that the Guiard reference principle is robust with respect to variances in the kinesthetic reference frames as long as appropriate visual feedback is present.

[1]  Shumin Zhai,et al.  Manual and cognitive benefits of two-handed input: an experimental study , 1998, TCHI.

[2]  Dennis Proffitt,et al.  Attention and visual feedback: the bimanual frame of reference , 1997, SI3D.

[3]  P. Wolff,et al.  Serial organization of motor skills in left- and right-handed adults , 1977, Neuropsychologia.

[4]  Maureen C. Stone,et al.  Snap-dragging , 1986, SIGGRAPH.

[5]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[6]  William Buxton,et al.  The design of a GUI paradigm based on tablets, two-hands, and transparency , 1997, CHI.

[7]  K. A. Provins,et al.  Handwriting, Typewriting and Handedness , 1968, The Quarterly journal of experimental psychology.

[8]  Mike Sinclair,et al.  Interaction and modeling techniques for desktop two-handed input , 1998, UIST '98.

[9]  B. Preilowski,et al.  Possible contribution of the anterior forebrain commissures to bilateral motor coordination. , 1972, Neuropsychologia.

[10]  Eric A. Bier Snap-dragging in three dimensions , 1990, I3D '90.

[11]  J. Annett,et al.  The Control of Movement in the Preferred and Non-Preferred Hands* , 1979, The Quarterly journal of experimental psychology.

[12]  M. Peters,et al.  Constraints in the performance of bimanual tasks and their expression in unskilled and skilled subjects , 1985 .

[13]  D Goodman,et al.  On the coordination of two-handed movements. , 1979, Journal of experimental psychology. Human perception and performance.

[14]  C. MacKenzie,et al.  Bimanual Movement Control: Information processing and Interaction Effects , 1984 .

[15]  Andrew S. Forsberg,et al.  Two pointer input for 3D interaction , 1997, SI3D.

[16]  Ravin Balakrishnan,et al.  Exploring bimanual camera control and object manipulation in 3D graphics interfaces , 1999, CHI '99.

[17]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .

[18]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[19]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[20]  A. Wing Timing and Co-Ordination of Repetitive Bimanual Movements , 1982 .

[21]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[22]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[23]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[24]  Abigail Sellen,et al.  Two-handed input in a compound task , 1994, CHI 1994.

[25]  Joe Tullio,et al.  Usability analysis of 3D rotation techniques , 1997, UIST '97.

[26]  Abigail Sellen,et al.  The Prevention of Mode Errors Through Sensory Feedback , 1992, Hum. Comput. Interact..