Addressing age-related pen-based target acquisition difficulties

Technology is increasingly being promoted as a means of addressing age-related cognitive and sensory impairments and enabling seniors to live more independently. Pen-based devices such as Personal Digital Assistants and Tablet PCs are appealing platforms for these endeavors because they are small, mobile, and powerful. Relative to the mouse, pen-based devices have been shown to be particularly beneficial for older adults. However, in terms of garnering wide-spread adoption, the mouse has historically dominated, leading researchers to focus chiefly on identifying and addressing its ageand motor-related limitations. In contrast, pen-based limitations for older users have been relatively unexplored. This thesis begins to fill that gap in the literature. Our first experiment, an empirical evaluation of pen-based target acquisition across the adult lifespan, identified three main sources of pen-based target acquisition difficulty—missing-just-below, slipping, and drifting—and demonstrated how these difficulties vary across task situation and age. In addition, this work showed that including older adults as participants can help uncover general peninteraction problems: the missing-just-below and drifting difficulties were evident in both younger and older users alike. We next developed seven new target acquisition techniques to improve penbased interaction, specifically addressing the three difficulties identified, and particularly targeting older adults. Our techniques built upon existing mouse-based techniques developed for older users and pen techniques for younger users. In total, we conducted three experiments to evaluate the seven new pen-based techniques: Reassigned and Deactivated (for missing-just-below), Tap and Glide (for drifting), and Steady, Bubble, and Steadied-Bubble (for slipping). Through these

[1]  Kim J. Vicente,et al.  The Earth is spherical (p < 0.05): alternative methods of statistical inference , 2000 .

[2]  Mark W. Newman,et al.  Escape: a target selection technique using visually-cued gestures , 2008, CHI.

[3]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[4]  M. Weiser,et al.  An empirical comparison of pie vs. linear menus , 1988, CHI '88.

[5]  J. Salamone,et al.  Temporal Measures of Human Finger Tapping: Effects of Age , 1998, Pharmacology Biochemistry and Behavior.

[6]  Chad A. Phipps,et al.  CareWatch: A Home Monitoring System for Use in Homes of Persons With Cognitive Impairment , 2007, Topics in geriatric rehabilitation.

[7]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[8]  Matthew Heath,et al.  Visual-Motor Integration of Unexpected Sensory Events in Young and Older Participants: A Kinematic Analysis , 1999 .

[9]  A T Welford,et al.  Signal, Noise, Performance, and Age , 1981, Human factors.

[10]  Nic D. P. Hollinworth Improving computer interaction for older adults , 2009, ASAC.

[11]  Takeo Igarashi,et al.  Considering the direction of cursor movement for efficient traversal of cascading menus , 2003, UIST '03.

[12]  Neff Walker,et al.  A comparison of selection time from walking and pull-down menus , 1990, CHI '90.

[13]  Joanna McGrenere,et al.  Slipping and drifting: using older users to uncover pen-based target acquisition difficulties , 2007, Assets '07.

[14]  J H Yan,et al.  Effects of Aging on Linear and Curvilinear Aiming Arm Movements , 2000, Experimental aging research.

[15]  Deborah L. Harrington,et al.  Neuropsychological Assessment of Motor Skills , 1998 .

[16]  Elizabeth D. Mynatt,et al.  Increasing the opportunities for aging in place , 2000, CUU '00.

[17]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[18]  David Ahlstr Modeling and Improving Selection in Cascading Pull›Down Menus Using Fitts' Law, the Steering Law and Force Fields , 2005 .

[19]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[20]  Gerhard Leitner,et al.  An evaluation of sticky and force enhanced targets in multi target situations , 2006, NordiCHI '06.

[21]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[22]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[23]  R. Sprott,et al.  Age‐related Variability , 1988, Annals of the New York Academy of Sciences.

[24]  Ben Shneiderman,et al.  Split menus: effectively using selection frequency to organize menus , 1994, TCHI.

[25]  François Guimbretière,et al.  Techniques , 2011, Laboratory Investigation.

[26]  G. Stelmach,et al.  Movement Control in the Older Adult , 2004 .

[27]  Shumin Zhai,et al.  High precision touch screen interaction , 2003, CHI '03.

[28]  J. Tiffin,et al.  The Purdue pegboard; norms and studies of reliability and validity. , 1948, The Journal of applied psychology.

[29]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[30]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[31]  J. Cooke,et al.  Control of simple arm movements in elderly humans , 1989, Neurobiology of Aging.

[32]  A. T. Welford,et al.  THE MEASUREMENT OF SENSORY-MOTOR PERFORMANCE : SURVEY AND REAPPRAISAL OF TWELVE YEARS' PROGRESS , 1960 .

[33]  A. Welford,et al.  Reaction Time, Speed of Performance, and Age , 1988, Annals of the New York Academy of Sciences.

[34]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[35]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[36]  G. Smith,et al.  Slowness and age: speed-accuracy mechanisms. , 1995, Psychology and aging.

[37]  Thomas K. Landauer,et al.  Behavioral Research Methods in Human-Computer Interaction , 1997 .

[38]  R. Rausch A compendium of neuropsychological tests: administration, norms, and commentary , 1994 .

[39]  Carl Gutwin,et al.  A predictive model of menu performance , 2007, CHI.

[40]  T. Hänninen,et al.  [Cognitive aging]. , 2000, Duodecim; laaketieteellinen aikakauskirja.

[41]  Sachi Mizobuchi,et al.  Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors , 2004, CHI '04.

[42]  Anind K. Dey,et al.  Providing good memory cues for people with episodic memory impairment , 2007, Assets '07.

[43]  Simeon Keates,et al.  Effect of age and Parkinson's disease on cursor positioning using a mouse , 2005, Assets '05.

[44]  Ian Oakley,et al.  Tilt to scroll: evaluating a motion based vibrotactile mobile interface , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[45]  Simeon Keates,et al.  Developing steady clicks:: a method of cursor assistance for people with motor impairments , 2006, Assets '06.

[46]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[47]  Jacob Slonim,et al.  Requirements gathering with alzheimer's patients and caregivers , 2005, Assets '05.

[48]  Sriram Subramanian,et al.  Modeling steering within above-the-surface interaction layers , 2007, CHI.

[49]  F. Craik,et al.  The handbook of aging and cognition , 1992 .

[50]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[51]  Patrick Rabbitt,et al.  Consciousness is slower than you think , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[52]  Ravin Balakrishnan,et al.  Zliding: fluid zooming and sliding for high precision parameter manipulation , 2005, UIST.

[53]  P. Graf,et al.  Exacting Assessments: Do Older Adults Fatigue More Quickly? , 2000, Journal of clinical and experimental neuropsychology.

[54]  P. Nussbaum,et al.  Neuropsychological Assessment of the Elderly , 1998 .

[55]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[56]  Sriram Subramanian,et al.  Multi-layer interaction for digital tables , 2006, UIST.

[57]  Patrick Baudisch,et al.  Hover widgets: using the tracking state to extend the capabilities of pen-operated devices , 2006, CHI.

[58]  H. Zelaznik,et al.  Motor-output variability: a theory for the accuracy of rapid motor acts. , 1979, Psychological review.

[59]  Andy Cockburn,et al.  Faster cascading menu selections with enlarged activation areas , 2006, Graphics Interface.

[60]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[61]  Dieter Zapf,et al.  Age differences in reactions to errors in computer-based work , 1997, Behav. Inf. Technol..

[62]  Joanna McGrenere,et al.  Exploring Methods to Improve Pen-Based Menu Selection for Younger and Older Adults , 2009, TACC.

[63]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[64]  S. Czaja,et al.  Age differences in attitudes toward computers. , 1998, The journals of gerontology. Series B, Psychological sciences and social sciences.

[65]  Frank Schieber,et al.  Human Factors and Aging: Identifying and Compensating for Age-related Deficits in Sensory and Cognitive Function , 2003 .

[66]  Renaud Blanch,et al.  Semantic pointing: improving target acquisition with control-display ratio adaptation , 2004, CHI.

[67]  M. P. J. M. Van Riel,et al.  The effect on sitting posture of a desk with a 10° inclination for reading and writing , 1991 .

[68]  Alex Chaparro,et al.  Range of motion of the wrist: implications for designing computer input devices for the elderly , 2000, Disability and rehabilitation.

[69]  Monica M. C. Schraefel,et al.  Bubbling menus: a selective mechanism for accessing hierarchical drop-down menus , 2007, CHI.

[70]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[71]  Joseph Sharit,et al.  Aging, Motor Control, and the Performance of Computer Mouse Tasks , 1999, Hum. Factors.

[72]  Daniel J. Wigdor,et al.  Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces , 2008, AVI '08.

[73]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[74]  Juan Pablo Hourcade,et al.  Simple pen interaction performance of young and older adults using handheld computers , 2008, Interact. Comput..

[75]  A. D. Fisk,et al.  Age-related differences in movement control: adjusting submovement structure to optimize performance. , 1997, The journals of gerontology. Series B, Psychological sciences and social sciences.

[76]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[77]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[78]  C. Riviere,et al.  Effects of age and disability on tracking tasks with a computer mouse: accuracy and linearity. , 1996, Journal of rehabilitation research and development.

[79]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[80]  Jon Froehlich,et al.  Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens , 2007, Assets '07.

[81]  George E Stelmach,et al.  Age-related kinematic differences as influenced by task difficulty, target size, and movement amplitude. , 2002, The journals of gerontology. Series B, Psychological sciences and social sciences.

[82]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[83]  William Buxton,et al.  Tracking menus , 2003, UIST '03.

[84]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[85]  Trent Apted,et al.  Tabletop sharing of digital photographs for the elderly , 2006, CHI.

[86]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[87]  J. Cooke,et al.  Kinematics of arm movements in elderly humans , 1989, Neurobiology of Aging.

[88]  R T Wilkinson,et al.  Age and simple reaction time: decade differences for 5,325 subjects. , 1989, Journal of gerontology.

[89]  David A. Rosenbaum,et al.  Human Motor Control (2. ed.) , 2010 .

[90]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[91]  Dan Venolia,et al.  T-Cube: a fast, self-disclosing pen-based alphabet , 1994, CHI '94.

[92]  Maria M. Klawe,et al.  The participatory design of a sound and image enhanced daily planner for people with aphasia , 2004, CHI.

[93]  Tom Mayfield,et al.  Bodyspace: Anthropometry, Ergonomics and the Design of Work (3rd ed.) by Stephen Pheasant & Christine M. Haslegrave 2005, 332 pages, $69.95 Boca Raton, FL: CRC Press ISBN 0-415-28520-8 , 2007 .

[94]  Yves Guiard,et al.  Beyond the 10-bit Barrier: Fitts' Law in Multi-Scale Electronic Worlds , 2001, BCS HCI/IHM.

[95]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[96]  Paul Kabbash,et al.  The “prince” technique: Fitts' law and selection using area cursors , 1995, CHI '95.

[97]  Darren Leigh,et al.  Haptic pen: a tactile feedback stylus for touch screens , 2004, UIST '04.

[98]  Ravin Balakrishnan,et al.  Pointing lenses: facilitating stylus input through visual-and motor-space magnification , 2007, CHI.

[99]  Ronald Baecker,et al.  Using participatory activities with seniors to critique, build, and evaluate mobile phones , 2007, Assets '07.

[100]  Joanna McGrenere,et al.  Hover or tap?: supporting pen-based menu navigation for older adults , 2008, Assets '08.

[101]  Scott E. Hudson,et al.  Understanding pointing problems in real world computing environments , 2008, Assets '08.

[102]  Simeon Keates,et al.  Using pointing devices: quantifying differences across user groups , 2005 .

[103]  Simeon Keates,et al.  Using pointing devices: difficulties encountered and strategies employed , 2005 .

[104]  B. Manly Randomization, Bootstrap and Monte Carlo Methods in Biology , 2018 .

[105]  Neil Charness,et al.  Light Pen Use and Practice Minimize Age and Hand Performance Differences in Pointing Tasks , 2004, Hum. Factors.

[106]  Peter Gregor,et al.  Designing for dynamic diversity: interfaces for older people , 2002, Assets '02.

[107]  Krzysztof Z. Gajos,et al.  Goal Crossing with Mice and Trackballs for People with Motor Impairments: Performance, Submovements, and Design Directions , 2008, TACC.

[108]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[109]  R. Cremer,et al.  What kind of noise increases with age? , 1987, Journal of gerontology.

[110]  Xiangshi Ren,et al.  Improving selection performance on pen-based systems: a study of pen-based interaction for selection tasks , 2000, TCHI.

[111]  F. James Rohlf,et al.  Biometry: The Principles and Practice of Statistics in Biological Research , 1969 .

[112]  T A Salthouse Cognitive Aspects of Motor Functioning , 1988, Annals of the New York Academy of Sciences.

[113]  T R Bashore,et al.  Mental slowing in elderly persons: a cognitive psychophysiological analysis. , 1989, Psychology and aging.

[114]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[115]  Andy Cockburn,et al.  Improving the Acquisition of Small Targets , 2004 .

[116]  Chris Harrison,et al.  Providing dynamically changeable physical buttons on a visual display , 2009, CHI.

[117]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[118]  Ravin Balakrishnan,et al.  Fitts' law and expanding targets: Experimental studies and designs for user interfaces , 2005, TCHI.

[119]  Joanna McGrenere,et al.  Steadied-bubbles: combining techniques to address pen-based pointing errors for younger and older adults , 2010, CHI.

[120]  Renaud Blanch,et al.  Object Pointing: A Complement to Bitmap Pointing in GUIs , 2004, Graphics Interface.

[121]  C D Wickens,et al.  Adult age differences in the speed and capacity of information processing: 2. An electrophysiological approach. , 1987, Psychology and aging.