Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens

Mobile phones and personal digital assistants (PDAs) are incredibly popular pervasive technologies. Many of these devices contain touch screens, which can present problems for users with motor impairments due to small targets and their reliance on tapping for target acquisition. In order to select a target, users must tap on the screen, an action which requires the precise motion of flying into a target and lifting without slipping. In this paper, we propose a new technique for target acquisition called barrier pointing, which leverages the elevated physical edges surrounding the screen to improve pointing accuracy. After designing a series of barrier pointing techniques, we conducted an initial study with 9 able bodied users and 9 users with motor impairments in order to discover the parameters that make barrier pointing successful. From this data, we offer an in-depth analysis of the performance of two motor impaired users for whom barrier pointing was especially beneficial. We show the importance of providing physical stability by allowing the stylus to press against the screen and its physical edge. We offer other design insights and lessons learned that can inform future attempts at leveraging the physical properties of mobile devices to improve accessibility.

[1]  Diane Nelson Bryen,et al.  Augmentative and Alternative Communication and Cell Phone Use: One Off-the-Shelf Solution and Some Policy Considerations , 2004, Assistive technology : the official journal of RESNA.

[2]  Anastasia Bezerianos,et al.  The vacuum: facilitating the manipulation of distant objects , 2005, CHI.

[3]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[4]  Brad A. Myers,et al.  Exploring edge-based input techniques for handheld text entry , 2003, 23rd International Conference on Distributed Computing Systems Workshops, 2003. Proceedings..

[5]  Jeffrey Nichols,et al.  Using handhelds to help people with motor impairments , 2002, Assets '02.

[6]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[7]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[8]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[9]  Tonya Smith-Jackson,et al.  Accessible cell phone design: development and application of a needs analysis framework , 2003, Disability and rehabilitation.

[10]  Neff Walker,et al.  A comparison of selection time from walking and pull-down menus , 1990, CHI '90.

[11]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[12]  Simeon Keates,et al.  Developing steady clicks:: a method of cursor assistance for people with motor impairments , 2006, Assets '06.

[13]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[14]  Ravin Balakrishnan,et al.  Acquisition of expanding targets , 2002, CHI.

[15]  Brad A. Myers,et al.  WebThumb: interaction techniques for small-screen browsers , 2002, UIST '02.

[16]  Benjamin B. Bederson,et al.  ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices , 2007, INTERACT.

[17]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[18]  B Phillips,et al.  Predictors of assistive technology abandonment. , 1993, Assistive technology : the official journal of RESNA.

[19]  Bengt Göransson The Re-design of a PDA-based System for Supporting People with Parkinson's Disease , 2004, BCS HCI.

[20]  Keith S. Jones,et al.  Acquisition Speed with Targets on the Edge of the Screen: An Application of Fitts' Law to Commonly Used Web Browser Controls , 2001 .

[21]  Simeon Keates,et al.  Effect of age and Parkinson's disease on cursor positioning using a mouse , 2005, Assets '05.

[22]  Jacob O. Wobbrock The benefits of physical edges in gesture-making: empirical support for an edge-based unistroke alphabet , 2003, CHI Extended Abstracts.

[23]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.