Effects of Feedforward in In-Air Remote Pointing

Remote pointing devices like the Wii remote have a wide range of applications and are becoming more important for the manipulation of and interactions with information on a distant display such as smart TVs. Because remote pointing devices are used without external support, however, muscular tremors and motional disparity between the display and motor space can result in usability problems of mouse jitters and instability. In this research, a solution is proposed to those problems using feedforward technology, where a user is provided with predictive information in multisensory modalities while approaching a target. Also, gender effect on the user experience of remote pointing devices is examined. By conducting two experiments and a survey, it was found that the feedforward signal plays a role of precue and is more effective than the typical feedback. It was also found that the modality variations in feedforward were impacted by the gender of the user. The findings can be used to improve user interfaces for remote pointing controllers.

[1]  Cristy Ho,et al.  Multisensory In-Car Warning Signals for Collision Avoidance , 2007, Hum. Factors.

[2]  W. L. Jenkins,et al.  Some design factors in making settings on a linear scale. , 1949 .

[3]  Sarah A. Douglas,et al.  Differences in movement microstructure of the mouse and the finger-controlled isometric joystick , 1996, CHI.

[4]  Junghwan Kook,et al.  Effects of amplitude modulation on vibrotactile flow displays on piezo-actuated thin touch screen , 2012 .

[5]  Beryl Plimmer,et al.  3D input for 3D worlds , 2007, OZCHI '07.

[6]  I. Scott MacKenzie,et al.  An Evaluation of Two Input Devices for Remote Pointing , 2001, EHCI.

[7]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[8]  Carl Gutwin,et al.  The Effects of Feedback on Targeting Performance in Visually Stressed Conditions , 2000, Graphics Interface.

[9]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[10]  Benjamin A. Clegg,et al.  Tactile interruption management: tactile cues as task-switching reminders , 2006, Cognition, Technology & Work.

[11]  B. Roskos-Ewoldsen,et al.  THE RELATIONS AMONG WAYFINDING STRATEGY USE, SENSE OF DIRECTION, SEX, FAMILIARITY, AND WAYFINDING ABILITY , 2000 .

[12]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[13]  Stephen A. Brewster,et al.  The design of sonically-enhanced widgets , 1998, Interact. Comput..

[14]  Morten Hertzum,et al.  The Effect of Target Precuing on Pointing With Mouse and Touchpad , 2013, Int. J. Hum. Comput. Interact..

[15]  Motoyuki Akamatsu,et al.  Movement characteristics using a mouse with tactile and force feedback , 1996, Int. J. Hum. Comput. Stud..

[16]  Marlieke T R van Kesteren,et al.  Auditory temporal-order thresholds show no gender differences. , 2007, Restorative neurology and neuroscience.

[17]  Doug A. Bowman,et al.  New Directions in 3D User Interfaces , 2006, Int. J. Virtual Real..

[18]  Peter Robinson,et al.  Using haptic feedback to enhance computer interaction for motion-impaired users , 2000 .

[19]  Junji Furusho,et al.  Control using joint torque sensor of robot arm with two‐inertia resonance: Comparison with control using state‐estimation observer , 2006 .

[20]  Jacob S Nteere,et al.  Information Capacity of the Human Motor system , 1982 .

[21]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[22]  M J Griffin,et al.  Prediction of the incidence of motion sickness from the magnitude, frequency, and duration of vertical oscillation. , 1986, The Journal of the Acoustical Society of America.

[23]  T. Fukawa,et al.  [Sex difference in susceptibility to delayed auditory feedback in oral reading tasks]. , 1988, Shinrigaku kenkyu : The Japanese journal of psychology.

[24]  A. Kramer,et al.  Stable individual differences in search strategy? The effect of task demands and motivational factors on scanning strategy in visual search. , 2009, Journal of vision.

[25]  Gregory W. Edwards.  Performance and Usability of Force Feedback and Auditory Substitutions in a Virtual Environment Manipulation Task , 2000 .

[26]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[27]  H Summala,et al.  Cognitive load and detection thresholds in car following situations: safety implications for using mobile (cellular) telephones while driving. , 1999, Accident; analysis and prevention.

[28]  Desney S. Tan,et al.  Large Displays Enhance Optical Flow Cues and Narrow the Gender Gap in 3-D Virtual Navigation , 2006, Hum. Factors.

[29]  Thomas Lundeberg,et al.  Vibratory stimulation increase the electro-cutaneous sensory detection and pain thresholds in women but not in men , 2006, BMC complementary and alternative medicine.

[30]  M. Taussig.  The Nervous System , 1991 .

[31]  Karl M Newell,et al.  Amplitude changes in the 8–12, 20–25, and 40 Hz oscillations in finger tremor , 2000, Clinical Neurophysiology.

[32]  W Schiff,et al.  Accuracy of judging time to arrival: effects of modality, trajectory, and gender. , 1990, Journal of experimental psychology. Human perception and performance.

[33]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[34]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[35]  James W Jenness,et al.  Effects of Manual versus Voice-Activated Dialing during Simulated Driving , 2002, Perceptual and motor skills.

[36]  Sriram Subramanian,et al.  Haptic feedback in remote pointing , 2009, CHI Extended Abstracts.

[37]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[38]  Gregory Neely,et al.  Gender differences in subjective responses to hand–arm vibration , 2006 .

[39]  D. Halpern.  Sex Differences in Cognitive Abilities , 1986 .

[40]  Ravin Balakrishnan,et al.  Fitts' law and expanding targets: Experimental studies and designs for user interfaces , 2005, TCHI.

[41]  Charles Spence,et al.  Multisensory warning signals: when spatial correspondence matters , 2009, Experimental Brain Research.

[42]  Stéphane Conversy,et al.  Auditory illusions for audio feedback , 1996, CHI Conference Companion.

[43]  Julie A. Jacko,et al.  Older adults and visual impairment: what do exposure times and accuracy tell us about performance gains associated with multimodal feedback? , 2003, CHI '03.

[44]  Charles Spence,et al.  Capturing spatial attention with multisensory cues , 2008, Psychonomic bulletin & review.

[45]  M. Sivak.  The Information That Drivers Use: Is it Indeed 90% Visual? , 1996, Perception.

[46]  Tonya L. Smith-Jackson,et al.  Elicitation of Haptic User Interface Needs of People with Low Vision , 2013, Int. J. Hum. Comput. Interact..

[47]  S. Hsu,et al.  Age Differences in Remote Pointing Performance , 1997, Perceptual and motor skills.

[48]  Anton Nijholt,et al.  Brain–Computer Interfaces for Multimodal Interaction: A Survey and Principles , 2012, Int. J. Hum. Comput. Interact..

[49]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[50]  Andy Cockburn,et al.  Multimodal feedback for the acquisition of small targets , 2005, Ergonomics.

[51]  N. Charness,et al.  Age-related changes in perceptual and psychomotor performance: implications for engineering design. , 1994, Experimental aging research.

[52]  M. Grunwald.  Human haptic perception : basics and applications , 2008 .

[53]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[54]  Haitao Song,et al.  Updating Fitts' Law to Account for Restricted Display Field of View Conditions , 2012, Int. J. Hum. Comput. Interact..

[55]  Ravin Balakrishnan,et al.  Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks , 2008, CHI.

[56]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.

[57]  Shang H. Hsu,et al.  EFFECTS OF AGE AND GENDER ON REMOTE POINTING PERFORMANCE AND THEIR DESIGN IMPLICATIONS , 1999 .

[58]  Haitao Song,et al.  Updating Fitts' Law to Account for Small Targets , 2012, Int. J. Hum. Comput. Interact..

[59]  Richard B. Stein,et al.  Tremor and Clonus , 2011 .

[60]  A. Berthoz,et al.  Sex, Lies And Virtual Reality , 1998, Nature Neuroscience.

[61]  Heinrich Müller,et al.  Interaction with a projection screen using a camera-tracked laser pointer , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).