Investigating Performance and Usage of Input Methods for Soft Keyboard Hotkeys

Touch-based devices, despite their mainstream availability, do not support a unified and efficient command selection mechanism, available on every platform and application. We advocate that hotkeys, conventionally used as a shortcut mechanism on desktop computers, could be generalized as a command selection mechanism for touch-based devices, even for keyboard-less applications. In this paper, we investigate the performance and usage of soft keyboard shortcuts or hotkeys (abbreviated SoftCuts) through two studies comparing different input methods across sitting, standing and walking conditions. Our results suggest that SoftCuts not only are appreciated by participants but also support rapid command selection with different devices and hand configurations. We also did not find evidence that walking deters their performance when using the Once input method.

[1]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.

[2]  Carl Gutwin,et al.  Supporting Transitions to Expertise in Hidden Toolbars , 2016, CHI.

[3]  Toshiya Isomoto,et al.  One-handed Rapid Text Selection and Command Execution Method for Smartphones , 2019, CHI Extended Abstracts.

[4]  Andrea Bunt,et al.  Where is that Feature?: Designing for Cross-Device Software Learnability , 2020, Conference on Designing Interactive Systems.

[5]  Daniel Vogel,et al.  FingerArc and FingerChord: Supporting Novice to Expert Transitions with Guided Finger-Aware Shortcuts , 2018, UIST.

[6]  Daniel J. Wigdor,et al.  Métamorphe: augmenting hotkey usage with actuated keys , 2013, CHI.

[7]  Gilles Bailly,et al.  Wavelet menus: a stacking metaphor for adapting marking menus to mobile devices , 2009, Mobile HCI.

[8]  Paul K. Wright,et al.  Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques , 2004, Graphics Interface.

[9]  Carl Gutwin,et al.  Faster Command Selection on Touchscreen Watches , 2016, CHI.

[10]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI '94.

[11]  Jakob Nielsen,et al.  Gestural interfaces: a step backward in usability , 2010, INTR.

[12]  Hyowon Lee,et al.  Multitouch Keyboard Revisited: Enhancing Moded Interaction Through Redesigning Structure and Switching Techniques , 2019, CHIuXiD.

[13]  Carl Gutwin,et al.  Faster command selection on tablets with FastTap , 2014, CHI.

[14]  Sylvain Malacria,et al.  Investigating the Necessity of Delay in Marking Menu Invocation , 2020, CHI.

[15]  Sylvain Malacria,et al.  Awareness, Usage and Discovery of Swipe-revealed Hidden Widgets in iOS , 2019, ISS.

[16]  Tero Jokela,et al.  A Diary Study on Combining Multiple Information Devices in Everyday Activities and Tasks , 2015, CHI.

[17]  Shumin Zhai,et al.  Command strokes with and without preview: using pen gestures on keyboard for command selection , 2007, CHI.

[18]  Nadine Mandran,et al.  Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode , 2010, AVI.

[19]  Carl Gutwin,et al.  Skillometers: reflective widgets that motivate and help users to improve performance , 2013, UIST.

[20]  Carl Gutwin,et al.  Reducing error aversion to support novice-to-expert transitions with FastTap , 2019, IHM.

[21]  Edward Lank,et al.  Surveying Expert-Level Gesture Use and Adoption on Multi-Touch Tablets , 2016, Conference on Designing Interactive Systems.

[22]  Xiaojun Bi,et al.  CommandBoard: Creating a General-Purpose Command Gesture Input Space for Soft Keyboard , 2017, UIST.

[23]  Bonnie E. John,et al.  The Strategic Use of Complex Computer Systems , 2000, Hum. Comput. Interact..

[24]  Iris van Rooij,et al.  Satisficing and the Use of Keyboard Shortcuts: Being Good Enough Is Enough? , 2013, Interact. Comput..

[25]  Björn Hartmann,et al.  Two-handed marking menus for multitouch devices , 2011, TCHI.

[26]  Oscar Kin-Chung Au,et al.  DownChord and UpChord: A New Style of Keyboard Shortcuts based on Simultaneous Key-down and Key-up Events , 2016, ChineseCHI2016.

[27]  Shumin Zhai,et al.  Typing on an Invisible Keyboard , 2018, CHI.

[28]  Thijs Roumen,et al.  NotiRing: A Comparative Study of Notification Channels for Wearable Interactive Rings , 2015, CHI.

[29]  William Buxton,et al.  User learning and performance with marking menus , 1994, CHI 1994.

[30]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[31]  Carl Gutwin,et al.  Investigating the Post-Training Persistence of Expert Interaction Techniques , 2017, ACM Trans. Comput. Hum. Interact..

[32]  Mark D. Dunlop,et al.  Enhancing KLM (keystroke-level model) to fit touch screen mobile devices , 2014, MobileHCI '14.

[33]  David M. Lane,et al.  Hidden Costs of Graphical User Interfaces: Failure to Make the Transition from Menus and Icon Toolbars to Keyboard Shortcuts , 2005, Int. J. Hum. Comput. Interact..

[34]  BaillyGilles,et al.  Visual Menu Techniques , 2016 .

[35]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[36]  Gilles Bailly,et al.  IconHK: Using Toolbar button Icons to Communicate Keyboard Shortcuts , 2017, CHI.

[37]  Craig S. Miller,et al.  Categorization costs for hierarchical keyboard commands , 2011, CHI.

[38]  Kun Li,et al.  M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction , 2018, CHI.

[39]  Tovi Grossman,et al.  The design and evaluation of multitouch marking menus , 2010, CHI.

[40]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[41]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[42]  Olivier Bau,et al.  Arpège: learning multitouch chord gestures vocabularies , 2013, ITS.

[43]  Xing-Dong Yang,et al.  PokeRing: Notifications by Poking Around the Finger , 2018, CHI.

[44]  Geehyuk Lee,et al.  MelodicTap: fingering hotkey for touch tablets , 2016, OZCHI.

[45]  Carl Gutwin,et al.  Promoting Hotkey use through rehearsal with ExposeHK , 2013, CHI.

[46]  Pierre Dragicevic,et al.  Strategies for accelerating on-line learning of hotkeys , 2007, CHI.