Gestural Menus for Games

Menu techniques plays an important role in video games. Since response time and ease of use of a menu system can significantly affect user experience in applications such as video games, it is essential that they be fast, efficient, and not be a burden on the user while setting up and during play. This chapter presents work related to several gesture based menu systems available in literature. We also present a study which seeks to determine the usefulness of finger-count based menu system. Finger-count menus selects an item on screen based on the number of fingers extended by the user. The experiment compares finger-count based menus with several other menus including the 3D Marking menus.

[1]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[2]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[3]  Joseph J. LaViola,et al.  Poster: Real-time markerless kinect based finger tracking and hand gesture recognition for HCI , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  C. Jennings,et al.  Robust finger tracking with multiple cameras , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[5]  Gang Ren,et al.  3D Marking menu selection with freehand gestures , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[7]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[8]  R. A. Fisher,et al.  Design of Experiments , 1936 .

[9]  Joseph J. LaViola,et al.  An exploration of menu techniques using a 3D game input device , 2009, FDG.

[10]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[11]  Jörg Müller,et al.  Comparing Free Hand Menu Techniques for Distant Displays Using Linear, Marking and Finger-Count Menus , 2011, INTERACT.

[12]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..

[13]  Gilles Bailly,et al.  Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces , 2010, CHI.

[14]  Shweta Kapur,et al.  Age-related changes in the control of finger force vectors. , 2010, Journal of applied physiology.

[15]  Gordon Kurtenbach,et al.  The design and evaluation of marking menus , 1993 .

[16]  Doug A. Bowman,et al.  Design and evaluation of menu systems for immersive virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[17]  Dominique Bechmann,et al.  The spin menu: a menu system for virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[18]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[19]  M. Weiser,et al.  An empirical comparison of pie vs. linear menus , 1988, CHI '88.

[20]  Mathias Kölsch,et al.  Robust hand detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[21]  Doug A. Bowman,et al.  Tech-note: rapMenu: Remote Menu Selection Using Freehand Gestural Input , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[22]  Colin Ware,et al.  A study of haptic linear and pie menus in a 3D fish tank VR environment , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[23]  Daniel James Ryan,et al.  Finger and gesture recognition with Microsoft Kinect , 2012 .