A $1.5 Gesture Recognizer as Input Device for a Multi-Platform Virtual Game Controller

Current high-end computer games mostly are developed simultaneously for several dierent plat- forms like e.g. PC, XBox c or Playstadion c . These sys- tems often have varying individual input devices. The necessity to consider all of them during the development process potentially obfuscates development and might increase cost signicantly. To overcome this problem virtual control devices can be introduced. Our paper has two main contributions. First, the design and im- plementation of a virtual game controller as an inter- face between any application in the context of video games and any kind of hardware input devices on mul- tiple platforms are discussed. Second, a modication of the $1 gesture recognizer introduced by Wobbrock et. al. is presented that speeds up the recognition of two- dimensional gestures signicantly. Finally, we demon- strate the usage of the gesture recognizer as a high-level input device for our multi-platform virtual controller.

[1]  Devina Ramduny-Ellis,et al.  The VoodooIO gaming kit: a real-time adaptable gaming controller , 2007, Comput. Entertain..

[2]  Pierre Dragicevic,et al.  The Input Configurator toolkit: towards high input adaptability in interactive applications , 2004, AVI.

[3]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[4]  Shijie Chen,et al.  Gesture Recognition Techniques in Handwriting Recognition Application , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[5]  James A. Pittman,et al.  Recognizing handwritten text , 1991, CHI.

[6]  Romit Roy Choudhury,et al.  Using mobile phones to write in air , 2011, MobiSys '11.

[7]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[8]  Ralf Dörner,et al.  Recognition of Dynamic Hand Gestures with Time-of-Flight Cameras , 2010 .

[9]  Terry Winograd,et al.  Fluid interaction with high-resolution wall-size displays , 2001, UIST '01.

[10]  Benjamin B. Bederson,et al.  AppLens and launchTile: two designs for one-handed thumb use on small devices , 2005, CHI.

[11]  Randall Davis,et al.  HMM-based efficient sketch recognition , 2005, IUI.

[12]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[13]  Thomas F. Stahovich,et al.  The effect of task on classification accuracy: Using gesture recognition techniques in free-sketch recognition , 2010, Comput. Graph..

[14]  William H. Press,et al.  Numerical recipes in C , 2002 .

[15]  Per Ola Kristensson,et al.  Continuous Recognition and Visualization of Pen Strokes and Touch-Screen Gestures , 2011, SBIM.

[16]  Minsu Jang,et al.  Design of an adaptive accelerometer-based handwriting recognition system based on metacognitive framework , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[17]  Charles C. Tappert,et al.  Cursive Script Recognition by Elastic Matching , 1982, IBM J. Res. Dev..

[18]  Andreas Butz,et al.  Towards a unified gesture description language , 2010, Humans and Computers.

[19]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[20]  Ravin Balakrishnan,et al.  VisionWand: interaction techniques for large displays using a passive wand tracked in 3D , 2004, SIGGRAPH 2004.

[21]  Andreas Paepcke,et al.  Cooperative gestures: multi-user gestural interactions for co-located groupware , 2006, CHI.

[22]  Mi-Gyung Cho A new gesture recognition algorithm and segmentation method of Korean scripts for gesture-allowed ink editor , 2006, Inf. Sci..

[23]  Andreas Oikonomou,et al.  History and alternative game input methods , 2011, 2011 16th International Conference on Computer Games (CGAMES).

[24]  Junichi Hoshino,et al.  A soft body controller that can be thrown and grasped , 2011, 2011 IEEE International Symposium on VR Innovation.

[25]  Steven A. Shafer,et al.  XWand: UI for intelligent spaces , 2003, CHI '03.