A Mobile Game Controller Adapted to the Gameplay and User's Behavior Using Machine Learning

When playing games, the user expects an easy and intuitive interaction. While current controllers are physical hardware components with a default configuration of buttons, different games use different buttons and demand different interaction methods. Besides, the player style varies according to personal characteristics or past gaming experiences. In previous works we proposed a novel virtual controller based on a common touchscreen device, such as smartphone or tablet, that is used as a gamepad to control a game on a computer or game console. In this work we include machine-learning techniques for an intelligent adaption of the layout and control elements distribution, minimizing errors and providing an enjoyable experience for individual users. We also present different usability tests and show considerable improvements in the precision and game performance of the user. We expect to open a new way of designing console and desktop games, allowing game designers to project individual controllers for each game.

[1]  Tyler Baldwin,et al.  Towards online adaptation and personalization of key-target resizing for mobile devices , 2012, IUI '12.

[2]  Simon Rogers,et al.  FingerCloud: uncertainty and autonomy handover incapacitive sensing , 2010, CHI.

[3]  Fred I. Dretske Explaining Behavior: Reasons in a World of Causes , 1990 .

[4]  Paul Coulton,et al.  Using a Mobile Phone as a "Wii-like" Controller for Playing Games on a Large Public Display , 2008, Int. J. Comput. Games Technol..

[5]  Wolfgang Minker,et al.  Adaptive Multimodal Interactive Systems , 2011 .

[6]  Chen Wei,et al.  Novel interface for first person shooting games on PDAs , 2008, OZCHI '08.

[7]  A. Saykin,et al.  In-home virtual reality videogame telerehabilitation in adolescents with hemiplegic cerebral palsy. , 2010, Archives of physical medicine and rehabilitation.

[8]  Shumin Zhai,et al.  Bayesian touch: a statistical criterion of target selection with finger touch , 2013, UIST.

[9]  Mateus Pelegrino,et al.  An architecture for game interaction using mobile , 2012, 2012 IEEE International Games Innovation Conference.

[10]  John Wang,et al.  Data Mining Software , 2008 .

[11]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[12]  Silva Junior,et al.  A Content Adaptation Ar chitecture for Games , 2012 .

[13]  Selan Rodrigues dos Santos,et al.  Using Mobile Phones to Control Desktop Multiplayer Games , 2010, 2010 Brazilian Symposium on Games and Digital Entertainment.

[14]  Daniela Gorski Trevisan,et al.  Semiotic Inspection of a Game for Children with Down Syndrome , 2010, 2010 Brazilian Symposium on Games and Digital Entertainment.

[15]  Arto Laikari,et al.  Exergaming - Gaming for health: A bridge between real world and virtual communities , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[16]  Michael Zyda,et al.  Educating the Next Generation of Mobile Game Developers , 2007, IEEE Computer Graphics and Applications.

[17]  Markus Löchtefeld,et al.  A user-specific machine learning approach for improving touch accuracy on mobile devices , 2012, UIST '12.

[18]  Teofilo F. Gonzalez,et al.  On the computational complexity of clustering and related problems , 1982 .

[19]  Björn Stenger,et al.  A Vision-Based Remote Control , 2010, Computer Vision: Detection, Recognition and Reconstruction.

[20]  Leonardo Torok,et al.  Creating and Designing Customized and Dynamic Game Interfaces Using Smartphones and Touchscreen , 2014, 2014 Brazilian Symposium on Computer Games and Digital Entertainment.

[21]  Darryl Charles,et al.  Serious Games for Upper Limb Rehabilitation Following Stroke , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[22]  Pat Langley,et al.  Machine Learning for Adaptive User Interfaces , 1997, KI.