Investigating On-Screen Gamepad Designs for Smartphone-Controlled Video Games

On-screen gamepads are increasingly used as controllers for video games on distant screens, yet lack the typical tactile feedback known from hardware controllers. We conducted a comparative lab study to investigate four smartphone gamepads inspired by traditional game controllers and mobile game controls (directional buttons, directional pad, floating joystick, tilt control). The study consisted of both completing a formal control test as well as controlling two popular video games of different genres (Pac-Man and Super Mario Bros.). The results indicate that the directional buttons require the most attention of the user, however, work precisely for direction-restricted navigational tasks. Directional pad and joystick showed a similar performance, yet they encourage drifting and unintended operations when the user is focused on the remote screen. While currently unfamiliar to many users, the floating joystick can reduce the glances at the device. Tilt turned out to be not sufficiently precise and quick for the investigated tasks. The article concludes with derived design guidelines with easily realizable measures for typical contexts such as casual gaming at home or spontaneous gaming on public displays.

[1]  Xiang Cao,et al.  Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays , 2008, CSCW.

[2]  Clarisse Sieckenius de Souza,et al.  Turn off the graphics: designing non-visual interfaces for mobile phone games , 2009, Journal of the Brazilian Computer Society.

[3]  Markus Krause,et al.  Exploring User Input Metaphors for Jump and Run Games on Mobile Devices , 2012, ICEC.

[4]  Timo Ojala,et al.  MobiLenin combining a multi-track music video, personal mobile phones and a public display into multi-user interactive entertainment , 2005, MULTIMEDIA '05.

[5]  Paul Coulton,et al.  Using “tilt” as an interface to control “no-button” 3-D mobile games , 2008, CIE.

[6]  I. MacKenzie,et al.  Evaluation of Nano-stick , Foam Buttons , and Other Input Methods for Gameplay on Touchscreen Phones , 2013 .

[7]  Shumin Zhai,et al.  The performance of touch screen soft buttons , 2009, CHI.

[8]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[9]  Marko Jurmu,et al.  Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays , 2009, OZCHI.

[10]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[11]  Wolfgang Hürst,et al.  Touch Me, Tilt Me - Comparing Interaction Modalities for Navigation in 2D and 3D Worlds on Mobiles , 2013, Advances in Computer Entertainment.

[12]  Michael Rohs,et al.  The smart phone: a ubiquitous input device , 2006, IEEE Pervasive Computing.

[13]  Robert J. Teather,et al.  Touchscreens vs. traditional controllers in handheld gaming , 2010, Future Play.

[14]  Chui Yin Wong,et al.  Evaluating playability on haptic user interface for mobile gaming , 2010, 2010 International Symposium on Information Technology.

[15]  Paul Coulton,et al.  Using a Mobile Phone as a "Wii-like" Controller for Playing Games on a Large Public Display , 2008, Int. J. Comput. Games Technol..

[16]  Masaki Oshita,et al.  Gamepad vs. touchscreen: a comparison of action selection interfaces in computer games , 2012, WASA '12.

[17]  Chui Yin Wong,et al.  Soft Key and Hard Key Mobile Input Devices on Player Experience for Mobile Gaming , 2013, IVIC.

[18]  Masahiro Hori,et al.  Mobile devices as multi-DOF controllers , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[19]  BaldaufMatthias,et al.  Investigating On-Screen Gamepad Designs for Smartphone-Controlled Video Games , 2015 .

[20]  Mateus Pelegrino,et al.  An architecture for game interaction using mobile , 2012, 2012 IEEE International Games Innovation Conference.

[21]  Andreas Lorenz,et al.  The ambient media player: a media application remotely operated by the use of mobile devices and gestures , 2010, MUM.

[22]  Peter Fröhlich,et al.  From Touchpad to Smart Lens: A Comparative Study on Smartphone Interaction with Public Displays , 2013, Int. J. Mob. Hum. Comput. Interact..

[23]  Paul Coulton,et al.  Motion controlled mobile 3D multiplayer gaming , 2008, ACE '08.

[24]  I. Scott MacKenzie,et al.  ISO 9241-9 evaluation of video game controllers , 2009, Graphics Interface.

[25]  Chui Yin Wong,et al.  Mobile input devices for gaming experience , 2011, 2011 International Conference on User Science and Engineering (i-USEr ).

[26]  Michael A. Brown,et al.  Beyond the Gamepad: HCI and Game Controller Design and Evaluation , 2015, Game User Experience Evaluation.

[27]  Markus Löchtefeld,et al.  The mighty un-touchables: creating playful engagement on media façades , 2011, Mobile HCI.

[28]  Timo Ojala,et al.  Wordster: collaborative versus competitive gaming using interactive public displays and mobile phones , 2013, PerDis '13.

[29]  I. Scott MacKenzie,et al.  A Comparison of Accelerometer and Touch-based Input for Mobile Gaming , 2013 .

[30]  Peter Fröhlich,et al.  The augmented video wall: multi-user AR interaction with public displays , 2013, CHI Extended Abstracts.

[31]  Andreas Butz,et al.  Multi-user interaction on media facades through live video on mobile devices , 2011, CHI.

[32]  Kevin Browne,et al.  An empirical evaluation of user interfaces for a mobile video game , 2012, Entertain. Comput..

[33]  Aaron J. Quigley,et al.  The cost of display switching: a comparison of mobile, large display and hybrid UI configurations , 2012, AVI.