Bendtroller:: An Exploration of In-Game Action Mappings with a Deformable Game Controller

We explore controller input mappings for games using a deformable prototype that combines deformation gestures with standard button input. In study one, we tested discrete gestures using three simple games. We categorized the control schemes as binary (button only), action, and navigation, the latter two named based on the game mechanics mapped to the gestures. We found that the binary scheme performed the best, but gesture-based control schemes are stimulating and appealing. Results also suggest that the deformation gestures are best mapped to simple and natural tasks. In study two, we tested continuous gestures in a 3D racing game using the same control scheme categorization. Results were mostly consistent with study one but showed an improvement in performance and preference for the action control scheme.

[1]  Xu Jia,et al.  How users manipulate deformable displays as input devices , 2010, CHI.

[2]  Sana Maqsood,et al.  Passwords on flexible display devices. , 2013, CCS 2013.

[3]  Dan Ionescu,et al.  A Multimodal Interaction Method that Combines Gestures and Physical Game Controllers , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[4]  Jessica Lo Bendy: An Exploration into Gaming with Mobile Flexible Devices , 2013 .

[5]  Sang Ho Yoon,et al.  BendID: flexible interface for localized deformation recognition , 2014, UbiComp.

[6]  Audrey Girouard,et al.  Visual Feedforward Guides for Performing Bend Gestures on Deformable Prototypes , 2016, Graphics Interface.

[7]  Roel Vertegaal,et al.  FlexView: an evaluation of depth navigation on deformable mobile devices , 2013, TEI '13.

[8]  Sonia Chiasson,et al.  POSTER: Passwords on flexible display devices , 2013, CCS.

[9]  Devina Ramduny-Ellis,et al.  The VoodooIO gaming kit: a real-time adaptable gaming controller , 2007, Comput. Entertain..

[10]  Pramod Kumar,et al.  SOFTii: Soft Tangible Interface for Continuous Control of Virtual Objects with Pressure-based Input , 2015, TEI.

[11]  Villarnicolas,et al.  The VoodooIO gaming kit , 2007 .

[12]  Jun-ichiro Watanabe,et al.  Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages , 2008, UbiComp.

[13]  Thomas P. B. Smith Squidge: an integrated game controller , 2013, CHI Extended Abstracts.

[14]  Fletcher Black,et al.  Sonic the Hedgehog , 2006 .

[15]  Roel Vertegaal,et al.  Snaplet: using body shape to inform function in mobile flexible display devices , 2011, CHI Extended Abstracts.

[16]  Paul Skalski,et al.  Mapping the road to fun: Natural video game controllers, presence, and game enjoyment , 2011, New Media Soc..

[17]  Peta Wyeth,et al.  Natural mapping and intuitive interaction in videogames , 2014, CHI PLAY.

[18]  Tohru Hoshi,et al.  SHAPIO: Shape I/O Controller for Video Games , 2015, CHI PLAY.

[19]  Md Riyadh Exploring tapping with thumb input for flexible tablets , 2014, CHI Extended Abstracts.

[20]  Jan O. Borchers,et al.  Twend: twisting and bending as new interaction gesture in mobile devices , 2008, CHI Extended Abstracts.

[21]  Johannes Schöning,et al.  Paddle: highly deformable mobile devices with physical controls , 2014, CHI Extended Abstracts.

[22]  Gary W. Meyer,et al.  A handheld flexible display system , 2005, VIS 05. IEEE Visualization, 2005..

[23]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[24]  Kasper Hornbæk,et al.  Deformable Interfaces for Performing Music , 2015, CHI.

[25]  Wonkyum Lee,et al.  FlexRemote: Exploring the Effectiveness of Deformable User Interface as an Input Device for TV , 2011, HCI.

[26]  Roel Vertegaal,et al.  PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays , 2011, CHI.

[27]  Roel Vertegaal,et al.  MagicWand: Exploring Physical Affordances with a Handheld Cylindrical Display Object , 2016, CHI Extended Abstracts.

[28]  David Kim,et al.  FlexSense: a transparent self-sensing deformable surface , 2014, UIST.

[29]  Ivan Poupyrev,et al.  Gummi: a bendable computer , 2004, CHI '04.

[30]  Susanna Paasovaara,et al.  Kinetic device: designing interactions with a deformable mobile interface , 2012, CHI Extended Abstracts.

[31]  Andrés Lucero,et al.  Twisting touch: combining deformation and touch as input within the same interaction cycle on handheld devices , 2013, MobileHCI '13.

[32]  Teemu Tuomas Ahmaniemi,et al.  What is a device bend gesture really good for? , 2014, CHI.

[33]  Zi Ye,et al.  Cobra: flexible displays for mobilegaming scenarios , 2010, CHI EA '10.

[34]  Pattie Maes,et al.  Flexpad: highly flexible bending interactions for projected handheld displays , 2013, CHI.