TV Channels in Your Pocket! Linking Smart Pockets to Smart TVs

We present a gesture-based user interface for smart TVs that employs deictic gestures to control the content displayed on the TV screen. Our interface implements an instance of the “Smart-Pockets” interaction technique, where links to digital content, in our case to users’ preferred television channels and shows, are stored inside users’ pockets and readily accessible with a mere pointing of the hand to those pockets. Pointing gestures to the pockets and towards the TV screen are detected using the Inertial Measurement Unit embedded in Myo, a smart armband. We discuss the ways in which our prototype opens new opportunities for hybrid, gesture- and pointing-based interactions for smart TVs as well as opportunities for designing interactions that take place at the periphery of user attention.

[1]  Radu-Daniel Vatavu,et al.  Leap gestures for TV: insights from an elicitation study , 2014, TVX.

[2]  Du Q. Huynh,et al.  Metrics for 3D Rotations: Comparison and Analysis , 2009, Journal of Mathematical Imaging and Vision.

[3]  Radu-Daniel Vatavu,et al.  Perceived Usability, Desirability, and Workload of Mid-Air Gesture Control for Smart TVs , 2018, RoCHI.

[4]  Jimmy J. Lin,et al.  Talking to Your TV: Context-Aware Voice Search with Hierarchical Recurrent Neural Networks , 2017, CIKM.

[5]  Sayan Sarcar,et al.  Designing Mid-Air TV Gestures for Blind People Using User- and Choice-Based Elicitation Approaches , 2016, Conference on Designing Interactive Systems.

[6]  Jean Vanderdonckt,et al.  Gestures for Smart Rings: Empirical Results, Insights, and Design Implications , 2018, Conference on Designing Interactive Systems.

[7]  Gilles Bailly,et al.  Gesture-aware remote controls: guidelines and interaction technique , 2011, ICMI '11.

[8]  Lars Bo Larsen,et al.  Gestures for Controlling a Moveable TV , 2018, TVX.

[9]  Manfred Tscheligi,et al.  Tablet, gestures, remote control?: influence of age on performance and user experience with iTV applications , 2014, TVX.

[10]  Min-Chun Hu,et al.  Immersive virtual reality with multimodal interaction and streaming technology , 2016, ICMI.

[11]  Radu-Daniel Vatavu,et al.  User-defined gestures for free-hand TV control , 2012, EuroITV.

[12]  Dong-Hoon Lee,et al.  Remote Application Control Technology and Implementation of HTML5-based Smart TV Platform , 2016, MoMM.

[13]  Radu-Daniel Vatavu,et al.  There's a world outside your TV: exploring interactions beyond the physical TV screen , 2013, EuroITV.

[14]  Elise van den Hoven,et al.  Facilitating peripheral interaction: design and evaluation of peripheral interaction for a gesture-based lighting control with multimodal feedback , 2016, Personal and Ubiquitous Computing.

[15]  David R. Flatla,et al.  Designing Game-Based Myoelectric Prosthesis Training , 2017, CHI.

[16]  Radu-Daniel Vatavu,et al.  Smart-Pockets: Body-deictic gestures for fast access to personal data during ambient interactions , 2017, Int. J. Hum. Comput. Stud..

[17]  Juha Röning,et al.  MyoGym: introducing an open gym data set for activity recognition collected using myo armband , 2017, UbiComp/ISWC Adjunct.