ARCord: Visually Augmented Interactive Cords for Mobile Interaction

Research on wearable controllers has shown that body-worn cords have many interesting physical affordances that make them powerful as a novel input device to control mobile applications in an unobtrusive manner. With this paper, we want to extend the interaction and application repertoire of body-worn cords by contributing the concept of visually augmented interactive cords using state-of-the-art augmented reality (AR) glasses. This novel combination of simultaneous input and output on a cord has the potential to create rich AR user interfaces that seamlessly support direct interaction and reduce cognitive burden by providing visual and tactile feedback. As a main contribution, we present a set of cord-based interaction techniques for browsing menus, selecting items, adjusting continuous values & ranges and solving advanced tasks in AR. In addition, we present our current implementation including different touch-enabled cords, its data transmission and AR visualization. Finally, we conclude with future challenges.

[1]  Enrico Rukzio,et al.  PocketThumb: a Wearable Dual-Sided Touch Interface for Cursor-based Control of Smart-Eyewear , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  George W. Fitzmaurice,et al.  Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip , 1999, SI3D.

[3]  Joseph A. Paradiso,et al.  SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape , 2015, UIST.

[4]  Chris Harrison,et al.  Cord input: an intuitive, high-accuracy, multi-degree-of-freedom input method for mobile devices , 2010, CHI.

[5]  Steven K. Feiner,et al.  Prototyping retractable string-based interaction techniques for dual-display mobile devices , 2006, CHI.

[6]  Raimund Dachselt,et al.  Elasticcon: Elastic Controllers for Casual Interaction , 2015, MobileHCI.

[7]  Alex Olwal,et al.  SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline , 2017, UIST.

[8]  Jürgen Steimle,et al.  DeformWear , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[9]  Steven K. Feiner,et al.  Opportunistic Tangible User Interfaces for Augmented Reality , 2010, IEEE Transactions on Visualization and Computer Graphics.

[10]  Hendrik Witt,et al.  Prototyping a chest-worn string-based wearable input device , 2008, 2008 International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[11]  Hiroshi Ishii,et al.  Cord UIs: Controlling Devices with Augmented Cables , 2015, TEI.

[12]  Ivan Poupyrev,et al.  Project Jacquard: Interactive Digital Textiles at Scale , 2016, CHI.

[13]  Steve Hodges,et al.  An interactive belt-worn badge with a retractable string-based input mechanism , 2013, CHI.