Put that Hologram there - Probing Mobile Interaction Experiences for a Vision of Mixed Material Public Spaces

Contemporary progress in mobile augmented reality technologies has already introduced novel pervasive displays, such as Microsoft's HoloLens, which allows to display mixed realities containing tangible real and "intangible" holographic objects. In order to allow prototyping and probing such seemingly near-future (urban) interaction experiences, we built a system, which combines a mobile phone with Microsoft's HoloLens and enables exemplary interaction techniques to manipulate "holograms" by combining the capabilities of both these personal and mobile devices. In this paper, we first describe details of this system and then report on a study with 12 participants probing participants' experiences and expectations of a future urban mixed material space. Results of a thematic analysis highlight a two-sided view, in which despite some "fears" of radical change, which may cause a disparity of what (materials) matter more, participants demonstrated a desire to benefit from material complementarity.

[1]  Yvonne Rogers,et al.  HCI Theory: Classical, Modern, and Contemporary , 2012, HCI Theory.

[2]  Arnulph Fuhrmann,et al.  An evaluation of smartphone-based interaction in AR for constrained object manipulation , 2018, VRST.

[3]  Erik Stolterman,et al.  Things That Keep Us Busy: The Elements of Interaction , 2017 .

[4]  Manfred Tscheligi,et al.  Drag and drop the apple: the semantic weight of words and images in touch-based interaction , 2013, TEI '13.

[5]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[6]  Other Contributors Are Indicated Where They Contribute.  The Eclipse Foundation , 2017 .

[7]  Paul Dourish,et al.  Where the action is , 2001 .

[8]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[9]  Manfred Tscheligi,et al.  Materials, materiality, and media , 2013, CHI.

[10]  Ilhan Aslan,et al.  GuideMe: A Mobile Augmented Reality System to Display User Manuals for Home Appliances , 2013, Advances in Computer Entertainment.

[11]  Antonio Krüger,et al.  COMPASS2008: Multimodal, Multilingual and Crosslingual Interaction for Mobile Tourist Guide Applications , 2005, INTETAIN.

[12]  Douglas E. Holmgren.  Design and Construction of a 30-Degree See-Through Head-Mounted Display , 1992 .

[13]  Michael J. McGuffin,et al.  DualCAD: Integrating Augmented Reality with a Desktop GUI and Smartphone Interaction , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[14]  Bernard C. Kress,et al.  11‐1: Invited Paper: Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture Choices , 2017 .

[15]  Elisabeth André,et al.  Of Smarthomes, IoT Plants, and Implicit Interaction Design , 2019, TEI.

[16]  Woontack Woo,et al.  Geometry-Aware Interactive AR Authoring Using a Smartphone in a Wearable AR Environment , 2017, HCI.

[17]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[18]  Hung-Kuo Chu,et al.  Dual-MR: interaction with mixed reality using smartphones , 2018, VRST.

[19]  Paul Dourish,et al.  The Stuff of Bits: An Essay on the Materialities of Information , 2017 .

[20]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[21]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[22]  William W. Gaver.  Technology affordances , 1991, CHI.