Changing Things so (Almost) Everything Stays the Same

Abstract The deployment of mixed reality systems in professional settings demands adaptation of the physical environment and practices. However, technology-driven changes to the environment are problematic in some contexts. Specifically, face-to-face advisory services rely on scripted material routines using specific tools. This manuscript explores challenges encountered during the development of LivePaper, a mixed-reality system for supporting financial advisory services. First, the article presents a range of design requirements derived from existing literature and multiple years of research experience concerning advisory services and physical collaborative environments. Second, it discusses technical and design challenges that emerged when building LivePaper along with those requirements. Third, the article describes a range of technical solutions and new design ideas implemented in a working system to mitigate the encountered problems. It explores potential alternative solutions and delivers empirical or conceptual arguments for the choices made. The manuscript concludes with implications for the advisory services, the systems used to support such encounters, and specific technical guidance for the developers of mixed reality solutions in institutional settings. Overall, the article advances the discourse on the application of technology in advisory services, the use of mixed-reality systems in professional environments, and the physical nature of collaboration.

[1]  Martin J. Eppler,et al.  Visualization in management: From communication to collaboration. A response to Zhang , 2013, J. Vis. Lang. Comput..

[2]  Gerhard Schwabe,et al.  Advisory Service Support that Works , 2020, Proc. ACM Hum. Comput. Interact..

[3]  Norbert A. Streitz,et al.  Roomware for Cooperative Buildings: Integrated Design of Architectural Spaces and Information Spaces , 1998, CoBuild.

[4]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[5]  Helmut Krcmar,et al.  The Design Process for a Computer-Supported Cooperative Work Research Laboratory: The Hohenheim CA Team Room , 1991, J. Manag. Inf. Syst..

[6]  Gerhard Schwabe,et al.  “Enforced” vs. “Casual” Transparency -- Findings from IT-Supported Financial Advisory Encounters , 2012, TMIS.

[7]  Adam Kendon,et al.  Spacing and Orientation in Co-present Interaction , 2009, COST 2102 Training School.

[8]  Andreas Oehler,et al.  Financial Advice Giving and Taking—Where are the Market’s Self-healing Powers and a Functioning Legal Framework When We Need Them? , 2009 .

[9]  Sanna Vehviläinen,et al.  Papers, documents, and the opening of an academic supervision encounter , 2013 .

[10]  Gerhard Schwabe,et al.  Don’t be afraid! Persuasive Practices in the Wild , 2018, Computer Supported Cooperative Work (CSCW).

[11]  Gerhard Schwabe,et al.  Enabling relationship building in tabletop-supported advisory settings , 2014, CSCW.

[12]  Nikolaus F. Troje,et al.  Paper windows: interaction techniques for digital paper , 2005, CHI.

[13]  Gerhard Schwabe,et al.  When the System Does Not Fit: Coping Strategies of Employment Consultants , 2020, Computer Supported Cooperative Work (CSCW).

[14]  Jürgen Steimle Designing pen-and-paper user interfaces for interaction with documents , 2009, Tangible and Embedded Interaction.

[15]  E. McGoun,et al.  From money storage to money store: Openness and transparency in bank architecture , 2013 .

[16]  Gerhard Schwabe (T)Räume der Zusammenarbeit – Probleme und neue Ansätze der Sitzungsunterstützung (Rooms of Cooperation – Problems and New Approaches in Session Support) , 2002, i-com.

[17]  Hiroshi Ishii,et al.  The tangible user interface and its evolution , 2008, CACM.

[18]  Henrik Artman,et al.  Computer Support for Financial Advisors and Their Clients: Co-creating an Investment Plan , 2015, CSCW.

[19]  Susanne Schmidt,et al.  When Joy Matters: The Importance of Hedonic Stimulation in Collocated Collaboration with Large-Displays , 2009, INTERACT.

[20]  Christian Heath,et al.  Swiping paper: the second hand, mundane artifacts, gesture and collaboration , 2010, Personal and Ubiquitous Computing.

[21]  Colin Ware,et al.  Perceiving complex causation through interaction , 2013, CAE '13.

[22]  Jay F. Nunamaker,et al.  Electronic meeting systems , 1991, CACM.

[23]  Pattie Maes,et al.  Mathland: Playful Mathematical Learning in Mixed Reality , 2018, CHI Extended Abstracts.

[24]  Gerhard Schwabe,et al.  Welcome, Computer! How Do Participants Introduce a Collaborative Application During Face-to-Face Interaction? , 2019, INTERACT.

[25]  Meg Withgott What do Objects Mean?: Early Tangibility in and around Interval Research , 2015, Tangible and Embedded Interaction.

[26]  Gerhard Schwabe,et al.  Service encounter thinklets: how to empower service agents to put value co‐creation into practice , 2017, Inf. Syst. J..

[27]  Theo M.M. Verhallen,et al.  Consultative selling in financial services : An observational study of the mortgage mediation process , 1997 .

[28]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[29]  John Zimmerman,et al.  Research Through Design in HCI , 2014, Ways of Knowing in HCI.

[30]  Gerhard Schwabe,et al.  Back in Sight, Back in Mind: Picture-Centric Support for Mobile Counseling Sessions , 2015, CSCW.

[31]  Gary Warnaby,et al.  Augmented Reality and Virtual Reality in Physical and Online Retailing: A Review, Synthesis and Research Agenda , 2018 .

[32]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[33]  Steven E. Clayman,et al.  Talk in Action , 2010 .

[34]  Jürgen Steimle Pen-and-Paper User Interfaces - Integrating Printed and Digital Documents , 2012, Human-Computer Interaction Series.

[35]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[36]  Anijo P. Mathew,et al.  Art, Human Computer Interaction, and Shared Experiences: A Gun Violence Prevention Intervention , 2018, CHI Extended Abstracts.

[37]  Gerhard Schwabe,et al.  Persuasive Practices: Learning from Home Security Advisory Services , 2016, PERSUASIVE.

[38]  Gerhard Schwabe,et al.  Paper Practices in Institutional Talk: How Financial Advisors Impress their Clients , 2017, Computer Supported Cooperative Work (CSCW).

[39]  Gerhard Schwabe,et al.  Unpacking the Artifact Knowledge: Secondary Data Analysis in Design Science Research , 2015, DESRIST.

[40]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[41]  Gerhard Schwabe,et al.  Facilitating Informed Decision-Making in Financial Service Encounters , 2018, Bus. Inf. Syst. Eng..

[42]  Gerhard Schwabe,et al.  Design Thinking in IS Research Projects , 2016 .

[43]  John Seely Brown,et al.  The coming age of calm technolgy , 1997 .

[44]  Tom Rodden,et al.  Data Work: How Energy Advisors and Clients Make IoT Data Accountable , 2017, Computer Supported Cooperative Work (CSCW).

[45]  Roel Vertegaal,et al.  Organic user interfaces: designing computers in any way, shape, or form , 2007, CACM.

[46]  Gerhard Schwabe,et al.  Designing for reintermediation in the brick-and-mortar world: Towards the travel agency of the future , 2009, Electron. Mark..

[47]  Gerhard Schwabe,et al.  Tuning in to More Interactivity – Learning from IT Support for Advisory Service Encounters , 2017, i-com.

[48]  Paul Dourish,et al.  Where the action is , 2001 .

[49]  Oren Zuckerman,et al.  To TUI or not to TUI: Evaluating performance and preference in tangible vs. graphical user interfaces , 2013, Int. J. Hum. Comput. Stud..

[50]  Gerhard Schwabe,et al.  Coercing into Completeness in Financial Advisory Service Encounters , 2015, CSCW.

[51]  William W. Gaver What should we expect from research through design? , 2012, CHI.

[52]  Gerrard Macintosh,et al.  Customer orientation, relationship quality, and relational benefits to the firm , 2007 .

[53]  Gerhard Schwabe,et al.  Pen-and-paper Rituals in Service Interaction , 2019, Proc. ACM Hum. Comput. Interact..

[54]  Robert Xiao,et al.  DIRECT: Making Touch Tracking on Ordinary Surfaces Practical with Hybrid Depth-Infrared Sensing , 2016, ISS.

[55]  T. Pinch,et al.  The Hard Sell: `Patter Merchanting' and the Strategic (Re)Production and Local Management of Economic Reasoning in the Sales Routines of Markt Pitchers , 1986 .

[56]  Daniel D. Mittleman Planning and Design Considerations for Computer Supported Collaboration Spaces , 2009, J. Assoc. Inf. Syst..

[57]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..