SurfaceConstellations: A Modular Hardware Platform for Ad-Hoc Reconfigurable Cross-Device Workspaces

We contribute SurfaceConstellations, a modular hardware platform for linking multiple mobile devices to easily create novel cross-device workspace environments. Our platform combines the advantages of multi-monitor workspaces and multi-surface environments with the flexibility and extensibility of more recent cross-device setups. The SurfaceConstellations platform includes a comprehensive library of 3D-printed link modules to connect and arrange tablets into new workspaces, several strategies for designing setups, and a visual configuration tool for automatically generating link modules. We contribute a detailed design space of cross-device workspaces, a technique for capacitive links between tablets for automatic recognition of connected devices, designs of flexible joint connections, detailed explanations of the physical design of 3D printed brackets and support structures, and the design of a web-based tool for creating new SurfaceConstellation setups.

[1]  Michael Nebeling,et al.  XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces , 2017, CHI.

[2]  Johannes Schöning,et al.  Visual separation in mobile multi-display environments , 2011, UIST.

[3]  Yvonne Rogers,et al.  HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration , 2014, ITS '14.

[4]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[5]  Andrés Lucero,et al.  Pass-them-around: collaborative use of mobile phones for photo sharing , 2011, CHI.

[6]  Carl Gutwin,et al.  Perspective cursor: perspective-based interaction for multi-display environments , 2006, CHI.

[7]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[8]  Yuichi Itoh,et al.  PUCs: detecting transparent, passive untouched capacitive widgets on unmodified multi-touch displays , 2013, ITS.

[9]  Homei Miyashita,et al.  3D Printed Physical Interfaces that can Extend Touch Devices , 2016, UIST.

[10]  Ming Li,et al.  Dynamic tiling display: building an interactive display surface using multiple mobile devices , 2012, MUM.

[11]  Ken Hinckley,et al.  Synchronous gestures for multiple persons and computers , 2003, UIST '03.

[12]  Li-Wei Chan,et al.  TUIC: enabling tangible interaction on capacitive multi-touch displays , 2011, CHI.

[13]  Norbert A. Streitz,et al.  Connectables: dynamic coupling of displays for the flexible creation of shared workspaces , 2001, UIST '01.

[14]  Mike Y. Chen,et al.  Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls , 2011, UIST '11.

[15]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[16]  Brian P. Bailey,et al.  ARIS: An Interface for Application Relocation in an Interactive Space , 2004, Graphics Interface.

[17]  Colin Ware,et al.  The DragMag image magnifier , 1995, CHI 95 Conference Companion.

[18]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[19]  Homei Miyashita,et al.  ExtensionSticker: A Proposal for a Striped Pattern Sticker to Extend Touch Interfaces and its Assessment , 2015, CHI.

[20]  Kasper Hornbæk,et al.  Tracko: Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction , 2015, UIST.

[21]  Teddy Seyed,et al.  SkyHunter: a multi-surface environment for supporting oil and gas exploration , 2013, ITS.

[22]  Moira C. Norrie,et al.  XDSession: integrated development and testing of cross-device applications , 2015, EICS.

[23]  Dominik Schmidt.  PhoneTouch: a technique for direct phone interaction on surfaces , 2010, ITS '10.

[24]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[25]  Andreas Butz,et al.  Curve: revisiting the digital desk , 2010, NordiCHI.

[26]  Nicholas Chen,et al.  Graduate student use of a multi-slate reading system , 2013, CHI.

[27]  Gudrun Klinker,et al.  Seamless integration of mobile devices into interactive surface environments , 2012, ITS '12.

[28]  Hao Jiang,et al.  WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system , 2009, CHI.

[29]  Stefanie Müller,et al.  CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens , 2012, CHI.

[30]  Yvonne Rogers,et al.  Dynamo: a public interactive surface supporting the cooperative sharing and exchange of media , 2003, UIST '03.

[31]  Wendy E. Mackay,et al.  Webstrates: Shareable Dynamic Media , 2015, UIST.

[32]  Andrew Wilson,et al.  Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices , 2012, CHI.

[33]  Jonathan Grudin,et al.  Partitioning digital worlds: focal and peripheral awareness in multiple monitor use , 2001, CHI.

[34]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[35]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[36]  Enrico Rukzio,et al.  Penbook: bringing pen+paper interaction to a tablet device to facilitate paper-based workflows in the hospital domain , 2013, ITS.

[37]  Morten Fjeld,et al.  RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions , 2016, CHI.

[38]  Khai N. Truong,et al.  Determining the orientation of proximate mobile devices using their back facing camera , 2012, CHI.

[39]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[40]  Ravin Balakrishnan,et al.  Codex: a dual screen tablet computer , 2009, CHI.

[41]  Daniel Vogel,et al.  Doppio: A Reconfigurable Dual-Face Smartwatch for Tangible Interaction , 2016, CHI.

[42]  Daniel J. Wigdor,et al.  Conductor: enabling and understanding cross-device interaction , 2014, CHI.

[43]  Morten Fjeld,et al.  Thaddeus: a dual device interaction space for exploring information visualisation , 2014, NordiCHI.

[44]  Chris North,et al.  VisPorter: facilitating information sharing for collaborative sensemaking on multiple displays , 2014, Personal and Ubiquitous Computing.

[45]  Nicholas Chen,et al.  Navigation techniques for dual-display e-book readers , 2008, CHI.

[46]  Yvonne Rogers,et al.  Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions , 2015, CHI.

[47]  Teddy Seyed,et al.  ePlan Multi-Surface: A Multi-Surface Environment for Emergency Response Planning Exercises , 2014, ITS '14.

[48]  Jan O. Borchers,et al.  BendDesk: dragging across the curve , 2010, ITS '10.

[49]  Roman Rädle,et al.  Connichiwa: A Framework for Cross-Device Web Applications , 2015, CHI Extended Abstracts.

[50]  Jan O. Borchers,et al.  PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays , 2015, UIST.