UI Testing Cross-Device Applications

The increasing number of devices available to a user has prompted the research community to explore how these can be used in combination. Frameworks and toolkits have been proposed to facilitate the design and implementation of these cross-device applications. Still, implementing cross-device applications remains complex because of the fragmentation of the user interface and logic across devices and the flexibility required to adapt to different combinations of devices. Testing in particular has been identified as a critical challenge. To address these issues, we introduce XD-Testing, a library that provides explicit and implicit device selectors, device templates and scenarios, as well as a visualiser for application screenshots. In a case study, we demonstrate how we used the library to author human-readable tests for a cross-device gallery that verify if a UI distributes correctly and if it works as expected despite being distributed.

[1]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[2]  Jeffrey Nichols,et al.  Understanding the Challenges of Designing and Developing Multi-Device Experiences , 2016, Conference on Designing Interactive Systems.

[3]  Linda Di Geronimo,et al.  XD-Bike: A Cross-Device Repository of Mountain Biking Routes , 2016, ICWE Workshops.

[4]  Volker Gruhn,et al.  Automating UI tests for mobile applications with formal gesture descriptions , 2014, MobileHCI '14.

[5]  Moira C. Norrie,et al.  XDSession: integrated development and testing of cross-device applications , 2015, EICS.

[6]  Paolo Tell,et al.  ActivitySpace: Managing Device Ecologies in an Activity-Centric Configuration Space , 2014, ITS '14.

[7]  Norbert A. Streitz,et al.  An interactive Landscape for Creativity and Innovation , 1999 .

[8]  Daniel J. Wigdor,et al.  Conductor: enabling and understanding cross-device interaction , 2014, CHI.

[9]  Daniel J. Wigdor,et al.  Panelrama: enabling easy specification of cross-device web applications , 2014, CHI.

[10]  Roman Rädle,et al.  When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets , 2016, CHI.

[11]  Wendy E. Mackay,et al.  Webstrates: Shareable Dynamic Media , 2015, UIST.

[12]  Linda Di Geronimo,et al.  Surveying personal device ecosystems with cross-device applications in mind , 2016, PerDis.

[13]  Yang Li,et al.  Weave: Scripting Cross-Device Wearable Interaction , 2015, CHI.

[14]  Bernd Bruegge,et al.  Object-Oriented Software Engineering: Using UML, Patterns and Java, Second Edition , 2003 .

[15]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[16]  Paolo Tonella,et al.  Capture-replay vs. programmable web testing: An empirical assessment during test case evolution , 2013, 2013 20th Working Conference on Reverse Engineering (WCRE).

[17]  Timo Ojala,et al.  Testdroid: automated remote UI testing on Android , 2012, MUM.

[18]  Yuxi Wang,et al.  SoD-Toolkit: A Toolkit for Interactively Prototyping and Developing Multi-Sensor, Multi-Device Environments , 2015, ITS.

[19]  James R. Eagan,et al.  Shared substance: developing flexible multi-surface applications , 2011, CHI.

[20]  Moira C. Norrie,et al.  Interactive development of cross-device user interfaces , 2014, CHI.

[21]  Fabio Paternò,et al.  Authoring context-dependent cross-device user interfaces based on trigger/action rules , 2015, MUM.

[22]  Cesare Pautasso,et al.  Towards Liquid Web Applications , 2015, ICWE.

[23]  Niklas Elmqvist,et al.  PolyChrome: A Cross-Device Framework for Collaborative Web Visualization , 2014, ITS '14.

[24]  Roman Rädle,et al.  Connichiwa: A Framework for Cross-Device Web Applications , 2015, CHI Extended Abstracts.

[25]  Andreas Kornstädt,et al.  Web Application Tests with Selenium , 2009, IEEE Software.

[26]  Daniel J. Wigdor,et al.  A field study of multi-device workflows in distributed workspaces , 2013, UbiComp.

[27]  Yvonne Rogers,et al.  HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration , 2014, ITS '14.

[28]  Bernd Bruegge,et al.  Object-Oriented Software Engineering Using UML, Patterns, and Java , 2009 .

[29]  Saul Greenberg,et al.  Cross-device interaction via micro-mobility and f-formations , 2012, UIST.

[30]  Moira C. Norrie,et al.  Is a framework enough?: cross-device testing and debugging , 2016, EICS.

[31]  Yang Li,et al.  Enhancing Cross-Device Interaction Scripting with Interactive Illustrations , 2016, CHI.

[32]  Zahra Shakeri Hossein Abad,et al.  Multi Surface Interactions with Geospatial Data: A Systematic Review , 2014, ITS '14.

[33]  Morten Fjeld,et al.  RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions , 2016, CHI.