Perceptibility of Mobile Notification Modalities during Multitasking in Smart Environments

Smartphone notifications are a major source of interaction with mobile devices. In this paper we address a gap in literature by establishing a foundation that explains the role of modalities with which a notification is delivered on a mobile device. Though previous studies have attempted to address this question, we find that they suffer from significant internal validity problems. As such we conducted an ecologically valid and carefully designed experiment in a controlled environment that simulates a smart home environment. Our work extends into smart environments, by examining a new modality, implemented by pairing the smartphone to a connected lighting system and replicating mobile notifications to smart light bulbs in the user's field of vision. We derive a set of guidelines for choosing notification modalities and set future research directions.

[1]  Karon E. MacLean,et al.  Learning and identifying haptic icons under workload , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[2]  Alireza Sahami Shirazi,et al.  Smarttention, please!: 2nd workshop on intelligent attention management on mobile devices , 2016, MobileHCI Adjunct.

[3]  Andrii Matviienko,et al.  Towards New Ambient Light Systems: a Close Look at Existing Encodings of Ambient Light Systems , 2015, IxD&A.

[4]  Tadashi Okoshi,et al.  Attelia: Reducing user's cognitive load due to interruptive notifications on smart phones , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[5]  Dominik Weber.  Notifications in a multi-device environment , 2015 .

[6]  Irene Mavrommati,et al.  An architecture that treats everyday objects as communicating tangible components , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[7]  Michael Haller,et al.  Glowworms and Fireflies: Ambient Light on Large Interactive Surfaces , 2016, CHI.

[8]  Susanne Boll,et al.  Sensor-Based Identification of Opportune Moments for Triggering Notifications , 2014, IEEE Pervasive Computing.

[9]  M. Pantti.  GETTING CLOSER? , 2013 .

[10]  Mirco Musolesi,et al.  Designing content-driven intelligent notification mechanisms for mobile applications , 2015, UbiComp.

[11]  Tom Gross.  Ambient Interfaces : Design Challenges and Recommendations , 2003 .

[12]  Susanne Boll,et al.  Sparkle: an ambient light display for dynamic off-screen points of interest , 2014, NordiCHI.

[13]  Alireza Sahami Shirazi,et al.  Exploring ambient visualizations of context information , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[14]  Fahim Kawsar,et al.  The myth of subtle notifications , 2014, UbiComp Adjunct.

[15]  Martin Pielot,et al.  An in-situ study of mobile phone notifications , 2014, MobileHCI '14.

[16]  Martin Pielot,et al.  Ambient Timer - Unobtrusively Reminding Users of Upcoming Tasks with Ambient Light , 2013, INTERACT.

[17]  Alireza Sahami Shirazi,et al.  Large-scale assessment of mobile notifications , 2014, CHI.

[18]  Andrii Matviienko,et al.  Deriving design guidelines for ambient light systems , 2015, MUM.

[19]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[20]  Fabian Hemmert.  Ambient Life: Calm and Excited Pulsation as a Means of Life-like Permanent Tactile Status Display in Mobile Phones , 2008 .

[21]  Alireza Sahami Shirazi,et al.  Smarttention, Please! Intelligent Attention Management on Mobile Devices , 2015, MobileHCI Adjunct.

[22]  Michael Rohs,et al.  Dynamic ambient lighting for mobile devices , 2011, UIST '11 Adjunct.

[23]  José A. Gallud,et al.  Smartphone Notifications: A Study on the Sound to Soundless Tendency , 2015, MobileHCI Adjunct.

[24]  Martin Pielot,et al.  Didn't you see my message?: predicting attentiveness to mobile instant messages , 2014, CHI.

[25]  Mirco Musolesi,et al.  Investigating The Role of Task Engagement in Mobile Interruptibility , 2015, MobileHCI Adjunct.

[26]  Nicole C. Krämer,et al.  The phantom in my pocket: Determinants of phantom phone sensations , 2015 .

[27]  David V. Keyson,et al.  Considerate home notification systems: A user study of acceptability of notifications in a living-room laboratory , 2009, Int. J. Hum. Comput. Stud..

[28]  Peter Ljungstrand,et al.  Subtle and Public Notification Cues for Mobile Devices , 2001, UbiComp.

[29]  A. J. Bernheim Brush,et al.  Phoneprioception: enabling mobile phones to infer where they are kept , 2013, CHI.

[30]  Tatsuo Nakajima,et al.  Augmenting everyday life with sentient artefacts , 2005, sOc-EUSAI '05.

[31]  Eamonn O'Neill,et al.  Mobile service audio notifications: intuitive semantics and noises , 2008, OZCHI.

[32]  Alireza Sahami Shirazi,et al.  Assessment of Notifications on Smartwatches , 2015, MobileHCI Adjunct.

[33]  John C. Tang,et al.  Investigating Mobile Users' Ringer Mode Usage and Attentiveness and Responsiveness to Communication , 2015, MobileHCI.