Assessing the perceptibility of smartphone notifications in smart lighting spaces

In smart spaces with connected smart lighting, there is an opportunity to deliver smartphone notifications using peripheral light, along with using standard smartphone modalities such as sound, vibration and LEDs, in order to help a user perceive them without constantly monitoring their mobile device. In this paper, we examine the effectiveness of on-device and extra-device modalities through smart lighting. We address a gap in literature by establishing a foundation that explains the role of modalities with which a notification is delivered on a mobile device. For this purpose, we conducted two ecologically valid and carefully designed experiments in a controlled environment that simulates multitasking in a smart home environment, and demonstrate that modality preferences are dependent on the environment context, by analysing subjective user data through a machine learning approach. We derive a set of guidelines for choosing notification modalities and set future research directions.

[1]  Dominik Weber Notifications in a multi-device environment , 2015 .

[2]  Alireza Sahami Shirazi,et al.  Smarttention, please!: 2nd workshop on intelligent attention management on mobile devices , 2016, MobileHCI Adjunct.

[3]  Nicole C. Krämer,et al.  The phantom in my pocket: Determinants of phantom phone sensations , 2015 .

[4]  Karon E. MacLean,et al.  Learning and identifying haptic icons under workload , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[5]  Mirco Musolesi,et al.  Investigating The Role of Task Engagement in Mobile Interruptibility , 2015, MobileHCI Adjunct.

[6]  Enrico Rukzio,et al.  inScent: a wearable olfactory display as an amplification for mobile notifications , 2017, SEMWEB.

[7]  Andreas Komninos,et al.  Perceptibility of Mobile Notification Modalities during Multitasking in Smart Environments , 2018, 2018 14th International Conference on Intelligent Environments (IE).

[8]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[9]  Roel Vertegaal,et al.  AuraOrb: social notification appliance , 2006, CHI EA '06.

[10]  Eamonn O'Neill,et al.  Mobile service audio notifications: intuitive semantics and noises , 2008, OZCHI.

[11]  Mirco Musolesi,et al.  InterruptMe: designing intelligent prompting mechanisms for pervasive applications , 2014, UbiComp.

[12]  Andrii Matviienko,et al.  Deriving design guidelines for ambient light systems , 2015, MUM.

[13]  Niels Henze,et al.  UbiTtention: smart & ambient notification and attention management , 2016, UbiComp Adjunct.

[14]  Tom Gross Ambient Interfaces : Design Challenges and Recommendations , 2003 .

[15]  Susanne Boll,et al.  Sparkle: an ambient light display for dynamic off-screen points of interest , 2014, NordiCHI.

[16]  Mirco Musolesi,et al.  My Phone and Me: Understanding People's Receptivity to Mobile Notifications , 2016, CHI.

[17]  José A. Gallud,et al.  Smartphone Notifications: A Study on the Sound to Soundless Tendency , 2015, MobileHCI Adjunct.

[18]  Martin Pielot,et al.  Didn't you see my message?: predicting attentiveness to mobile instant messages , 2014, CHI.

[19]  David V. Keyson,et al.  Considerate home notification systems: A user study of acceptability of notifications in a living-room laboratory , 2009, Int. J. Hum. Comput. Stud..

[20]  Susanne Boll,et al.  Sensor-Based Identification of Opportune Moments for Triggering Notifications , 2014, IEEE Pervasive Computing.

[21]  Tatsuo Nakajima,et al.  Augmenting everyday life with sentient artefacts , 2005, sOc-EUSAI '05.

[22]  Tadashi Okoshi,et al.  Attelia: Reducing user's cognitive load due to interruptive notifications on smart phones , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[23]  Irene Mavrommati,et al.  An architecture that treats everyday objects as communicating tangible components , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[24]  Michael Haller,et al.  Glowworms and Fireflies: Ambient Light on Large Interactive Surfaces , 2016, CHI.

[25]  Alireza Sahami Shirazi,et al.  Exploring ambient visualizations of context information , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[26]  Martin Pielot,et al.  Ambient Timer - Unobtrusively Reminding Users of Upcoming Tasks with Ambient Light , 2013, INTERACT.

[27]  Andreas Komninos,et al.  Predicting User Responsiveness to Smartphone Notifications for Edge Computing , 2018, AmI.

[28]  Alireza Sahami Shirazi,et al.  Large-scale assessment of mobile notifications , 2014, CHI.

[29]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[30]  Jeremy R. Cooperstock,et al.  Pseudo-Ambience: Filling the Gap Between Notifications and Continuous Information Displays , 2018, UbiComp/ISWC Adjunct.

[31]  Ardalan Amiri Sani,et al.  Understanding Sensor Notifications on Mobile Devices , 2017, HotMobile.

[32]  Lucio Marcenaro,et al.  Effects of Ambient Lighting Displays on Peripheral Activity Awareness , 2017, IEEE Access.

[33]  Mirco Musolesi,et al.  Designing content-driven intelligent notification mechanisms for mobile applications , 2015, UbiComp.

[34]  Fahim Kawsar,et al.  The myth of subtle notifications , 2014, UbiComp Adjunct.

[35]  Martin Pielot,et al.  Dismissed!: a detailed exploration of how mobile phone users handle push notifications , 2018, MobileHCI.

[36]  Michael Beigl,et al.  Investigating the perceptibility different notification types on smartphones depending on the smartphone position , 2017, UbiComp/ISWC Adjunct.

[37]  Martin Pielot,et al.  An in-situ study of mobile phone notifications , 2014, MobileHCI '14.

[38]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.

[39]  John C. Tang,et al.  Investigating Mobile Users' Ringer Mode Usage and Attentiveness and Responsiveness to Communication , 2015, MobileHCI.

[40]  Peter Ljungstrand,et al.  Subtle and Public Notification Cues for Mobile Devices , 2001, UbiComp.

[41]  A. J. Bernheim Brush,et al.  Phoneprioception: enabling mobile phones to infer where they are kept , 2013, CHI.

[42]  Dominik Weber Towards smart notification management in multi-device environments , 2017, MobileHCI.

[43]  Alireza Sahami Shirazi,et al.  Assessment of Notifications on Smartwatches , 2015, MobileHCI Adjunct.

[44]  Katarzyna Wac,et al.  Getting closer: an empirical investigation of the proximity of user to their smart phones , 2011, UbiComp '11.

[45]  Andrii Matviienko,et al.  Towards New Ambient Light Systems: a Close Look at Existing Encodings of Ambient Light Systems , 2015, IxD&A.

[46]  Michael Rohs,et al.  ScatterWatch: subtle notifications via indirect illumination scattered in the skin , 2016, MobileHCI.

[47]  Stuart M. Allen,et al.  Pervasive and Mobile Computing , 2022 .

[48]  Alireza Sahami Shirazi,et al.  Smarttention, Please! Intelligent Attention Management on Mobile Devices , 2015, MobileHCI Adjunct.

[49]  Michael Rohs,et al.  Dynamic ambient lighting for mobile devices , 2011, UIST '11 Adjunct.

[50]  Fabian Hemmert Ambient Life: Calm and Excited Pulsation as a Means of Life-like Permanent Tactile Status Display in Mobile Phones , 2008 .