Characterizing and Predicting Email Deferral Behavior

Email triage involves going throughunhandled emails and deciding what to do with them. This familiar process can become increasingly challenging as the number of unhandled email grows. During a triage session, users commonlydefer handling emails that they cannot immediately deal with to later. These deferred emails, are often related to tasks that are postponed until the user has more time or the right information to deal with them. In this paper, through qualitative interviews and a large-scale log analysis, we study when and whatenterprise email users tend to defer. We found that users are more likely to defer emails when handling them involves replying, reading carefully, or clicking on links and attachments. We also learned that the decision to defer emails depends on many factors such as user's workload and the importance of the sender. Our qualitative results suggested that deferring is very common, and our quantitative log analysis confirms that 12% of triage sessions and 16% of daily active users had at least one deferred email on weekdays. We also discuss severaldeferral strategies such as marking emails as unread and flagging that are reported by our interviewees, and illustrate how such patterns can be also observed in user logs. Inspired by the characteristics of deferred emails and contextual factors involved in deciding if an email should be deferred, we train a classifier for predicting whether a recently triaged email is actually deferred. Our experimental results suggests that deferral can be classified with modest effectiveness. Overall, our work provides novel insights about how users handle their emails and how deferral can be modeled.

[1]  Anoop Gupta,et al.  Supporting Email Workflow , 2001 .

[2]  Robert E. Kraut,et al.  Email overload at work: an analysis of factors associated with email strain , 2006, IEEE Engineering Management Review.

[3]  Victoria Bellotti,et al.  E-mail as habitat: an exploration of embedded personal information management , 2001, INTR.

[4]  Jacek Gwizdka,et al.  TaskView: design and evaluation of a task-based email interface , 2002, CASCON.

[5]  Susan T. Dumais,et al.  The Lifetime of Email Messages: A Large-Scale Analysis of Email Revisitation , 2018, CHIIR.

[6]  Anthony Tang,et al.  Going with the flow: email awareness and task management , 2006, CSCW '06.

[7]  John C. Tang,et al.  Am I wasting my time organizing email?: a study of email refinding , 2011, CHI.

[8]  Yoelle Maarek,et al.  How Many Folders Do You Really Need?: Classifying Email into a Handful of Categories , 2014, CIKM.

[9]  Susan T. Dumais,et al.  Characterizing Email Search using Large-scale Behavioral Logs and Surveys , 2017, WWW.

[10]  Eric Horvitz,et al.  Balancing Awareness and Interruption: Investigation of Notification Deferral Policies , 2005, User Modeling.

[11]  Wendy E. Mackay,et al.  More than just a communication system: diversity in the use of electronic mail , 1988, CSCW '88.

[12]  Candace L. Sidner,et al.  Email overload: exploring personal information management of email , 1996, CHI.

[13]  Dotan Di Castro,et al.  You've got Mail, and Here is What you Could do With It!: Analyzing and Predicting Actions on Email Messages , 2016, WSDM.

[14]  Eric Gilbert,et al.  Overload is overloaded: email in the age of Gmail , 2014, CHI.

[15]  Carman Neustaedter,et al.  Beyond "from" and "received": exploring the dynamics of email triage , 2005, CHI Extended Abstracts.

[16]  Martin Hacker,et al.  Understanding re-finding behavior in naturalistic email interaction logs , 2011, SIGIR '11.

[17]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[18]  Susan T. Dumais,et al.  Large-Scale Analysis of Email Search and Organizational Strategies , 2017, CHIIR.

[19]  Raghavendra Udupa,et al.  InLook: Revisiting Email Search Experience , 2016, SIGIR.

[20]  Jacek Gwizdka,et al.  Email task management styles: the cleaners and the keepers , 2004, CHI EA '04.

[21]  Robert E. Kraut,et al.  Should I open this email?: inbox-level cues, curiosity and attention to email , 2011, CHI.

[22]  Rosie Jones,et al.  Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs , 2008, CIKM '08.

[23]  A. J. Bernheim Brush,et al.  Revisiting Whittaker & Sidner's "email overload" ten years later , 2006, CSCW '06.

[24]  Susan T. Dumais,et al.  Characterizing and Predicting Enterprise Email Reply Behavior , 2017, SIGIR.

[25]  Ian Smith,et al.  Taking email to task: the design and evaluation of a task management centered email tool , 2003, CHI '03.

[26]  Yoram M. Kalman,et al.  Filing, piling, and everything in between: The dynamics of E‐mail inbox management , 2015, J. Assoc. Inf. Sci. Technol..

[27]  Jeffrey S. Pierce,et al.  IBM Research Report No Smart Phone Is an Island: The Impact of Places, Situations, and Other Devices on Smart Phone Use , 2009 .

[28]  Susan T. Dumais,et al.  Stuff I've Seen: A System for Personal Information Retrieval and Re-Use , 2003, SIGF.

[29]  John C. Tang,et al.  When Can I Expect an Email Response? A Study of Rhythms in Email Usage , 2003, ECSCW.