Survival Analysis: Objective assessment of Wait Time in HCI

Waiting for the completion of a system process is an everyday experience. While waiting, system provides feedback to the user about ongoing process through temporal metaphors (Progress bar, Busy icons, etc.). One of the key performance requirement for temporal metaphors is to retain the user till the process completes. Researchers have evaluated these metaphors through subjective means, and objective assessment has not been well explored. In this paper, we present survival analysis as objective assessment method to evaluate temporal metaphors. Through a field experiment, we demonstrate the application of survival analysis and empirically establish that auditory progress bar (temporal metaphor for audio interfaces) works for callers of a distress helpline. To the best of our knowledge, it is the first study on distress callers. The paper further discusses the applicability of survival analysis for evaluating temporal metaphors and wait time experiments for other applications, tasks, and settings.

[1]  Zhiquan Yeo,et al.  Faster progress bars: manipulating perceived duration with visual augmentations , 2010, CHI.

[2]  Jakob Nielsen,et al.  Chapter 6 – Usability Testing , 1993 .

[3]  Fiona Fui-Hoon Nah,et al.  A study on tolerable waiting time: how long are Web users willing to wait? , 2004, AMCIS.

[4]  M. Pagano,et al.  Survival analysis. , 1996, Nutrition.

[5]  R. Block.  Prospective and Retrospective Duration Judgment: The Role of Information Processing and Memory , 1992 .

[6]  M. Treisman.  Temporal discrimination and the indifference interval. Implications for a model of the "internal clock". , 1963, Psychological monographs.

[7]  Allan Kuchinsky,et al.  Quality is in the eye of the beholder: meeting users' requirements for Internet quality of service , 2000, CHI.

[8]  L. Rüschendorf,et al.  On the Perception of Time , 2009, Gerontology.

[9]  Jeff Sauro,et al.  Average task times in usability tests: what to report? , 2010, CHI 2010.

[10]  Robert Bell,et al.  Rethinking the progress bar , 2007, UIST.

[11]  Ward Whitt,et al.  The Impact of Delay Announcements in Many-Server Queues with Abandonment , 2009, Oper. Res..

[12]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[13]  Yves Dallery,et al.  Call Centers with Delay Information: Models and Insights , 2011, Manuf. Serv. Oper. Manag..

[14]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[15]  Itay Gurvich,et al.  "We Will Be Right with You": Managing Customer Expectations with Vague Promises and Cheap Talk , 2011, Oper. Res..

[16]  A. Rafaeli,et al.  Numbers or apologies? Customer reactions to telephone waiting time fillers. , 2007, The Journal of applied psychology.

[17]  P. Mounoud.  Action and Cognition , 1986 .

[18]  Philip Kortum,et al.  Auditory Progress Bars Preference Performance, and Aesthetics , 2007 .

[19]  D. Zakay.  Attention et jugement temporel , 2005 .

[20]  C. Gallistel,et al.  Toward a neurobiology of temporal cognition: advances and challenges , 1997, Current Opinion in Neurobiology.

[21]  Dan Zakay,et al.  Gating or switching? Gating is a better model of prospective timing (a response to ‘switching or gating?’ by Lejeune) 1 Originally published in Vol. 50, issue 1, pages 1–17; PII of the original publication: S0376-6357(00)00086-3. 1 , 2000, Behavioural Processes.

[22]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[23]  S. Grondin.  Timing and time perception: A review of recent behavioral and neuroscience findings and theoretical directions , 2010, Attention, perception & psychophysics.

[24]  Christopher A. Sanchez,et al.  Feedback Preferences and Impressions of Waiting , 2009, Hum. Factors.

[25]  Carine Lallemand,et al.  Enhancing User eXperience during waiting time in HCI: contributions of cognitive psychology , 2012, DIS '12.

[26]  Richard A. Block,et al.  Cognitive models of psychological time , 1992 .

[27]  Etsuko T. Harada,et al.  Field study of a waiting-time filler delivery system , 2011, Mobile HCI.

[28]  L. Allan.  The influence of the scalar timing model on human timing research , 1998, Behavioural Processes.

[29]  Brad A. Myers,et al.  The importance of percent-done progress indicators for computer-human interfaces , 1985, CHI '85.

[30]  J. Peto,et al.  Asymptotically Efficient Rank Invariant Test Procedures , 1972 .

[31]  Richard A. Bwck.  Prospective and retrospective duration judgments: A meta-analytic review , 1997 .

[32]  P. Hancock,et al.  How cognitive load affects duration judgments: A meta-analytic review. , 2010, Acta psychologica.

[33]  H. Lejeune.  Switching or gating? The attentional challenge in cognitive models of psychological time , 1998, Behavioural Processes.

[34]  Rupert G. Miller,et al.  Survival Analysis , 2022, The SAGE Encyclopedia of Research Design.

[35]  Philip T. Kortum,et al.  Extensible Auditory Progress Bar Design: Performance and Aesthetics , 2011, Int. J. Hum. Comput. Interact..

[36]  Florian Block,et al.  The impact of cognitive load on the perception of time , 2010, NordiCHI.

[37]  Paul D. Feigin.  Analysis of Customer Patience in a Bank Call Center , 2006 .

[38]  R. Church,et al.  Alternative representations of time, number, and rate , 1990, Cognition.

[39]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[40]  Z. Ying,et al.  Rank-based inference for the accelerated failure time model , 2003 .

[41]  Christophe Hurter,et al.  Active progress bars : aiding the switch to temporary activities , 2012 .

[42]  Gad Allon,et al.  The Impact of Delaying the Delay Announcements , 2011, Oper. Res..

[43]  Peter Fröhlich.  Dealing with system response times in interactive speech applications , 2005, CHI EA '05.

[44]  Douglas G Altman,et al.  The logrank test , 2004, BMJ : British Medical Journal.