Reinforcement learning and the prevention of data catastrophes

Companies incur immense losses due to employee neglect to save and back up data and failure to frequently update anti‐virus protections. This problem appears perplexing as such oversights are clearly neither in the organization’s nor in the employees’ best interest. We review the possible reasons for this phenomenon arising from studies of social dilemmas, unrealistic optimism, and reinforcement learning. We follow with three examples of “under‐saving” behavior. The results reveal that in all three cases computer users, novices and experts, feel that they do not save enough. This feeling is consistent with the reinforcement learning account. People think that they are less careful than they wish to be. The implications of this observation are discussed.

[1]  N. Weinstein Unrealistic optimism about future life events , 1980 .

[2]  Peter R. Harris,et al.  Sufficient grounds for optimism? The relationship between perceived controllability and optimistic bias , 1996 .

[3]  R. Thaler Some empirical evidence on dynamic inconsistency , 1981 .

[4]  P. Cohen,et al.  Punishment: the interactive effects of delay and intensity of shock. , 1968, Journal of the experimental analysis of behavior.

[5]  E. Langer The illusion of control. , 1975 .

[6]  Ido Erev,et al.  Constructive Intergroup Competition as a Solution to the Free Rider Problem: A Field Experiment , 1993 .

[7]  L. Kamin,et al.  The delay-of-punishment gradient. , 1959, Journal of comparative and physiological psychology.

[8]  R. H. Walters,et al.  Timing of punishment as a determinant of response inhibition. , 1963, Child development.

[9]  U. Ben-Zion,et al.  Discount rates inferred from decisions: an experimental study , 1989 .

[10]  Farshid Vahid,et al.  Predicting How People Play Games: A Simple Dynamic Model of Choice , 2001, Games Econ. Behav..

[11]  S. O'leary,et al.  Effectiveness of delayed punishment in an applied setting , 1990 .

[12]  B. Skinner,et al.  Science and human behavior , 1953 .

[13]  Gretchen M. Spreitzer,et al.  Preserving Employee Morale during Downsizing , 1998 .

[14]  O. Mowrer,et al.  Time as a determinant in integrative learning. , 1945 .

[15]  M Vogel-Sprott,et al.  Effect of delayed punishment on an immediately rewarded response in humans. , 1965, Journal of experimental psychology.

[16]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .