Behavioral Economics for Human-in-the-Loop Control Systems Design: Overconfidence and the Hot Hand Fallacy

This century brought interesting challenges and opportunities that derive from the way digital technology is shaping the lives of individuals and society as a whole. A key feature of many engineered systems is that they interact with humans. Rather than solely affecting humans, people often make decisions that affect the engineered system. As an example, when driving cars, people often decide to take a route that differs from that suggested by the navigation system. This information is fed back to the service provider and henceforth used when making route suggestions to other users. The analysis and design of such cyberphysical human systems (CPHSs) would benefit from an understanding of how humans behave. However, given their immense complexity, it is unclear how to formulate appropriate models for human decision makers, especially when operating in closed-loop systems (see "Summary" for an overview of this article).

[1]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[2]  G. Charness Laboratory experiments: Challenges and promise: A review of “Theory and Experiment: What are the Questions?” by Vernon Smith , 2010 .

[3]  H. Varian Intermediate Microeconomics: A Modern Approach , 1987 .

[4]  Francesco Borrelli,et al.  Modeling, Identification, and Predictive Control of a Driver Steering Assistance System , 2017, IEEE Transactions on Human-Machine Systems.

[5]  Campbell R. Harvey,et al.  Managerial Miscalibration , 2010 .

[6]  V. Smith Papers in experimental economics , 1991 .

[7]  S. Shankar Sastry,et al.  A POMDP framework for human-in-the-loop system , 2014, 53rd IEEE Conference on Decision and Control.

[8]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[9]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[10]  Dean A. Shepherd,et al.  The nature of information and overconfidence on venture capitalists' decision making , 2001 .

[11]  Catherine C. Eckel,et al.  Men, Women and Risk Aversion: Experimental Evidence , 2008 .

[12]  Shlomo Benartzi,et al.  Excessive Extrapolation and the Allocation of 401(k) Accounts to Company Stock , 2001 .

[13]  A. Thakor,et al.  Overconfidence, CEO Selection, and Corporate Governance , 2006 .

[14]  Frederick Buechner Wishful thinking , 1973 .

[15]  Don A. Moore,et al.  Competing to Be Certain (But Wrong): Market Dynamics and Excessive Confidence in Judgment , 2011, Manag. Sci..

[16]  B. De Schutter,et al.  Human-inthe-loop model predictive control of an irrigation canal ∗ , 2018 .

[17]  Baruch Fischhoff,et al.  Why Study Risk Perception , 1982 .

[18]  Falko Dressler,et al.  Cyber Physical Social Systems: Towards Deeply Integrated Hybridized Systems , 2018, 2018 International Conference on Computing, Networking and Communications (ICNC).

[19]  J Khair,et al.  Wishful thinking. , 1998, Nursing times.

[20]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[21]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[22]  Bernd Irlenbusch,et al.  Editorial Addresses , 1999 .

[23]  Gilles Hilary,et al.  Does Past Success Lead Analysts to Become Overconfident? , 2006, Manag. Sci..

[24]  Colin Camerer,et al.  A Cognitive Hierarchy Model of Games , 2004 .

[25]  Gary E. Bolton,et al.  Behavioral economic engineering , 2012 .

[26]  M. Rabin,et al.  The Gambler's and Hot-Hand Fallacies: Theory and Applications , 2007 .

[27]  Colin Camerer Does the Basketball Market Believe in the 'Hot Hand'? , 1989 .

[28]  Terrance Odean,et al.  Learning to Be Overconfident , 1997 .

[29]  Don N. Kleinmuntz,et al.  Cognitive Heuristics and Feedback in a Dynamic Decision Environment , 1985 .

[30]  Mara Tanelli,et al.  Guest EditorialHolistic Approaches for Human–Vehicle Systems: Combining Models, Interactions, and Control , 2017, IEEE Transactions on Human-Machine Systems.

[31]  Henry Montgomery,et al.  Worse Than Chance? Performance and Confidence Among Professionals and Laypeople in the Stock Market , 2004 .

[32]  Daniel Read,et al.  Choice Bracketing , 1999 .

[33]  Vijay Gupta,et al.  “Weak” Control for Human-in-the-Loop Systems , 2019, IEEE Control Systems Letters.

[34]  Brad M. Barber,et al.  Boys Will Be Boys: Gender, Overconfidence, and Common Stock Investment , 1998 .

[35]  R. Thaler,et al.  Save More Tomorrow™: Using Behavioral Economics to Increase Employee Saving , 2004, Journal of Political Economy.

[36]  Ben Greiner,et al.  Subject pool recruitment procedures: organizing experiments with ORSEE , 2015, Journal of the Economic Science Association.

[37]  R. Feigenbaum,et al.  Some determinants and consequences of the teacher's perception of causation. , 1964 .

[38]  A. Hama Predictably Irrational: The Hidden Forces That Shape Our Decisions , 2010 .

[39]  Brad M. Barber,et al.  Trading is Hazardous to Your Wealth: The Common Stock Investment Performance of Individual Investors , 2000 .

[40]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[41]  Joshua B. Miller,et al.  Surprised by the Gambler's and Hot Hand Fallacies? A Truth in the Law of Small Numbers , 2016, 1902.01265.

[42]  Yiming Qian,et al.  Are Overconfident CEOS Born or Made? Evidence of Self-Attribution Bias from Frequent Acquirers , 2007, Manag. Sci..

[43]  A. Falk,et al.  Are Risk Aversion and Impatience Related to Cognitive Ability? , 2007, SSRN Electronic Journal.

[44]  Guoli Chen,et al.  Making the Same Mistake All Over Again: CEO Overconfidence and Corporate Resistance to Corrective Feedback , 2014 .

[45]  Gary Charness,et al.  When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect , 2004 .

[46]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[47]  G. Harrison,et al.  Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion , 2004 .

[48]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[49]  Charles A. Holt,et al.  Risk Aversion and Incentive Effects , 2002 .

[50]  R. Thaler,et al.  Financial Decision-Making in Markets and Firms: A Behavioral Perspective , 1994 .

[51]  J. Pratt RISK AVERSION IN THE SMALL AND IN THE LARGE11This research was supported by the National Science Foundation (grant NSF-G24035). Reproduction in whole or in part is permitted for any purpose of the United States Government. , 1964 .

[52]  P. Todd,et al.  Bounding rationality to the world , 2003 .

[53]  A. Roth,et al.  The Redesign of the Matching Market for American Physicians: Some Engineering Aspects of Economic Design , 1999, The American economic review.

[54]  Deniz Erdogmus,et al.  The Future of Human-in-the-Loop Cyber-Physical Systems , 2013, Computer.

[55]  R. Howard,et al.  Risk-Sensitive Markov Decision Processes , 1972 .

[56]  William O. Brown,et al.  Does the Basketball Market Believe in the Hot Hand? Comment , 1993 .

[57]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[58]  Irwan Trinugroho,et al.  Overconfidence and Excessive Trading Behavior: An Experimental Study , 2011 .

[59]  Pramod K. Varshney,et al.  Human-Machine Inference Networks for Smart Decision Making: Opportunities and Challenges , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[60]  D. Moore,et al.  The three faces of overconfidence , 2017 .

[61]  B. Weiner,et al.  Cue utilization and attributional judgments for success and failure , 1971 .

[62]  Nina Mazar,et al.  The Dishonesty of Honest People: A Theory of Self-Concept Maintenance , 2008 .

[63]  Sierra N. Young,et al.  Review of Human–Machine Interfaces for Small Unmanned Systems With Robotic Manipulators , 2020, IEEE Transactions on Human-Machine Systems.

[64]  Terrance Odean Do Investors Trade Too Much? , 1998 .

[65]  Peter Ayton,et al.  The hot hand fallacy and the gambler’s fallacy: Two faces of subjective randomness? , 2004, Memory & cognition.

[66]  D. Bertsekas Reinforcement Learning and Optimal ControlA Selective Overview , 2018 .

[67]  A. Roth Laboratory Experimentation in Economics: A Methodological Overview , 1988 .

[68]  Colin Camerer,et al.  Behavioral Economics: Past, Present, Future , 2003 .

[69]  V. Benassi,et al.  Illusion of control: A meta-analytic review. , 1996 .

[70]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[71]  Ulrike Malmendier,et al.  Depression Babies: Do Macroeconomic Experiences Affect Risk-Taking? , 2009 .

[72]  S. C. Jaquette A Utility Criterion for Markov Decision Processes , 1976 .

[73]  Reid Hastie,et al.  Effects of Amount of Information on Judgment Accuracy and Confidence , 2008 .

[74]  Gjergji Kasneci,et al.  Bayesian Knowledge Corroboration with Logical Rules and User Feedback , 2010, ECML/PKDD.

[75]  Thomas Langer,et al.  Does Commitment or Feedback Influence Myopic Loss Aversion? An Experimental Analysis , 2008 .

[76]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[77]  A. Nederhof Methods of coping with social desirability bias: A review. , 1985 .

[78]  Steven J. Kachelmeier,et al.  Examining Risk Preferences under High Monetary Incentives: Experimental Evidence from the People's Republic of China , 1992 .

[79]  Katia P. Sycara,et al.  Human Interaction With Robot Swarms: A Survey , 2016, IEEE Transactions on Human-Machine Systems.

[80]  Bart De Schutter,et al.  Human-in-the-Loop Model Predictive Control of an Irrigation Canal [Applications of Control] , 2015, IEEE Control Systems.

[81]  Alvaro Sandroni,et al.  Overconfidence and asymmetric information: The case of insurance , 2013 .

[82]  N. Weinstein Unrealistic optimism about future life events , 1980 .

[83]  Baruch Fischhoff,et al.  Accident probabilities and seat belt usage: A psychological perspective☆ , 1978 .

[84]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[85]  M. Jarvik,et al.  Probability learning and a negative recency effect in the serial anticipation of alternative symbols. , 1951, Journal of experimental psychology.

[86]  O. Svenson ARE WE ALL LESS RISKY AND MORE SKILLFUL THAN OUR FELLOW DRIVERS , 1981 .

[87]  Ulrike Malmendier,et al.  CEO Overconfidence and Corporate Investment , 2002 .

[88]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[89]  Morten I. Lau,et al.  Estimating Risk Attitudes in Denmark: A Field Experiment , 2005 .

[90]  Aldo Rustichini,et al.  Overconfident: Do You Put Your Money on it? , 2005 .

[91]  R. Fahr,et al.  The Impact of Risk Perception and Risk Attitudes on Corrupt Behavior: Evidence from a Petty Corruption Experiment , 2013, SSRN Electronic Journal.

[92]  Kurt A. Carlson,et al.  The rule of three: How the third event signals the emergence of a streak. , 2007 .

[93]  G. Whitwell,et al.  Why Ethical Consumers Don’t Walk Their Talk: Towards a Framework for Understanding the Gap Between the Ethical Purchase Intentions and Actual Buying Behaviour of Ethically Minded Consumers , 2010 .

[94]  E. Weber Experience-Based and Description-Based Perceptions of Long-Term Risk: Why Global Warming does not Scare us (Yet) , 2006 .

[95]  Colin Camerer Behavioral economics: reunifying psychology and economics. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[96]  Colin Camerer,et al.  Overconfidence and Excess Entry: An Experimental Approach , 1999 .

[97]  D. Kahneman Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[98]  Daniel Hernández-Hernández,et al.  Risk Sensitive Markov Decision Processes , 1997 .

[99]  Daniel L. Chen,et al.  oTree - An Open-Source Platform for Laboratory, Online, and Field Experiments , 2016 .

[100]  Marco Pavone,et al.  Risk-sensitive Inverse Reinforcement Learning via Coherent Risk Models , 2017, Robotics: Science and Systems.

[101]  R. Trivers,et al.  The evolution and psychology of self-deception. , 2011, The Behavioral and brain sciences.

[102]  James G. Phillips,et al.  EFFECTS OF PERCEIVED CONTROL UPON WAGERING AND ATTRIBUTIONS IN COMPUTER BLACKJACK , 1995 .

[103]  Marco Wiering,et al.  Reinforcement Learning and Markov Decision Processes , 2012, Reinforcement Learning.

[104]  Cristina C. Williams,et al.  Overconfidence and the Big Five , 2004 .

[105]  D. Ariely,et al.  Man's search for meaning: The case of Legos , 2008 .

[106]  D. Hirshleifer,et al.  Are Overconfident CEOs Better Innovators? , 2011 .

[107]  A. Cox Optimal Stopping and Applications , 2009 .

[108]  Yildiray Yildiz,et al.  Modeling Cyber-Physical Human Systems via an Interplay Between Reinforcement Learning and Game Theory , 2019, Annu. Rev. Control..

[109]  Miguel A. Vadillo,et al.  Illusion of Control , 2013, Experimental psychology.

[110]  Kent D. Daniel,et al.  Overconfident Investors, Predictable Returns, and Excessive Trading , 2015 .

[111]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[112]  Ufuk Topcu,et al.  Synthesis of Human-in-the-Loop Control Protocols for Autonomous Systems , 2016, IEEE Transactions on Automation Science and Engineering.