Learning from Learning Machines: Optimisation, Rules, and Social Norms

There is an analogy between machine learning systems and economic entities in that they are both adaptive, and their behaviour is specified in a more-or-less explicit way. It appears that the area of AI that is most analogous to the behaviour of economic entities is that of morally good decision-making, but it is an open question as to how precisely moral behaviour can be achieved in an AI system. This paper explores the analogy between these two complex systems, and we suggest that a clearer understanding of this apparent analogy may help us forward in both the socio-economic domain and the AI domain: known results in economics may help inform feasible solutions in AI safety, but also known results in AI may inform economic policy. If this claim is correct, then the recent successes of deep learning for AI suggest that more implicit specifications work better than explicit ones for solving such problems.

[1]  D. Gentner.  Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  Ruth E. Chambers.  Topics , 1973, Seminars in Perinatology.

[4]  Aliaksandr Barushka,et al.  Spam Filtering in Social Networks Using Regularized Deep Neural Networks with Ensemble Learning , 2018, AIAI.

[5]  R. Merton,et al.  Non-Contractual Relations in Business : A Preliminary Study , 2007 .

[6]  H. Jeffreys.  A Treatise on Probability , 1922, Nature.

[7]  H. E. Cunningham,et al.  The Principles of Reasoning. , 1926 .

[8]  Niall O' Mahony,et al.  Deep Learning vs. Traditional Computer Vision , 2019 .

[9]  Douglas Walton,et al.  Argument - critical thinking, logic and the fallacies (2. ed.) , 2004 .

[10]  Syed Muhammad Anwar,et al.  Deep Learning in Medical Image Analysis , 2017 .

[11]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[12]  D. Kahneman.  Thinking, Fast and Slow , 2011 .

[13]  David Lewis.  Convention: A Philosophical Study , 1986 .

[14]  K. Dunbar.  The analogical paradox: Why analogy is so easy in naturalistic settings yet so difficult in the psychological laboratory. , 2001 .

[15]  Edward Cartwright,et al.  On the Emergence of Social Norms , 2007 .

[16]  A. Ariño,et al.  Strategic alliance contracts: dimensions and determinants of contractual complexity , 2007 .

[17]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[18]  Razvan Pascanu,et al.  On the Number of Linear Regions of Deep Neural Networks , 2014, NIPS.

[19]  Lina Eriksson,et al.  Norms and conventions , 2011 .

[20]  Kyle J. Mayer,et al.  Breaking the letter vs. spirit of the law: How the interpretation of contract violations affects trust and the management of relationships , 2015 .

[21]  Yuemin Bian,et al.  Deep Learning for Drug Design: an Artificial Intelligence Paradigm for Drug Discovery in the Big Data Era , 2018, The AAPS Journal.

[22]  Vaibhava Goel,et al.  Deep multimodal learning for Audio-Visual Speech Recognition , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Samy Bengio,et al.  Tensor2Tensor for Neural Machine Translation , 2018, AMTA.

[24]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[25]  John R. Koza,et al.  Automated Design of Both the Topology and Sizing of Analog Electrical Circuits Using Genetic Programming , 1996 .

[26]  Eric A. Posner.  Symbols, Signals, and Social Norms in Politics and the Law , 1997 .

[27]  Edna Ullmann-Margalit,et al.  The Emergence Of Norms , 1977 .

[28]  J. Barnes,et al.  The Complete Works of Aristotle the Revised Oxford Translation , 1984 .

[29]  Paul Thagard,et al.  Analogical Mapping by Constraint Satisfaction , 1989, Cogn. Sci..

[30]  J. Coleman.  Foundations of Social Theory , 1990 .

[31]  Brian Falkenhainer,et al.  The Structure-Mapping Engine: Algorithm and Examples , 1989, Artif. Intell..

[32]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[33]  Sartaj Sahni,et al.  Computationally Related Problems , 1974, SIAM J. Comput..

[34]  Irving M. Copi,et al.  Introduction to Logic , 1962 .

[35]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[36]  K. Holyoak,et al.  Mental Leaps: Analogy in Creative Thought , 1994 .

[37]  Bruno Verbeek,et al.  Instrumental Rationality and Moral Philosophy - An Essay on the Virtues of Cooperation , 2002 .

[38]  Amanda Porterfield.  The Great Awakening , 2020 .

[39]  Poonam Puri,et al.  The Future of Stakeholder Interests in Corporate Governance , 2010 .

[40]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[41]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[42]  O. Williamson.  The economic institutions of capitalism , 1985 .

[43]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[44]  Kenneth D. Forbus,et al.  MAC/FAC: A Model of Similarity-Based Retrieval , 1995, Cogn. Sci..

[45]  Kyle J. Mayer,et al.  Learning to Contract: Evidence from the Personal Computer Industry , 2004, Organ. Sci..

[46]  Paul Bartha,et al.  By parallel reasoning : the construction and evaluation of analogical arguments , 2010 .

[47]  W. Quine,et al.  The web of belief , 1970 .

[48]  Kenneth D. Forbus,et al.  Incremental Structure-Mapping , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[49]  O. Williamson.  Comparative Economic Organization: The Analysis of Discrete Structural Alternatives , 1994 .

[50]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[51]  Yu Xie,et al.  Community discovery in networks with deep sparse filtering , 2018, Pattern Recognit..

[52]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[53]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[54]  Honglak Lee,et al.  Unsupervised feature learning for audio classification using convolutional deep belief networks , 2009, NIPS.

[55]  Frank H. Easterbrook,et al.  The Role of Original Intent in Statutory Construction , 1988 .

[56]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[57]  Norman J. Finkel,et al.  Commonsense Justice: Jurors' Notions of the Law , 1998 .

[58]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[59]  C. Bicchieri.  The grammar of society: the nature and dynamics of social norms , 2005 .

[60]  Vinit Kumar Gunjan,et al.  Deep Learning Based Representation for Face Recognition , 2019, Lecture Notes in Electrical Engineering.

[61]  Daniel T. Ostas,et al.  Cooperate, Comply, or Evade? A Corporate Executive's Social Responsibilities with Regard to Law , 2004 .

[62]  Gisbert Schneider,et al.  Deep Learning in Drug Discovery , 2016, Molecular informatics.

[63]  Kenneth D. Forbus,et al.  Exploring analogy in the large , 2000 .

[64]  Gillian K. Hadfield.  Rules for a Flat World: Why Humans Invented Law and How to Reinvent It for a Complex Global Economy , 2016 .

[65]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[66]  J. Boatright,et al.  The Corporate Objective after Ebay v. Newmark , 2017 .

[67]  Giuseppe Del Re,et al.  Models and analogies in science , 2013 .

[68]  Sarah Mehta Alexander.  Directors Duties under the CBCA:Shareholder Theory versus Stakeholder Theory Consideration of Stakeholder Theory's Legal and Moral Supremacy , 2012 .

[69]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[70]  Shengen Yan,et al.  Deep Image: Scaling up Image Recognition , 2015, ArXiv.

[71]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[72]  T. Schelling.  Micromotives and Macrobehavior , 1978 .

[73]  H. Young.  Individual Strategy and Social Structure , 2020 .

[74]  Norman J. Finkel,et al.  Commonsense Justice, Culpability, and Punishment , 2000 .

[75]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[76]  Brian F. Bowdle,et al.  Metaphor is like analogy , 2001 .

[77]  H. Black,et al.  Black's Law Dictionary , 1968 .

[78]  John W. Blyth,et al.  A Modern Introduction to Logic. , 1961 .

[79]  Yu Li,et al.  Deep learning in bioinformatics: introduction, application, and perspective in big data era , 2019, bioRxiv.

[80]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[81]  Demis Hassabis,et al.  A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play , 2018, Science.

[82]  Katta G. Murty,et al.  Some NP-complete problems in quadratic and nonlinear programming , 1987, Math. Program..

[83]  Panos M. Pardalos,et al.  Quadratic programming with one negative eigenvalue is NP-hard , 1991, J. Glob. Optim..

[84]  D. Rousseau,et al.  Violating the psychological contract: Not the exception but the norm , 1994 .

[85]  J. Barnes.  The Prior Analytics , 1990, The Classical Review.

[86]  R. Sellars.  Rhetoric , 1996, The Classical Review.

[87]  Dirk Schlimm,et al.  Two Ways of Analogy: Extending the Study of Analogies to Mathematical Domains* , 2008, Philosophy of Science.

[88]  David R. Hekman,et al.  Stakeholder Theory and Managerial Decision-Making: Constraints and Implications of Balancing Stakeholder Interests , 2006 .

[89]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[90]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[91]  Kyle J. Mayer,et al.  Breaking the Letter vs. Spirit of the Law , 2012 .

[92]  Melissa E. Graebner.  Caveat Venditor: Trust Asymmetries in Acquisitions of Entrepreneurial Firms , 2009 .

[93]  Peter Vanderschraaf,et al.  Convention as correlated equilibrium , 1995 .

[94]  Patrick Suppes,et al.  Introduction To Logic , 1958 .

[95]  Dylan Hadfield-Menell,et al.  Incomplete Contracting and AI Alignment , 2018, AIES.

[96]  Aravind Subramanian,et al.  Gene expression inference with deep learning , 2015 .

[97]  Inderjit S. Dhillon,et al.  Rank minimization via online learning , 2008, ICML '08.

[98]  R. Alfaro-LeFevre.  Critical thinking. , 1997, Nursing spectrum.

[99]  Nelson Pike,et al.  Dialogues Concerning Natural Religion , 2017 .

[100]  A new introduction , 2020 .

[101]  M. Whinston,et al.  Incomplete Contracts and Strategic Ambiguity , 1998 .

[102]  Zheyi Chen,et al.  Detecting spammers on social networks , 2015, Neurocomputing.

[103]  W. Dugger.  The Economic Institutions of Capitalism , 1987 .

[104]  Patricia Chen,et al.  The letter versus the spirit of the law: A lay perspective on culpability , 2011, Judgment and Decision Making.

[105]  Kyle J. Mayer,et al.  Complementarity and Evolution of Contractual Provisions: An Empirical Study of IT Services Contracts , 2007, Organ. Sci..

[106]  Oliver E. Williamson,et al.  Economic Organization: The Case For Candor , 1996 .

[107]  Jun Zhang,et al.  Twitter spam detection based on deep learning , 2017, ACSW.

[108]  Sanford J. Grossman,et al.  The Costs and Benefits of Ownership: A Theory of Vertical and Lateral Integration , 1986 .