Human agency and responsible computing: Implications for computer system design

Abstract To understand and promote responsible computing, this paper highlights the importance of analyses based on human agency. We first examine whether computers can be moral agents. Then we draw on research in human factors, cognitive science, and instructional technology to examine how three types of computing practices can be problematic from the perspective of human agency. The first involves anthropomorphizing a computational system, the second, delegating decision making to a computational system, and the third, delegating instruction to a computational system. Throughout this discussion, we provide alternative design goals and methods by which responsible computing can be enhanced as a shared vision and practice within the computing community.

[1]  Larry Nucci,et al.  Social interactions and the development of social concepts in preschool children. , 1978 .

[2]  J. Searle,et al.  Is the brain's mind a computer program? , 1990, Scientific American.

[3]  R. Chang,et al.  Accuracy of decisions to withdraw therapy in critically ill patients: clinical judgment versus a computer model. , 1989, Critical care medicine.

[4]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[5]  C. Harris,et al.  Office automation: making it pay off , 1989 .

[6]  Robert Kass,et al.  Student Modeling in Intelligent Tutoring Systems — Implications for User Modeling , 1989 .

[7]  L. Kohlberg.  Stage and sequence: The cognitive-developmental approach to socialization , 1969 .

[8]  G. E. Scott.  Moral Personhood: An Essay in the Philosophy of Moral Psychology , 1990 .

[9]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[10]  Batya Friedman,et al.  Societal Issues and School Practices: An Ethnographic Investigation of the Social Context of School Computer Use. , 1990 .

[11]  Geoffrey B. Saxe,et al.  Culture and cognitive development , 1990 .

[12]  J. Piaget,et al.  The Child's Conception of the World , 1971 .

[13]  John McCarthy,et al.  Ascribing Mental Qualities to Machines , 1979 .

[14]  E. Turiel,et al.  The Development of Social Knowledge: Morality and Convention , 1983 .

[15]  Arnold Zuboff,et al.  THE STORY OF “BRAIN.” , 1922, British medical journal.

[16]  Friedman Batya.  Social and Moral Development Through Computer Use , 1991 .

[17]  J. Piaget.  The Moral Judgment of the Child , 1932 .

[18]  Donald A. Norman,et al.  Analogical Processes in Learning , 1980 .

[19]  William Damon,et al.  The social world of the child , 1977 .

[20]  J S Packer,et al.  Clinical evaluation of closed‐loop control of blood pressure in seriously ill patients , 1991, Critical care medicine.

[21]  Rheta Devries.  Children's conceptions of shadow phenomena , 1986 .

[22]  Larry Nucci,et al.  Children's Responses to Moral and Social Conventional Transgressions in Free-Play Settings. , 1982 .

[23]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[24]  Pelle Ehn,et al.  Work-oriented design of computer artifacts , 1989 .

[25]  P M Churchland,et al.  Could a machine think? , 1990, Scientific American.

[26]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[27]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[28]  Edward H. Shortliffe,et al.  Medical consultation systems: Designing for doctors , 1983 .

[29]  John W. Snapper,et al.  RESPONSIBILITY FOR COMPUTER‐BASED ERRORS* , 1985 .

[30]  A. Göncü,et al.  Interpersonal relations in four-year dyads from constructivist and montessori programs☆ , 1987 .

[31]  Sherry Turkle,et al.  The second self: computers and the human spirit , 1984 .

[32]  Benjamin Kuipers,et al.  Computer power and human reason , 1976, SGAR.

[33]  S Demertzis,et al.  Use of a computerized closed-loop sodium nitroprusside titration system for antihypertensive treatment after open heart surgery. , 1990, Critical care medicine.