The role of user age in task performance: examining curvilinear and interaction effects of user age, expertise, and interface design on mistake making

AbstractThe next 30 years are going to be challenging for organizations as they need to transition to a workforce that is rapidly growing older. As the workforce is growing older, the age of organizational technology users is an important aspect to examine in the context of organizational information systems (IS). The corresponding IS literature has largely assumed that age is an impediment or disadvantage when using modern information and communication technologies (ICTs) and has, thus, directed attention to the challenges faced by older technology users in the workforce. However, such research has not examined the potential benefits of an older workforce in terms of a possibly higher task performance under certain workplace conditions, such as employees’ subject-area knowledge and the design of the ICT interface. Hence, this paper examines age-related differences in the use of organizational ICTs in terms of the propensity that different age groups have toward performance in the form of mistake-making when searching for information. To do so, the paper forms hypotheses that explain how the combination of age, subject-area knowledge, and system interface lead individuals to make mistakes in a technology-enabled context. Drawing on a laboratory experiment using 107 older and younger technology users, we evaluated the three-way interaction of age, subject-area knowledge, and interface design. Our results demonstrate that—under certain conditions—age is not the detriment that it is widely believed to be. The implications of this finding are explored in relation to the “graying of the workforce” that all OECD countries are currently experiencing.

[1]  Dennis J. Devine,et al.  Domain-Specific Knowledge and Task Characteristics in Decision Making , 1995 .

[2]  A. D. Pearman,et al.  Judgment and Decision Making: An Interdisciplinary Reader , 1999 .

[3]  Robert J. Sternberg,et al.  Expertise and Intelligent Thinking: When is it Worse to Know Better , 1989 .

[4]  Ben Godde,et al.  The Influence of Age and Work-Related Expertise on Fine Motor Control , 2012 .

[5]  G. Bower,et al.  THE PSYCHOLOGY OF LEARNING AND M·OTIVATION , 2001 .

[6]  Barbara McIntosh,et al.  Retaining an aging nurse workforce: perceptions of human resource practices. , 2009, Nursing economic$.

[7]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[8]  Monideepa Tarafdar,et al.  The Impact of Technostress on Role Stress and Productivity , 2007, J. Manag. Inf. Syst..

[9]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[10]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[11]  Michael Cardew-Hall,et al.  The folksonomy tag cloud: when is it useful? , 2008, J. Inf. Sci..

[12]  Michael S. Scott Morton,et al.  A Framework for Management Information Systems , 2015 .

[13]  Daniel Västfjäll,et al.  Adult Age Differences in Dual Information Processes: Implications for the Role of Affective and Deliberative Processes in Older Adults' Decision Making , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[14]  Rick P. Thomas,et al.  Psychological plausibility of the theory of probabilistic mental models and the fast and frugal heuristics. , 2008, Psychological review.

[15]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[16]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[17]  J. Stevens Applied Multivariate Statistics for the Social Sciences , 1986 .

[18]  Frank Dong,et al.  Health Literacy Assessment of the STOFHLA , 2014, Health education & behavior : the official publication of the Society for Public Health Education.

[19]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[20]  J. Shanteau How much information does an expert use? Is it relevant? , 1992 .

[21]  Ronald K. Mitchell,et al.  Cross-Cultural Cognitions and the Venture Creation Decision , 2000 .

[22]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[23]  R. Sternberg Advances in the psychology of human intelligence , 1982 .

[24]  Lazar Stankov,et al.  Age differences in the realism of confidence judgements: A calibration study using tests of fluid and crystallized intelligence , 1996 .

[25]  Jason Bennett Thatcher,et al.  Modern information technology in an old workforce: Toward a strategic research agenda , 2014, J. Strateg. Inf. Syst..

[26]  M M Johnson,et al.  Purchasing over-the-counter medications: the influence of age and familiarity. , 2000, Experimental aging research.

[27]  John S. Gero,et al.  The structure of concurrent cognitive actions: a case study on novice and expert designers , 2002 .

[28]  D. Kahneman A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[29]  Richard Pak,et al.  Age-Sensitive Design of Online Health Information: Comparative Usability Study , 2009, Journal of medical Internet research.

[30]  Sissel Guttormsen Schär The influence of the user interface on solving well- and ill-defined problems , 1996, Int. J. Hum. Comput. Stud..

[31]  D W Baker,et al.  Health literacy among Medicare enrollees in a managed care organization. , 1999, JAMA.

[32]  Scott E. Maxwell,et al.  Designing Experiments and Analyzing Data: A Model Comparison Perspective , 1990 .

[33]  James F. Courtney,et al.  Decision making and knowledge management in inquiring organizations: toward a new decision-making paradigm for DSS , 2001, Decis. Support Syst..

[34]  N W Denney,et al.  Aging and episodic memory: are elderly adults less likely to make connections between target and contextual information? , 1994, Journal of gerontology.

[35]  Mohammad Nasir Uddin,et al.  Faceted classification in web information architecture: A framework for using semantic web tools , 2007, Electron. Libr..

[36]  Joel Myerson,et al.  Aging and intraindividual variability in performance: analyses of response time distributions. , 2007, Journal of the experimental analysis of behavior.

[37]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[38]  Harry Bruce,et al.  Don't take my folders away!: organizing personal information to get ghings done , 2005, CHI Extended Abstracts.

[39]  José J. Cañas,et al.  Structural Representations in Knowledge Acquisition. , 1994 .

[40]  Lynn Hasher,et al.  Working Memory, Comprehension, and Aging: A Review and a New View , 1988 .

[41]  G Bordage,et al.  The structure of medical knowledge in the memories of medical students and general practitioners: categories and prototypes , 1984, Medical education.

[42]  Lawrence W. Barsalou,et al.  Deriving Categories to Achieve Goals , 1991 .

[43]  M. Rabin Psychology and Economics , 1997 .

[44]  Jennifer L. Snyder An investigation of the knowledge structures of experts, intermediates and novices in physics , 2000 .

[45]  Darrell A. Worthy,et al.  With Age Comes Wisdom , 2011, Psychological science.

[46]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[47]  D. Baker,et al.  Development of a brief test to measure functional health literacy. , 1999, Patient education and counseling.

[48]  Helmut Krueger,et al.  In pursuit of desktop evolution: User problems and practices with modern desktop systems , 2004, TCHI.

[49]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[50]  Yeliz Yesilada,et al.  What input errors do you experience? Typing and pointing errors of mobile Web users , 2010, Int. J. Hum. Comput. Stud..

[51]  Sergio Della Sala,et al.  Behavioral dysexecutive symptoms in normal aging , 2003, Brain and Cognition.

[52]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[53]  J. Baron,et al.  Heuristics and biases in diagnostic reasoning: II. Congruence, information, and certainty☆ , 1988 .

[54]  N. Charness,et al.  Factors Predicting the Use of Technology: Findings From the Center for Research and Education on Aging and Technology Enhancement (CREATE) , 2006 .

[55]  Corinna E Löckenhoff,et al.  Age, time, and decision making: from processing speed to global time horizons , 2011, Annals of the New York Academy of Sciences.

[56]  Denise C. Park,et al.  Handbook of the Psychology of Aging , 1979 .

[57]  James Shanteau,et al.  Reducing the influence of irrelevant information on experienced decision makers , 1984 .

[58]  Susan T. Dumais,et al.  A comparison of symbolic and spatial filing , 1985, CHI '85.

[59]  J. Wiley Expertise as mental set: The effects of domain knowledge in creative problem solving , 1998, Memory & cognition.

[60]  Kenneth S. Rogoff,et al.  Growth in a Time of Debt , 2010 .

[61]  Terri L. Griffith,et al.  Information Technology and the Changing Fabric of Organization , 2007, Organ. Sci..

[62]  Glenn J. Browne,et al.  Cognitive Stopping Rules for Terminating Information Search in Online Tasks , 2007, MIS Q..

[63]  Michael J. Prietula,et al.  Studies of Expertise from Psychological Perspectives , 2006 .

[64]  Bob Lee,et al.  Age differences in constraints encountered by seniors in their use of computers and the internet , 2011, Comput. Hum. Behav..

[65]  D. Campbell Task Complexity: A Review and Analysis , 1988 .

[66]  R. Zmud INDIVIDUAL DIFFERENCES AND MIS SUCCESS: A REVIEW OF THE EMPIRICAL LITERATURE* , 1979 .

[67]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[68]  C. Abrams,et al.  Facilitating equity and efficiency in Malaysian primary health care through the application of the ACG® case mix system , 2009, BMC Health Services Research.

[69]  Daniel Cervone,et al.  Everyday Challenges in Context: The Influence of Contextual Factors on Everyday Problem Solving Among Young, Middle-Aged, and Older Adults , 2010, Experimental aging research.

[70]  R. Cattell,et al.  Age differences in fluid and crystallized intelligence. , 1967, Acta psychologica.

[71]  Jeremye D Cohen The aging nursing workforce: How to retain experienced nurses. , 2006, Journal of healthcare management / American College of Healthcare Executives.

[72]  Arthur D. Fisk,et al.  Touch a Screen or Turn a Knob: Choosing the Best Device for the Job , 2005, Hum. Factors.

[73]  Rob Kling,et al.  Reconceptualizing Users as Social Actors in Information Systems Research , 2003, MIS Q..

[74]  Martina Ziefle,et al.  Understanding age differences in PDA acceptance and performance , 2007, Comput. Hum. Behav..

[75]  Maria Karavidas,et al.  The effects of computers on older adult users , 2005, Comput. Hum. Behav..

[76]  A. Tversky,et al.  Contingent weighting in judgment and choice , 1988 .

[77]  R. A. Bailey Designing Experiments and Analyzing Data: a Model Comparison Perspective, 2nd edn , 2005 .

[78]  J. Baron,et al.  Heuristics and biases in diagnostic reasoning: I. Priors, error costs, and test accuracy , 1988 .

[79]  Jan H. B. M. Huysmans,et al.  The Effectiveness of the Cognitive-Style Constraint in Implementing Operations Research Proposals , 1970 .

[80]  Richard Pak,et al.  Designing an Information Search Interface for Younger and Older Adults , 2008, Hum. Factors.

[81]  David Lopatto,et al.  Cautiousness, Stereotypy, and Variability in Older and Younger Adults , 1998 .

[82]  A. Tversky,et al.  Rational choice and the framing of decisions , 1990 .

[83]  Andrew B. Whinston,et al.  Research Issues in Social computing , 2007, J. Assoc. Inf. Syst..

[84]  Andrew Mienaltowski Everyday problem solving across the adult life span: solution diversity and efficacy , 2011, Annals of the New York Academy of Sciences.

[85]  Cordula Wagner,et al.  Design of a study on suboptimal cognitive acts in the diagnostic process, the effect on patient outcomes and the influence of workload, fatigue and experience of physician , 2009, BMC health services research.

[86]  Herbert A. Simon,et al.  Problem Solving and Reasoning. , 1984 .

[87]  James Shanteau,et al.  When does a response error become a judgmental bias? Commentary on "Judged Frequency of Lethal Events". , 1978 .

[88]  Stephen J. Read,et al.  The effects of expertise on financial problem solving: Evidence for goal-directed, problem-solving scripts , 1990 .

[89]  Glenn J. Browne,et al.  Stopping rule use during information search in design problems , 2004 .

[90]  Michael S. Schadewald,et al.  The use of analogy in legal argument: problem similarity, precedent, and expertise , 1993 .

[91]  Abraham H. Maslow,et al.  The psychology of science: a reconnaissance , 1966 .

[92]  J. Strough,et al.  Decision‐making heuristics and biases across the life span , 2011, Annals of the New York Academy of Sciences.

[93]  Timothy A. Salthouse,et al.  The Nature of the Influence of Speed on Adult Age Differences in Cognition. , 1994 .

[94]  B. Adelson When Novices Surpass Experts: The Difficulty of a Task May Increase With Expertise , 1984 .