Improving Computer Training Effectiveness for Decision Technologies: Behavior Modeling and Retention Enhancement

Managers and analysts increasingly need to master the hands-on use of computer-based decision technologies including spreadsheet models. Effective training can prevent the lack of skill from impeding potential effectiveness gains from decision technologies. Among the wide variety of software training approaches in use today, recent research indicates that techniques based on behavior modeling, which consists of computer skill demonstration and hands-on practice, are among the most effective for achieving positive training outcomes. The present research examines whether the established behavior-modeling approach to software training can be improved by adding a retention enhancement intervention as a substitute for, or complement to, hands-on practice. One hundred and eleven trainees were randomly assigned to one of three versions of a training program for spreadsheets: retention enhancement only, practice only, and retention enhancement plus practice. Results obtained while controlling for total training time indicate that a combination of retention enhancement and practice led to significantly better cognitive learning than practice alone. The initial difference in cognitive achievement was still evident one week after training. Implications for future computer training research and practice are discussed.

[1]  J. Mathieu,et al.  Meeting trainees' expectations: The influence of training fulfillment on the development of commitment, self-efficacy, and motivation. , 1991 .

[2]  R. Noe Trainees' Attributes and Attitudes: Neglected Influences on Training Effectiveness , 1986 .

[3]  Rebecca B. Mann,et al.  The Effect of Key Behavior Distinctiveness on Generalization and Recall in Behavior Modeling Training , 1984 .

[4]  Lorne Olfman,et al.  End-user training and learning , 1995, CACM.

[5]  Mary Beth Rosson,et al.  Managing evaluation goals for training , 1995, CACM.

[6]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[7]  Robert L. Craig,et al.  Training and development handbook: A guide to human resource development , 1976 .

[8]  Mary Beth Rosson,et al.  Paradox of the active user , 1987 .

[9]  R. Crutchfield,et al.  Individual in Society , 1963 .

[10]  P. Decker,et al.  THE ENHANCEMENT OF BEHAVIOR MODELING TRAINING OF SUPERVISORY SKILLS BY THE INCLUSION OF RETENTION PROCESSES , 1982 .

[11]  Timothy T. Baldwin,et al.  Augmenting behavior-modeling training: Testing the effects of pre- and post-training interventions , 1994 .

[12]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[13]  T. Baldwin,et al.  Effects of alternative modeling strategies on outcomes of interpersonal-skills training. , 1992, The Journal of applied psychology.

[14]  Candice Harp Many Paths to Learning Software. , 1997 .

[15]  R. Jeffery,et al.  The influence of symbolic and motor rehearsal in observational learning , 1976 .

[16]  Kieran Mathieson,et al.  Predicting User Intentions: Comparing the Technology Acceptance Model with the Theory of Planned Behavior , 1991, Inf. Syst. Res..

[17]  Roger E. Kirk,et al.  Experimental design: Procedures for the behavioral sciences (3rd ed.). , 1995 .

[18]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[19]  Dennis F. Galletta,et al.  Social influence and end-user training , 1995, CACM.

[20]  Jon M. Werner,et al.  Computer training through behavior modeling, self-paced, and instructional approaches : A field experiment , 1996 .

[21]  Albert Bandura,et al.  Role of Symbolic Coding and Rehearsal Processes in Observational Learning. , 1973 .

[22]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[23]  Marilyn E. Gist,et al.  EFFECTS OF ALTERNATIVE TRAINING METHODS ON SELF-EFFICACY AND PERFORMANCE IN COMPUTER SOFTWARE TRAINING , 1989 .

[24]  G. Yukl,et al.  Training and development in work organizations. , 1992 .

[25]  Judy Kay,et al.  Studying long-term system use , 1995, CACM.

[26]  Paul H. Cheney,et al.  Organizational Factors Affecting the Success of End-User Computing , 1986, J. Manag. Inf. Syst..

[27]  L Olfman,et al.  End‐user software training: an experimental comparison of methods to enhance motivation , 1991, Inf. Syst. J..

[28]  Milton D. Hakel,et al.  Effects of trainee-generated versus trainer-provided rule codes on generalization in behavior-modeling training. , 1986 .

[29]  M. Gerst,et al.  Symbolic Coding Processes in Observational Learning. , 1971 .

[30]  G. Boynton The Individual in Society , 1972 .

[31]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[32]  Lorne Olfman,et al.  Conceptual Versus Procedural Software Training for Graphical User Interfaces: A Longitudinal Field Experiment , 1994, MIS Q..

[33]  Peter A. Todd,et al.  Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication , 1992, MIS Q..

[34]  A. Bandura Principles of behavior modification , 1969 .

[35]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[36]  Sang M. Lee,et al.  An Empirical Study of the Relationships among End-User Information Systems Acceptance, Training, and Effectiveness , 1995, J. Manag. Inf. Syst..

[37]  Peter A. Todd,et al.  Understanding Information Technology Usage: A Test of Competing Models , 1995, Inf. Syst. Res..

[38]  Viswanath Venkatesh,et al.  Creation of Favorable User Perceptions: Exploring the Role of Intrinsic Motivation , 1999, MIS Q..

[39]  Michelene T. H. Chi,et al.  Self-Explanations: How Students Study and Use Examples in Learning To Solve Problems. Technical Report No. 9. , 1987 .

[40]  Carolyn Copper,et al.  Does mental practice enhance performance , 1994 .

[41]  Izak Benbasat,et al.  An Empirical Study of Computer System Learning: Comparison of Co-Discovery and Self-Discovery Methods , 1997, Inf. Syst. Res..

[42]  M. Gist,et al.  THE INFLUENCE OF TRAINING METHOD AND TRAINEE AGE ON THE ACQUISITION OF COMPUTER SKILLS , 1988 .

[43]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[44]  Richard D. Johnson,et al.  Research Report: The Role of Behavioral Modeling in Computer Skills Acquisition: Toward Refinement of the Model , 2000, Inf. Syst. Res..

[45]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[46]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[47]  Freda Kemp Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences , 2003 .

[48]  Timothy T. Baldwin,et al.  Effects of alternative modeling strategies on outcomes of interpersonal-skills training. , 1992, The Journal of applied psychology.

[49]  Leon A. Kappelman,et al.  Converging end-user and corporate computing , 1993, CACM.

[50]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[51]  I. Goldstein Training in Work Organizations , 1980 .

[52]  P. Decker Effects of symbolic coding and rehearsal in behavior-modeling training. , 1980, The Journal of applied psychology.

[53]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[54]  Robert P. Bostrom,et al.  Training End Users: An Experimental Investigation of the Roles of the Computer Interface and Training Methods , 1993, MIS Q..

[55]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[56]  R. Ryan Nelson,et al.  The assessment of end-user training needs , 1995, CACM.

[57]  Albert Bandura,et al.  Analysis of memory codes and cumulative rehearsal in observational learning , 1974 .

[58]  Paul H. Cheney,et al.  Training End Users: An Exploratory Study , 1987, MIS Q..

[59]  James T. C. Teng,et al.  The Relationship of Information System Training Methods and Cognitive Ability to End-User Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study , 1996, Inf. Syst. Res..

[60]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..