The Relationship of Information System Training Methods and Cognitive Ability to End-User Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study

This study compares traditional and nontraditional training techniques with regard to computer related training. Its purpose was to determine which training methods could best be utilized in computer related training to maximize a trainee's retention of material and transfer of learning. A field experiment was conducted using two hundred members of active duty U.S. Naval Construction Battalion as subjects. Evaluation of trainees included a pre-training screening, post-training evaluation immediately after training, and a follow-up session four weeks after the post-training session utilizing previously validated instruments. Training treatments included instruction lecture, exploration independent study, and a nontraditional technique---behavior modeling an enhanced combination of the other two methods. Performance outcomes were operationalized using hands-on task performance and comprehension of the computer system as dependent variables. End-user satisfaction with the computer system was also measured. Two covariates, cognitive ability and system use, were also introduced into the study. The use of hands-on training methods, especially behavior modeling, resulted in superior retention of knowledge, transfer of learning, and end-user satisfaction. Cognitive ability failed to be a good predictor of trainee success but a connection was established between training methodology, system use, and end-user satisfaction.

[1]  Lorne Olfman,et al.  Conceptual Versus Procedural Software Training for Graphical User Interfaces: A Longitudinal Field Experiment , 1994, MIS Q..

[2]  Donna F. Davis,et al.  The Effect of Training Techniques and Personal Characteristics on Training End Users of Information Systems , 1990, J. Manag. Inf. Syst..

[3]  Joseph J. Martocchio,et al.  Microcomputer playfulness: development of a measure with workplace implications , 1992 .

[4]  A. Bandura Principles of behavior modification , 1969 .

[5]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[6]  John M. Carroll,et al.  The Minimal Manual , 1987, Hum. Comput. Interact..

[7]  Robert Glaser VARIABLES IN "DISCOVERY LEARNING.". , 1966 .

[8]  Susan J. Winter,et al.  Misplaced resources? Factors associated with computer literacy among end-users , 1992, Inf. Manag..

[9]  Norman R. F. Maier,et al.  Psychology in Industrial Organizations , 1973 .

[10]  Sang-Hoon Kim,et al.  A Contingent analysis of the relationshiop between IS implementation strategies and IS success , 1991, Inf. Process. Manag..

[11]  Fl. Klöcker-Larsen William McGehee and Paul W. Thayer, Training in Business and Industry. John Wiley & Sons, Inc., New York 1961. 305 sider. , 1964 .

[12]  Robert W Zmud,et al.  Linking mechanism supporting end-user computing , 1985, SIGCPR '85.

[13]  Paul H. Cheney,et al.  Organizational Factors Affecting the Success of End-User Computing , 1986, J. Manag. Inf. Syst..

[14]  Timothy T. Baldwin,et al.  Augmenting behavior-modeling training: Testing the effects of pre- and post-training interventions , 1994 .

[15]  Sirkka L. Jarvenpaa,et al.  The Information Age Confronts Education: Case Studies on Electronic Classrooms , 1993, Inf. Syst. Res..

[16]  Radhika Santhanam,et al.  Improving End-User Proficiency: Effects of Conceptual Training and Nature of Interaction , 1994, Inf. Syst. Res..

[17]  Sid L. Huff,et al.  Implementing Decision Support Systems: Correlates Of User Satisfaction And System Usage , 1990 .

[18]  John M. Carroll,et al.  The Minimal Manual , 1987, SGCH.

[19]  John M. Carroll,et al.  Metaphor, computing systems, and active learning , 1999, Int. J. Hum. Comput. Stud..

[20]  J. Guthrie,et al.  Expository instruction versus a discovery method. , 1967, Journal of educational psychology.

[21]  Marilyn E. Gist,et al.  EFFECTS OF ALTERNATIVE TRAINING METHODS ON SELF-EFFICACY AND PERFORMANCE IN COMPUTER SOFTWARE TRAINING , 1989 .

[22]  John E. Penick,et al.  The influence of classroom climate on science process and content achievement of community college students , 1983 .

[23]  Harold J. Fletcher,et al.  Improving Conditional Syllogism Performance of Young Normal and Gifted Students with Discovery and Rule Instruction. , 1983 .

[24]  Eugene R. Hall,et al.  A Comparison of Individualized and Conventional Instruction in Navy Technical Training. , 1982 .

[25]  C. Hirsch The Effects of Guided Discovery and Individualized Instructional Packages on Initial Learning, Transfer, and Retention in Second-Year Algebra. , 1977 .

[26]  Joe Wehr Instructor-led or computer-based: which will work best for you? , 1988 .

[27]  G. Latham,et al.  Application of social-learning theory to training supervisors through behavioral modeling. , 1979 .

[28]  Kirk A. Johnson An Evaluation of Individualized, Job-Specific Maintenance Training. , 1982 .

[29]  D. Ausubel The psychology of meaningful verbal learning. , 1963 .

[30]  James T. C. Teng,et al.  Facilitating the implementation of customer‐based inter‐organizational systems: an empirical analysis of innovation and support factors , 1994, Inf. Syst. J..

[31]  D. Meichenbaum Examination of model characteristics in reducing avoidance behavior. , 1971 .

[32]  Robert D. Bretz,et al.  Comparing traditional and integrative learning methods in organizational training programs. , 1992 .

[33]  James F. Courtney,et al.  A Field Study of Organizational Factors Influencing DSS Success , 1985, MIS Q..

[34]  J. Bruner Toward a Theory of Instruction , 1966 .

[35]  Scott B. Parry,et al.  An uneasy look at behavior modeling. , 1984 .

[36]  R. Kelly Rainer,et al.  The Influence of Individual Differences on Skill in End-User Computing , 1992, J. Manag. Inf. Syst..

[37]  Robert P. Bostrom,et al.  Conceptual models in training novice users of computer systems: effectiveness of abstract vs. analogical models and influence of individual differences , 1988 .

[38]  Paul H. Cheney,et al.  Training End Users: An Exploratory Study , 1987, MIS Q..

[39]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[40]  James C. Wetherbe,et al.  Key Information Systems Issues for the 1980's , 1984, MIS Q..

[41]  Robert P. Bostrom,et al.  Training End Users: An Experimental Investigation of the Roles of the Computer Interface and Training Methods , 1993, MIS Q..

[42]  Melvin Sorcher,et al.  THE INTERFACE PROJECT: BEHAVIOR MODELING AS SOCIAL TECHNOLOGY IN SOUTH AFRICA , 1982 .

[43]  Deborah Compeau,et al.  Application of Social Cognitive Theory to Training for Computer Skills , 1995, Inf. Syst. Res..

[44]  Martin Herbert,et al.  1985 Opinion Survey of MIS Managers: Key Issues , 1986, MIS Q..

[45]  Joey F. George A comparison of four recent GDSS experiments , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume III: Decision Support and Knowledge Based Systems Track.

[46]  Wanda J. Orlikowski,et al.  A Short Form Measure of User Information Satisfaction: A Psychometric Evaluation and Notes on Use , 1987, J. Manag. Inf. Syst..

[47]  Amiram Raban,et al.  Word processing techniques and user learning preferences , 1988, SGCH.

[48]  I. Goldstein Training in Work Organizations , 1980 .

[49]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[50]  B. Friedlander,et al.  A Psychologist's Second Thoughts on Concepts, Curiosity, and Discovery in Teaching and Learning , 1965 .