The effectiveness of managerial leadership development programs: a meta-analysis of studies from 1982-2001

Eighty-three studies from 1982 to 2001 with formal training interventions were integrated via meta-analytic techniques to determine the effectiveness of interventions in their enhancement of performance, knowledge, and expertise at the individual, team or group, or organizational level. The studies were separated by research design, with the outcome measure of the intervention as the unit of analysis. The effect size for knowledge outcomes ranged from .96 to 1.37; expertise outcomes from .35 to 1.01; and system outcomes averaged .39. Interventions with knowledge outcomes were found to be more effective than in the Burke and Day (1986) meta-analysis, with the most effective interventions using a single group pretest-posttest research design. Methodological and conceptual differences in Burke and Day's meta-analysis on the effectiveness of managerial training make historical comparisons risky. The data suggest that practitioners can attain substantial improvements in both knowledge and skills if sufficient front-end analysis is conducted to assure that the right development is offered to the right leaders.

[1]  Martin G. Evans,et al.  The effects of supervisory behavior on the path-goal relationship , 1970 .

[2]  R. J. House,et al.  A Path-Goal Theory of Leader Effectiveness , 1971 .

[3]  D. Bray.  Managerial Behavior, Performance and Effectiveness. , 1971 .

[4]  James V. Downton,et al.  Rebel Leadership: Commitment and Charisma in the Revolutionary Process , 1974 .

[5]  F. Glen.  The social psychology of organizations , 1976 .

[6]  L. Sjodahl.  Evaluation of Training. , 1975 .

[7]  G. Graen.  Role-making processes within complex organizations , 1976 .

[8]  J W Borthwick,et al.  The human side of management. , 1976, The Canadian Journal of Hospital Pharmacy.

[9]  Ann Marrinr,et al.  Improving Leadership Effectiveness: The Leader Match Concept , 1979 .

[10]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[11]  P. Hersey,et al.  Life cycle theory of leadership. , 1979 .

[12]  R. Kilmann.  Organization Change and Development: A Systems View , 1980 .

[13]  I. Goldstein.  Training in Work Organizations , 1980 .

[14]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[15]  J. Ivancevich.  Subordinates' reactions to performance appraisal interviews: A test of feedback and goal-setting techniques. , 1982 .

[16]  Ronald W. Clement,et al.  Testing the Hierarchy Theory of Training Evaluation: An Expanded Role for Trainee Reactions , 1982 .

[17]  An inferential analysis measuring the cost effectiveness of training outcomes of a supervisory development program using four selected economic indices : an experimental study in a public agency setting , 1982 .

[18]  G. Graen,et al.  The effects of leader–member exchange and job design on productivity and satisfaction: Testing a dual attachment model. , 1982 .

[19]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[20]  John E. Hunter,et al.  Quantifying the effects of psychological interventions on employee job performance and work-force productivity. , 1983 .

[21]  AN EVALUATIVE STUDY OF THE EFFECT OF SELF-MANAGEMENT TRAINING ON A GROUP LEADERSHIP TRAINING PROGRAM FOR HOSPITAL MANAGERS , 1983 .

[22]  The effects of a leadership training program on supervisory learning and performance , 1984 .

[23]  John E. Hunter,et al.  QUESTIONING THE EFFECTIVENESS OF BEHAVIOR MODELING TRAINING IN AN INDUSTRIAL SETTING , 1984 .

[24]  K. N. Wexley,et al.  Personnel Training , 2002, Water-Related Death Investigation.

[25]  Harris Cooper,et al.  The Integrative Research Review: A Systematic Approach , 1984 .

[26]  G. Graen,et al.  Moderating effects of initial leader–member exchange status on the effects of a leadership intervention. , 1984 .

[27]  Brian L. Davis,et al.  EFFECTIVENESS OF PERFORMANCE APPRAISAL TRAINING USING COMPUTER ASSISTED INSTRUCTION AND BEHAVIOR MODELING , 1984 .

[28]  X. C. Birkenbach,et al.  The Development and the Evaluation of a Behaviour-Modelling Training Programme for Supervisors , 1985 .

[29]  Gerald R. Ferris,et al.  Management training: Justify costs or say goodbye. , 1985 .

[30]  Fabricio E. Balcazar,et al.  A Critical, Objective Review of Performance Feedback , 1985 .

[31]  Preliminary Validation and Training of Supervisory Interactional Skills , 1985 .

[32]  Philip K. Duncan,et al.  A Method for Evaluating Corporation Training Seminars , 1985 .

[33]  W. Bennis,et al.  Leaders: Strategies for Taking Charge , 1985 .

[34]  D. E. Frost.  A Test of Situational Engineering for Training Leaders , 1986 .

[35]  Noel M. Tichy,et al.  The Transformational Leader. , 1988 .

[36]  J. Hackman,et al.  Leading groups in organizations , 1986 .

[37]  Michael J. Burke,et al.  A Cumulative Study of the Effectiveness of Managerial Training , 1986 .

[38]  D. Eden.  Perspectives Team Development: Quasi-Experimental Confirmation Among Combat Companies , 1986 .

[39]  P. Dorfman,et al.  PERFORMANCE APPRAISAL BEHAVIORS: SUPERVISOR PERCEPTIONS AND SUBORDINATE REACTIONS , 1986 .

[40]  Patricia A. McLagan.  Who Can Plan? You Can!. , 1987 .

[41]  Neal Schmitt,et al.  The fidelity-adaptation debate: Implications for the implementation of public sector social programs , 1987 .

[42]  The training of principals for school advisory council leadership , 1987 .

[43]  Sanford B. Ehrlich,et al.  The Romance of Leadership and The Evaluation of Organizational Performance , 1987 .

[44]  P. Christopher Earley,et al.  Intercultural training for managers: A comparison of documentary and interpersonal methods , 1987 .

[45]  Alice Susan Leddick.  Effects of Training on Measures of Productivity: A Meta-Analysis of the Findings of Forty-Eight Experiments , 1987 .

[46]  Edwin L. Miller,et al.  Managing in the Twenty-first Century: The Need for Global Orientation , 1988 .

[47]  Steven D. Maurer,et al.  EFFECT OF SITUATIONAL INTERVIEWS, CONVENTIONAL STRUCTURED INTERVIEWS, AND TRAINING ON INTERVIEW RATING AGREEMENT: AN EXPERIMENTAL ANALYSIS , 1988 .

[48]  An exploratory study of the impact of a Western management training program on Chinese managers , 1988 .

[49]  Terry R. Johnson,et al.  A Survey of Management Training and Education Practices in U.S. Companies. , 1988 .

[50]  A meta-analysis of evaluations of the effect of continuing education on clinical practice in the health professions , 1988 .

[51]  Richard A. Swanson,et al.  Forecasting Financial Benefits of Human Resource Development , 1988 .

[52]  Peter B. Vaill,et al.  Managing as a Performing Art: New Ideas for a World of Chaotic Change , 1989 .

[53]  Mark W. Lipsey,et al.  Design Sensitivity: Statistical Power for Experimental Research. , 1989 .

[54]  L. Gerstein,et al.  EAP Referral Training and Supervisor's Beliefs About Troubled Workers , 1989 .

[55]  Don Hellriegei,et al.  The Lessons of Experience: How Successful Executives Develop on the Job , 1989 .

[56]  G. Alliger,et al.  KIRKPATRICK'S LEVELS OF TRAINING CRITERIA: THIRTY YEARS LATER , 1989 .

[57]  John E. Hunter,et al.  Methods of Meta-Analysis , 1989 .

[58]  E. Deci,et al.  Self-determination in a work organization. , 1989 .

[59]  John P. Wanous,et al.  The role of judgment calls in meta-analysis. , 1989 .

[60]  G. Yukl.  Managerial Leadership: A Review of Theory and Research , 1989 .

[61]  Carl E. Larson,et al.  Teamwork: What Must Go Right/What Can Go Wrong , 1989 .

[62]  Christopher P. Neck,et al.  Subordinates' observations: Feedback for management development , 1990 .

[63]  Nancy M. Dixon,et al.  The relationship between trainee responses on participant reaction forms and posttest scores , 1990 .

[64]  J. Berry.  Linking management development to business strategies , 1990 .

[65]  B. Bass.  Bass & Stogdill's handbook of leadership: Theory, research, and managerial applications, 3rd ed. , 1990 .

[66]  Geary A. Rummler,et al.  Improving Performance: How to Manage the White Space on the Organization Chart , 1990 .

[67]  Effectiveness of a Management Training Institute , 1990 .

[68]  A. Carnevale,et al.  Return on Investment: Accounting for Training. , 1990 .

[69]  Phyllis Tharenou,et al.  The effect of a supervisory development program on leadership style , 1990 .

[70]  J. Kotter.  A force for change : how leadership differs from management , 1990 .

[71]  E. A. Fleishman,et al.  Taxonomic efforts in the description of leader behavior: A synthesis and functional interpretation , 1991 .

[72]  E. A. Locke,et al.  Leadership: do traits matter? , 1991 .

[73]  J. Niska.  Examination of a cooperative learning supervision training and development model , 1991 .

[74]  Aharon Tziner,et al.  Personal and situational characteristics influencing the effectiveness of transfer of training improvement strategies , 1991 .

[75]  P. Moxnes,et al.  The influence of management training upon organizational climate: An exploratory study , 1991 .

[76]  J. Durlak,et al.  A practitioner's guide to meta-analysis , 1991, American journal of community psychology.

[77]  J. W. Walker,et al.  Defining Effectiveness and Efficiency Measures in the Context of Human Resource Strategy , 1991 .

[78]  M. Marquardt,et al.  Global Human Resource Development , 1992 .

[79]  Investigation of Interpersonal Management Training for Educational Administrators , 1992 .

[80]  R. Plant,et al.  Training Evaluation: A Procedure for Validating an Organization′s Investment in Training , 1992 .

[81]  J. Harrison,et al.  Individual and combined effects of behavior modeling and the cultural assimilator in cross-cultural management training. , 1992 .

[82]  R. Schneider,et al.  The Effectiveness of Employee Assistance Program Supervisor Training: An Experimental Study. , 1992 .

[83]  E. Kossek,et al.  Affective Reactions to Leadership Education: An Exploration of the Same-Gender Effect , 1992 .

[84]  David D. Van Fleet,et al.  Theory and research on leadership in organizations. , 1992 .

[85]  W. Burke,et al.  A Causal Model of Organizational Performance and Change , 1992 .

[86]  Leadership, organizational culture and organizational outcomes , 1992 .

[87]  Hugh McCredie,et al.  The Validation, Learning Dynamics and Application of an Off-the-Shelf Course in Analytical Skills , 1992 .

[88]  K. Clark.  Impact of Leadership. , 1992 .

[89]  P. Wortman,et al.  On the Reliability of Meta-Analytic Reviews , 1993 .

[90]  Karin Klenke.  Leadership Education at the Great Divide: Crossing into the Twenty-First Century , 1993 .

[91]  Thomas L. Hughes.  Learning to Lead: The Art of Transforming Managers into Leaders , 1993 .

[92]  Gwenn W. Gröndal,et al.  Meta-analytic procedures for social research , 1993 .

[93]  Ferdinand Tesoro.  The use of the measurement of continuous improvement model for training program evaluation , 1993 .

[94]  Sarah A. Hezlett,et al.  The impact of 360‐degree feedback on management skills development , 1993 .

[95]  E. Salas,et al.  Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation. , 1993 .

[96]  R. Kaplan,et al.  PUTTING THE BALANCED SCORECARD TO WORK , 1993 .

[97]  M. Lipsey,et al.  The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. , 1993, American Psychologist.

[98]  J. C. Wofford,et al.  Path-Goal Theories of Leadership: A Meta-Analysis , 1993 .

[99]  Sue R. Faerman,et al.  Trainee Satisfaction and Training Impact: Issues in Training Evaluation , 1993 .

[100]  A. Wiswell,et al.  Using the Work Group as a Laboratory for Learning: Increasing Leadership and Team Effectiveness through Feedback. , 1993 .

[101]  D. Garvin.  Building a learning organization. , 1993, Harvard business review.

[102]  Jeffrey Pfeffer,et al.  Competitive advantage through people : unleashing the power of the work force , 1995 .

[103]  H. Klein,et al.  Participation and Evaluative Outcomes in Management Training. , 1994 .

[104]  Paul M. Wortman,et al.  Judging research quality. , 1994 .

[105]  C. Mccauley,et al.  An evaluation of the outcomes of a leadership development program , 1994 .

[106]  Ichiro Innami.  The Quality of Group Decisions, Group Verbal Behavior, and Intervention , 1994 .

[107]  R. R. Haccoun,et al.  OPTIMIZING KNOWLEDGE TESTS FOR INFERRING LEARNING ACQUISITION LEVELS IN SINGLE GROUP TRAINING EVALUATION DESIGNS: THE INTERNAL REFERENCING STRATEGY , 1994 .

[108]  Marian N. Ruderman,et al.  Assessing the developmental components of managerial jobs. , 1994 .

[109]  D. Soucie.  Effective Managerial Leadership in Sport Organizations , 1994 .

[110]  Judith Rosenblum,et al.  Building a learning organization at Coopers & Lybrand , 1994 .

[111]  Richard A. Swanson,et al.  The Strategic Roles of Human Resource Development , 1995 .

[112]  Robert O. Brinkerhoff,et al.  Partnerships for training transfer: Lessons from a corporate study , 1995 .

[113]  Paula Caligiuri,et al.  Multinational corporation management strategies and international human resources practices: bringing IHRM to the bottom line , 1995 .

[114]  Analysis for improving performance: Tools for diagnosing organizations and documenting workplace expertise, by Richard A. Swanson. (1994). San Francisco: Berrett-Koehler. 325 pp., $32.95 cloth. , 1995 .

[115]  Mark A. Huselid.  The Impact of Human Resource Management Practices on Turnover, Productivity, and Corporate Financial Performance , 1995 .

[116]  P. Warr,et al.  TRAINEE CHARACTERISTICS AND THE OUTCOMES OF OPEN LEARNING , 1995 .

[117]  John W. Newstrom.  Evaluating training programs: The four levels, by Donald L. Kirkpatrick. (1994). San Francisco: Berrett-Koehler. 229 pp., $32.95 cloth. , 1995 .

[118]  K. Peter Kuchinke,et al.  Managing learning for performance , 1995 .

[119]  Michael J. Kavanagh,et al.  Applying Trained Skills on the Job: The Importance of the Work Environment , 1995 .

[120]  D. Ready,et al.  Developing leadership capabilities of global corporations: A comparative study in eight nations , 1995 .

[121]  Steven A. Cavaleri,et al.  Managing in Organizations That Learn , 1996 .

[122]  A level three evaluation of a management training program , 1996 .

[123]  H. Vroman.  The Loyalty Effect: The Hidden Force Behind Growth, Profits, and Lasting Value , 1996 .

[124]  Laurie J. Bassi.  The Top Ten Trends. , 1996 .

[125]  D. Kirkpatrick.  Invited reaction: Reaction to holton article , 1996 .

[126]  Bob Guns,et al.  The Faster Learning Organization: Gain and Sustain the Competitive Edge , 1996 .

[127]  Pierre-Olivier Dionne.  The evaluation of training activities: A complex issue involving different stakes , 1996 .

[128]  A. Denisi,et al.  Organization of information in memory and the performance appraisal process: evidence from the field. , 1996, The Journal of applied psychology.

[129]  Elwood F. Holton.  The flawed four‐level evaluation model , 1996 .

[130]  Changes in leadership styles as a function of a four-day leadership training institute for nurse managers: a perspective on continuing education program evaluation. , 1996, Journal of continuing education in nursing.

[131]  David Antonioni,et al.  Designing an effective 360-degree appraisal feedback process , 1996 .

[132]  E. Kelloway,et al.  Effects of Transformational Leadership Training on Attitudinal and Financial Outcomes: A Field Experiment , 1996 .

[133]  Curt Brungardt.  The Making of Leaders: A Review of the Research in Leadership Development and Education , 1996 .

[134]  F. Fiedler.  Research on Leadership Selection and Training: One View of the Future , 1996 .

[135]  Patricia A. McLagan.  Competencies: The Next Generation. , 1997 .

[136]  B. Bass.  Transformational Leadership: Industrial, Military, and Educational Impact , 1997 .

[137]  Cynthia D. McCauley,et al.  Management Development Through Job Experiences: An Annotated Bibliography , 1997 .

[138]  Scott I. Tannenbaum,et al.  Enhancing continuous learning: Diagnostic findings from multiple companies , 1997 .

[139]  Joan D. Mahoney,et al.  Early identification of international executive potential , 1997 .

[140]  Olusegun Agboola Sogunro,et al.  Impact of Training On Leadership Development , 1997 .

[141]  유화자.  기독교 사역과 Leadership , 1997 .

[142]  Winston Bennett,et al.  A META-ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA , 1997 .

[143]  James T. Johnson,et al.  An Analysis of an Employee Assistance Supervisory Training Program , 1997 .

[144]  Terence Brake,et al.  The global leader : critical factors for creating the world class organization , 1997 .

[145]  George E. Dodge,et al.  Leadership Complexity and Development of the leaderplex Model , 1997 .

[146]  L. L. Martin,et al.  Performance measurement: the new accountability. , 1997, Administration in social work.

[147]  R. J. House,et al.  The Social Scientific Study of Leadership: Quo Vadis? , 1997 .

[148]  Richard Lepsinger,et al.  The Art and Science of 360 Degree Feedback , 1997 .

[149]  A. H. Church,et al.  Advancing the State of the Art of 360-Degree Feedback , 1997 .

[150]  Dave Ulrich,et al.  MEASURING HUMAN RESOURCES: AN OVERVIEW OF PRACTICE AND A PRESCRIPTION FOR RESULTS , 1997 .

[151]  David B. Greenberger,et al.  A Test of Vision Training and Potential Antecedents to Leaders' Visioning Ability. [and] Invited Reaction: Enabling Visionary Leadership. , 1998 .

[152]  Kenneth G. Brown,et al.  Designing Management Training and Development for Competitive Advantage: Lessons from the Best , 1998 .

[153]  Long W. Lam,et al.  Human resource orientation and corporate performance , 1998 .

[154]  Brad D. Lafferty.  Investigation of a Leadership Development Program. , 1998 .

[155]  Joseph H. Boyett,et al.  The Guru Guide: The Best Ideas of the Top Management Thinkers , 1998 .

[156]  Janis R. Evink.  High Flyers: Developing the Next Generation of Leaders , 1998 .

[157]  Mark L. Poteet,et al.  Reactions of leaders to 360-degree feedback from subordinates and peers , 1998 .

[158]  S. Parker,et al.  Enhancing role breadth self-efficacy: the roles of job enrichment and other organizational interventions. , 1998, The Journal of applied psychology.

[159]  F. Shipper,et al.  A study of the impact of training in a management development program based on 360 feedback , 1998 .

[160]  R. S. M. Lau,et al.  A Win-Win Paradigm for Quality of Work Life and Business Performance. [and] Invited Reaction: Comments on Lau and May's Study. , 1998 .

[161]  Sally Atkinson,et al.  Is management development fulfilling its organisational role , 1998 .

[162]  R. Swanson.  Demonstrating the financial benefit of human resource development: Status and update on the theory and practice , 1998 .

[163]  Herman Aguinis,et al.  Testing Moderator Variable Hypotheses Meta-Analytically: , 1998 .

[164]  M. Hitt,et al.  Achieving and maintaining strategic competitiveness in the 21st century: The role of strategic leadership , 1999 .

[165]  Hal B. Gregersen,et al.  Global Explorers: The Next Generation of Leaders , 1999 .

[166]  P. Goodman.  Designing effective work groups , 1999 .

[167]  Robert M. Fulmer,et al.  Leadership: lessons from the best , 1999 .

[168]  Kevin D. Carlson,et al.  Impact of Experimental Design on Effect Size: Findings From the Research Literature on Training , 1999 .

[169]  David B. Nash,et al.  On Leadership , 1981, Perspectives on Politics.

[170]  T. Friedman.  The Lexus and the Olive Tree , 1999 .

[171]  Bruce J. Avolio,et al.  Full leadership development : building the vital forces in organizations , 1999 .

[172]  Reid A. Bates,et al.  Measuring Performance Improvement , 1999 .

[173]  Elwood F. Holton.  Performance Domains and Their Boundaries , 1999 .

[174]  Eileen P. Kelly,et al.  Book Reviews: Transformational Leadership: Industry, Military and Educational Impact Bernard M. Bass Lawrence Erlbaum Associates, 1998 208 pp., Paperback, $29.95 , 1999 .

[175]  C. Butler,et al.  Transformational Leadership: Industrial, Military, and Educational Impact , 1999 .

[176]  Richard W. Herling.  Operational Definitions of Expertise and Competence , 2000 .

[177]  F. Trompenaars,et al.  Developing Expatriates for the Asia-Pacific Region: A Comparative Analysis of Multinational Enterprise Managers from Five Countries across Three Continents. [and] Invited Reaction: Developing Expatriates for the Asia-Pacific Region. , 2000 .

[178]  High-Performance Leadership at the Process Level , 2000 .

[179]  K. Peter Kuchinke,et al.  The role of feedback in management training settings , 2000 .

[180]  Martha L. Maznevski,et al.  Global leaders are team players: Developing global leaders through membership on global teams , 2000 .

[181]  Marian N. Ruderman,et al.  Developing from Job Experiences: The Role of Organization-based Self-Esteem. , 2000 .

[182]  D. Eden,et al.  Implanting pygmalion leadership style through workshop training: Seven field experiments , 2000 .

[183]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[184]  Training as a Strategic Investment , 2000 .

[185]  Theo Bastiaens,et al.  Results: How to assess performance, learning, and perceptions in organizations, by Richard A. Swanson and Elwood F. Holton III , 2000 .

[186]  Gary L. May,et al.  THE EFFECT OF A MASTERY PRACTICE DESIGN ON LEARNING AND TRANSFER IN BEHAVIOR MODELING TRAINING , 2000 .

[187]  Doris B. Collins.  Organizational Performance: The Future Focus of Leadership Development Programs , 2001 .

[188]  R. J. House,et al.  Does Leadership Matter? CEO Leadership Attributes and Profitability under Conditions of Perceived Environmental Uncertainty. , 2001 .

[189]  B. Avolio,et al.  Impact of Transformational Leadership on Follower Development and Performance: A Field Experiment , 2002 .

[190]  P. Sackett.  The status of validity generalization research: Key issues in drawing inferences from cumulative research findings. , 2003 .

[191]  Andrew Mayo.  Measuring Human Capital , 2003 .

[192]  Michael J. Strube,et al.  Validity Generalization: A Critical Review , 2004 .

[193]  M. D. Dunnette.  Handbook of Industrial and Organizational Psychology , 2005 .

[194]  R. Burke,et al.  Leadership in organizations , 2006 .

[195]  J. Bordas,et al.  Leadership in the twenty-first century , 2006, IEEE Engineering Management Review.

[196]  Donovan A. McFarlane,et al.  Evaluating Training Programs: The Four Levels , 2006 .