Evaluation Methodology in Organization Development: An Analysis and Critique

The purpose of this analysis is to present a detailed overview of the current state of evaluation methodology in organization development. A detailed search procedure yielded 35 empirical studies in the OD field for the period 1959 to mid-1975. Each study was analyzed according to (a) research design, (b) data collection procedures, (c) subject characteristics, (d) treatment dimensions, and (e) data analysis approaches. Findings show that the overall quality of OD research methodology was spotty. Research designs were relatively strong with a large percentage of investigators using quasi-experimental designs. An excessive reliance on questionnaires as the sole data collection approach exists. Only a small percentage of studies report using other quantified approaches. Most studies were conducted in one organization or in situations where the N's for units of analysis larger than the individual were small (< 10). The heavy use of laboratory training intervention techniques was noted, although a strong shift from process to task orientation has occurred in recent years. Over 75% of the studies reported the use of statistical tests of significance. Although data analysis procedures are becoming more sophisticated, the vast majority of studies used very simple analytical techniques. Based on this analysis, a series of suggestions for improvement of methodological approaches to OD research is presented.

[1]  Robert T. Golembiewski,et al.  Measuring Change and Persistence in Human Affairs: Types of Change Generated by OD Designs , 1976 .

[2]  H. P. Sims,et al.  How Effective Is Data Survey and Feedback as a Technique of Organization Development? An Experiment , 1975 .

[3]  Warren R. Nielsen,et al.  Organization Development and Change in Organizational Performance. , 1975 .

[4]  Y. Zeira An evaluation of a planned change effort through top management training , 1975 .

[5]  W. F. Dowling To move an organization: The corning approach to organization development , 1975 .

[6]  Robert T. Golembiewski,et al.  A Longitudinal Study of Flexi-Time Effects: Some Consequences of an OD Structural Intervention , 1974 .

[7]  R. S. Juralewicz An Experiment on Participation in a Latin American Factory , 1974 .

[8]  G. Strauss Organizational development: Credits and debits , 1973 .

[9]  Peter L Block,et al.  A Structural Approach to Organizational Change , 1973 .

[10]  D. G. Bowers OD Techniques and Their Results in 23 Organizations: The Michigan ICL Study , 1973 .

[11]  David G. Bowers,et al.  Survey of Organizations; A Machine-Scored Standardized Questionnaire Instrument , 1972 .

[12]  K. Back Beyond Words: Story of Sensitivity Training and the Encounter Movement , 1972 .

[13]  R. Gray THE SCANLON PLAN–A CASE STUDY* , 1971 .

[14]  M. Beer,et al.  Eclectic Approach to Organizational Development , 1971 .

[15]  J. Slocum,et al.  Job Satisfaction and Productivity , 1971 .

[16]  J. B. Harvey,et al.  Improving Communication Within a Managerial Workgroup , 1971 .

[17]  N. J. Colarelli,et al.  Managerial Grid Human Relations Training for Mental Hospital Personnel , 1971 .

[18]  John W. Slocum,et al.  Human Relations Training for Middle Management: A Field Experiment , 1970 .

[19]  R. Harrison,et al.  Choosing the Depth of Organizational Intervention , 1970 .

[20]  R. Jenks An Action-Research Approach to Organizational Change , 1970 .

[21]  I. Mangham,et al.  T‐GROUP TRAINING: BEFORE AND AFTER , 1970 .

[22]  Peter B. Smith,et al.  The IMPACT OF PHASE I MANAGERIAL GRID TRAINING , 1969 .

[23]  Paul C. Buchanan Laboratory Training and Organization Development. , 1969 .

[24]  R. Beckhard Organization Development: Strategies and Models , 1969 .

[25]  I. Mangham,et al.  The IMPACT OF T-GROUPS ON MANAGERIAL BEHAVIOUR , 1969 .

[26]  F. Friedlander,et al.  A Comparative Study of Consulting Processes and Group Development , 1968 .

[27]  John P. Campbell,et al.  Laboratory Education: Impact on People and Organizations , 1968 .

[28]  M. I. Valiquet Individual Change in a Management Development Program , 1968 .

[29]  M. D. Dunnette,et al.  Effectiveness of T-group experiences in managerial training and development. , 1968, Psychological bulletin.

[30]  Abraham Zaleznik,et al.  The Human Organization: Its Management and Value. , 1968 .

[31]  Joe B. Buttram T-Group Theory and Laboratory Method , 1967 .

[32]  F. Friedlander THE IMPACT OF ORGANIZATIONAL TRAINING LABORATORIES UPON THE EFFECTIVENESS AND INTERACTION OF ONGOING WORK GROUPS , 1967 .

[33]  Robert J. House,et al.  T‐GROUP EDUCATION AND LEADERSHIP EFFECTIVENESS: A REVIEW OF THE EMPIRIC LITERATURE AND A CRITICAL EVALUATION , 1967 .

[34]  R. Harrison,et al.  Transfer from Here-and-Now to There-and-Then: Changes in Organizational Problem Diagnosis Stemming from T-Group Training , 1966 .

[35]  R. Beckhard An Organization Improvement Program in a Decentralized Organization , 1966 .

[36]  E. Jaques Social-analysis and the Glacier Project , 1964 .

[37]  N. Seear,et al.  Productivity and Social Organization: The Ahmedabad Experiment. , 1959 .

[38]  A. K. Rice Productivity and Social Organization in an Indian Weaving Shed , 1953 .

[39]  J. French,et al.  Overcoming Resistance to Change , 1948 .

[40]  D. Campbell,et al.  EXPERIMENTAL AND QUASI-EXPERIMENT Al DESIGNS FOR RESEARCH , 2012 .

[41]  William Foote Whyte,et al.  Action research for management , 1973 .

[42]  J. J. Holder Evaluation of an In-Company Management Training Program. , 1972 .

[43]  G. Levin Change in school systems: edited by Goodwin Watson. National Training Laboratories, N.E.A. 1967. 115 pp. $2.50 , 1970 .

[44]  R. Schmuck Organization development in schools , 1970 .

[45]  E. Schein Process Consultation : Its Role in Organization Development , 1969 .

[46]  N. C. Morse,et al.  The experimental change of a major organizational variable. , 1956, Journal of abnormal psychology.