Performance theory based outcome measurement in engineering education and training

An approach is presented to improve engineering education that is based on new concepts of systems performance and classic feedback theory. An important aspect is the use of general systems performance theory (GSPT) to provide a performance model of the educational system and as a basis for the key outcome metrics: the volumes of performance capacity envelopes of individual students. Feedback is aimed at achieving both better curriculum design and teaching methods. In addition to conceptual issues, a web-based implementation plan and experimental validation plan is described. The quantitative modeling approach taken, including choice of appropriate levels of abstraction, has provided better understanding of the system used to provide engineering education and a basis for quantitatively linking components of the program to student performance in a causal manner. The educational system performance model is discussed in the context of competency models. It is believed that this approach holds promise for not only documenting a meaningful type of outcome but also for providing insight into the rationale for steps taken in attempts to improve an educational system.

[1]  A. Bendell,et al.  Taguchi methods : applications in world industry , 1989 .

[2]  George V. Kondraske,et al.  A Working Model for Human System-Task Interfaces , 1999 .

[3]  George V. Kondraske,et al.  Neuroperformance Evaluation of Multiple Sclerosis Disease Progression in a Clinical Trial: Implications for Neurological Outcomes , 1993 .

[4]  George V. Kondraske,et al.  Measurement Tools and Processes in Rehabilitation Engineering , 1999 .

[5]  D. Mcclelland.  Testing for competence rather than for "intelligence". , 1973, The American psychologist.

[6]  George V. Kondraske,et al.  An approach to estimating performance capacity envelopes: knee extensor system example , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[7]  George V. Kondraske,et al.  HUMAN PERFORMANCE: SCIENCE OR ART? , 1987 .

[8]  G V Kondraske.  An elemental resource for the human-task interface. , 1995, International journal of technology assessment in health care.

[9]  George V. Kondraske,et al.  Telerobotic system performance measurement: motivation and methods , 1992, Other Conferences.

[10]  Francis A Kulacki,et al.  Downsizing the Curriculum: A Proposed Baccalaureate Program and Contextual Basis , 1995 .

[11]  Harold P. Frisch,et al.  Man/Machine Interaction Dynamics and Performance Analysis , 1993 .

[12]  Joseph A. Shaeiwitz.  Outcomes Assessment in Engineering Education , 1996 .

[13]  M Jafari,et al.  Performance characterization of human pitch control system: an acoustic approach. , 1989, The Journal of the Acoustical Society of America.

[14]  Rory A. Cooper,et al.  Rehabilitation Engineering Applied to Mobility and Manipulation , 1995 .

[15]  Andrea De Lucia,et al.  The Art and Science of Competency Models: Pinpointing Critical Success Factors in Organizations , 1999 .

[16]  W. Deming.  Quality, productivity, and competitive position , 1982 .

[17]  Denny Davis,et al.  Establishing engineering design competencies for freshman/sophomore students , 1995, Proceedings Frontiers in Education 1995 25th Annual Conference. Engineering Education for the 21st Century.

[18]  Leo H. Bradley.  Complete Guide to Competency-Based Education: Practical Techniques for Planning, Developing, Implementing, and Evaluating Your Program , 1987 .

[19]  George V. Kondraske,et al.  A new approach to human motion quality measurement , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[20]  Jeanette N. Cleveland,et al.  Performance Measurement and Theory , 1983 .

[21]  George V. Kondraske,et al.  Neuromuscular performance: resource economics and product-based composite indices , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[22]  H. Khan.  Procedural steps for designing and implementing an evaluative research using outcome based program evaluation , 1995, Proceedings Frontiers in Education 1995 25th Annual Conference. Engineering Education for the 21st Century.

[23]  Louis Cohen,et al.  Quality Function Deployment: How to Make QFD Work for You , 1995 .

[24]  J. Kleinfeld,et al.  Youth Organizations as a Third Educational Environment Particularly for Minority Group Youth. Final Report to the National Institute of Education. , 1982 .

[25]  Paul J. Vasta,et al.  Performance prediction of an upper extremity reciprocal task using non-linear causal resource analysis , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  J. Paris.  Performance assessment. , 1998, Journal of public health medicine.

[27]  George V. Kondraske,et al.  Applying General Systems Performance Theory and the Elemental Resource Model to Gender-Related Issues in Physical Education and Sport , 1994 .

[28]  Susan M. Miller,et al.  Functional Restoration for Spinal Disorders: The Sports Medicine Approach , 1989 .

[29]  Jeffrey E. Froyd,et al.  Competency matrix assessment in an integrated, first-year curriculum in science, engineering, and mathematics , 1996, Technology-Based Re-Engineering Engineering Education Proceedings of Frontiers in Education FIE'96 26th Annual Conference.