A proposal for a measure of program understanding

This paper investigates the needs of computer science educators and experimental researchers for a measure of programmer performance. Operational and comprehensional problem solving is differentiated and their manifestations in computer science are presented. Measures that have been used by experimental researchers to evaluate programmer performance are described. The lack of adequate measures of comprehensional problem solving leads to the definition of the concept of Program Understanding. A measure of Program Understanding is discussed and its uses in education, experimental research, and industry are explored.

[1]  Harlan D. Mills,et al.  Understanding and Documenting Programs , 1982, IEEE Transactions on Software Engineering.

[2]  John D. Gould,et al.  An Exploratory Study of Computer Program Debugging1 , 1974 .

[3]  Larry Weissman,et al.  Psychological complexity of computer programs: an experimental methodology , 1974, SIGP.

[4]  E A JEROME,et al.  A Problem Programmer , 1964, Perceptual and motor skills.

[5]  Tom Moher,et al.  Methodology and experimental research in software engineering , 1982 .

[6]  Thomas R. G. Green,et al.  Scope Marking in Computer Conditionals - A Psychological Evaluation , 1977, Int. J. Man Mach. Stud..

[7]  T. R. G. Green Conditional program statements and their comprehensibility to professional programmers , 1977 .

[8]  Ben Shneiderman,et al.  Software psychology: Human factors in computer and information systems (Winthrop computer systems series) , 1980 .

[9]  Johnette Hassell,et al.  Student workbook for ansi fortran77: an introduction to structured software design , 1983 .

[10]  Gerald M. Weinberg,et al.  Psychology of computer programming , 1971 .

[11]  Lance A. Miller Programming by Non-Programmers , 1974, Int. J. Man Mach. Stud..

[12]  H. Simon,et al.  Perception in chess , 1973 .

[13]  Victor J. Law ANSI FORTRAN 77: An Introduction to Software Design , 1983 .

[14]  Johnette Hassell,et al.  Tutorial on structure charts as an algorithm design tool , 1982, SIGCSE '82.

[15]  Thomas R. G. Green,et al.  The problems the programmer faces , 1980 .

[16]  J. Reitman,et al.  Knowledge organization and skill differences in computer programmers , 1981, Cognitive Psychology.

[17]  Bill Curtis,et al.  Modern Coding Practices and Programmer Performance , 1979, Computer.

[18]  Bill Curtis,et al.  Third time charm: Stronger prediction of programmer performance by software complexity metrics , 1979, ICSE 1979.