A quantitative analysis of U.S. and Japanese software-engineering practice and performance

Since the early 1980s, there has been a mounting debate in industry literature and in U.S. government-sponsored reports over the relative performance of software developers in Japan versus those in the United States. This literature is divided between assertions of Japanese or U.S. superiority in this technology. However, both sides of the debate have offered evidence that, to date, has been primarily qualitative or based on one or two cases. This paper contributes to the debate in two ways. First, it offers a comprehensive literature review that analyzes existing comparisons of Japanese and U.S. firms in software development and summarizes the major proposed differences in performance. Second, it presents the first set of quantitative data collected from a statistically comparable sample of 24 U.S. and 16 Japanese software-development projects, and uses these data to test propositions from the literature. The analyses indicate that Japanese programmers perform at least as well as their U.S. counterparts in basic measures of productivity, quality (defects), and reuse of software code. The data also make it possible to offer models that explain some of the differences in productivity and quality.

[1]  Thomas A. Standish An Essay on Software Reuse , 1984, IEEE Transactions on Software Engineering.

[2]  Charles H. Kriebei,et al.  An Economics Approach to Modeling the Productivity of Computer Systems , 1980 .

[3]  Barry W. Boehm,et al.  Improving Software Productivity , 1987, Computer.

[4]  Tomoo Matsubara,et al.  Inside the Japanese Software Industry , 1984, Computer.

[5]  Charles B. Stabell OFFICE PRODUCTIVITY: A MICROECONOMIC FRAMEWORK FOR EMPIRICAL RESEARCH , 1982 .

[6]  Pearl Brereton,et al.  Software engineering environments , 1988 .

[7]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[8]  Claude E. Walston,et al.  A Method of Programming Measurement and Estimation , 1977, IBM Syst. J..

[9]  H. E. Dunsmore,et al.  Software engineering metrics and models , 1986 .

[10]  Fred P. Brooks,et al.  The Mythical Man-Month , 1975, Reliable Software.

[11]  R. Cole,et al.  Job-Changing in Japan: Is a New Focus Needed?@@@Work, Mobility and Participation: A Comparative Study of American and Japanese Industry. , 1980 .

[12]  G. Stalk,et al.  Kaisha: The Japanese Corporation. , 1986 .

[13]  R. W. Selby,et al.  Empirically analyzing software Reuse in a production environment , 1988 .

[14]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[15]  James D. McKeen Successful Development Strategies for Business Application Systems , 1983, MIS Q..

[16]  Anthony I. Wasserman,et al.  Software Engineering Environments , 1983, Adv. Comput..

[17]  David W. Embley,et al.  Can Programmers Reuse Software? , 1987, IEEE Software.

[18]  Will Tracz,et al.  Software reuse myths , 1988, SOEN.

[19]  Earl Chrysler,et al.  Some basic determinants of computer programming productivity , 1978, CACM.

[20]  Chris F. Kemerer,et al.  An empirical validation of software cost estimation models , 1987, CACM.

[21]  K. H. Kim,et al.  A Look at Japan's Development of Software Engineering Technology , 1983, Computer.

[22]  Laszlo A. Belady,et al.  The Japanese and Software: is it a Good Match? , 1986, Computer.

[23]  日経BP社,et al.  日経コンピュータ = Nikkei computer , 1981 .

[24]  G. Stalk,et al.  Kaisha, the Japanese Corporation. , 1987 .

[25]  Tomoo Matsubara,et al.  Special Feature the Computer Software Industry in Japan , 1981, Computer.

[26]  T. Capers Jones Reusability in Programming: A Survey of the State of the Art , 1984, IEEE Transactions on Software Engineering.

[27]  H. Hodara,et al.  A competitive assessment of the U.S. fiber optics industry , 1986 .

[28]  Veikko Seppänen,et al.  Reusability in software engineering , 1987 .

[29]  Marvin V. Zelkowitz,et al.  Software Engineering Practices in the US and Japan , 1984, Computer.

[30]  Peter Freeman,et al.  Tutorial, software reusability , 1987 .

[31]  Koji Torii,et al.  Quality-Assurance Technology in Japan , 1987, IEEE Software.

[32]  Bruce Arden,et al.  What Can Be Automated , 1980 .

[33]  Rajiv D. Banker,et al.  Factors Affecting Software Maintenance Productivity: an Exploratory Studyl , 1987, ICIS.

[34]  Atul Prakash,et al.  Software Engineering: Problems and Perspectives , 1984, Computer.

[35]  J. V. Bradley Distribution-Free Statistical Tests , 1968 .

[36]  D. Rubinfeld,et al.  Econometric models and economic forecasts , 2002 .

[37]  Michael A. Cusumano,et al.  Gaining Ground: Japan's Strides in Science and Technology , 1988 .

[38]  Lawrence H. Putnam,et al.  A General Empirical Solution to the Macro Software Sizing and Estimating Problem , 1978, IEEE Transactions on Software Engineering.

[39]  情報サービス産業協会 情報サービス産業白書 = White paper of information service industry , 1987 .

[40]  J. E. Gaffney,et al.  Software reuse—key to enhanced productivity: some quantitative models , 1989 .

[41]  Michael A. Cusumano,et al.  The software factory: a historical interpretation , 1989, IEEE Software.