Assessing Software Replacement Success: An Industrial Case Study Applying Four Approaches

This paper describes an industrial case study assessing software replacement success and other effects. The target of assessments has been a large commercial legacy system for customer register management. The success of its replacement by its performed rewrite has been assessed via four approaches concerning: user satisfaction, strengths and problems of the system, problem surveillance and expert judgments. The approaches and metrics have been selected in cooperation with industrial experts in order that they would meet the needs of their organization. The assessments have been conducted by comparing the situations before and after the rewrite. They have included quality aspects. The applied approaches have supplemented each other well and results provided by them have been mainly consistent. The study has offered a wide view of the system replacement effects and lessons for the replacement assessment process improvement in industrial settings.

[1]  Dewayne E. Perry,et al.  Implications of evolution metrics on software maintenance , 1998, Proceedings. International Conference on Software Maintenance (Cat. No. 98CB36272).

[2]  Ian Warren,et al.  Renaissance: a method to support software system evolution , 2002, Proceedings 26th Annual International Computer Software and Applications.

[3]  Grace A. Lewis,et al.  Modernizing Legacy Systems - Software Technologies, Engineering Processes, and Business Practices , 2003, SEI series in software engineering.

[4]  Harry M. Sneed,et al.  Critical success factors in software maintenance: a case study , 2003, International Conference on Software Maintenance, 2003. ICSM 2003. Proceedings..

[5]  Keith H. Bennett,et al.  Decision model for legacy systems , 1999, IEE Proc. Softw..

[6]  Chris Verhoef,et al.  Quantitative IT portfolio management , 2002, Sci. Comput. Program..

[7]  Lerina Aversano,et al.  Supporting decisions on the adoption of re-engineering technologies , 2004, Eighth European Conference on Software Maintenance and Reengineering, 2004. CSMR 2004. Proceedings..

[8]  Brian Lawler,et al.  Review of "Modernizing legacy systems: software technologies, engineering processes and business practices by Robert C. Seacord, Daniel Plakosh and Grace A. Lewis." Addison Wesley 2003 , 2004, SOEN.

[9]  Vernon J. Richardson,et al.  Returns on Investments in Information Technology: A Research Synthesis , 2002, J. Inf. Syst..

[10]  Jarmo J. Ahonen,et al.  ISEBA – A Framework for IS Evolution Benefit Assessment , 2005 .

[11]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[12]  Fatemeh Zahedi,et al.  Policy analysis for warranty, maintenance, and upgrade of software systems , 2001, J. Softw. Maintenance Res. Pract..

[13]  Harry M. Sneed Estimating the costs of software maintenance tasks , 1995, Proceedings of International Conference on Software Maintenance.

[14]  E. Burton Swanson,et al.  Problems in application software maintenance , 1981, CACM.

[15]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[16]  Jarmo J. Ahonen,et al.  Software modernization decision criteria: an empirical study , 2005, Ninth European Conference on Software Maintenance and Reengineering.

[17]  Giuseppe Visaggio Value‐based decision model for renewal processes in software maintenance , 2000, Ann. Softw. Eng..