Psychometric theory applied to questionnaire-based appraisals on software process assessments: An initial report

Adopting a software process model for organizations requires them to begin with an appraisal of their current processes. However, the current existing automated tools for process assessments can not verify the authenticity of answers and are therefore limited in their reliability level depending only in the employees' responses. This paper presents our research in psychometric theory applied to questionnaire-based appraisals to determine feasibility of combining them together to develop a reliable assessment tool to provide more reliable evidences about organizations' current maturity/capability level. We have found a lot of work can be done to improve appraisals questionnaires with psychometric theory and we show here areas that can be improved and first steps in how it can be done.

[1]  Luis E. Suarez,et al.  Determining Practice Achievement in Project Management using a Two-Phase Questionnaire on Small and Medium Enterprises , 2007, International Conference on Software Engineering Advances (ICSEA 2007).

[2]  Ana Regina Cavalcanti da Rocha,et al.  Implementing Software Process Improvement Initiatives in Small and Medium-Size Enterprises in Brazil , 2007, 6th International Conference on the Quality of Information and Communications Technology (QUATIC 2007).

[3]  Christiane Gresse von Wangenheim,et al.  Experiences on establishing software processes in small companies , 2006, Inf. Softw. Technol..

[4]  T. Kline.  Psychological Testing: A Practical Approach to Design and Evaluation , 2005 .

[5]  Ivan A. Garcia,et al.  Toward Automated Support for Software Process Improvement Initiatives in Small and Medium Size Enterprises , 2009, SERA.

[6]  C. Pacheco,et al.  Use of Questionnaire-Based Appraisal to Improve the Software Acquisition Process in Small and Medium Enterprises , 2008 .

[7]  Gonzalo Cuevas Agustín,et al.  Assessment of the requirements management process using a two-stage questionnaire , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[8]  E. Cueto.  Introducción a la psicometría , 1993 .

[9]  Donna K. Dunaway,et al.  CMM-Based Appraisal for Internal Process Improvement (CBA IPI) Version 1.2 Method Description , 2001 .

[10]  Beijun Shen,et al.  A Case Study of Software Process Improvement in a Chinese Small Company , 2008, 2008 International Conference on Computer Science and Software Engineering.

[11]  Mario Piattini,et al.  Software Process Improvement: The Competisoft Project , 2007, Computer.

[12]  Mark C. Paulk,et al.  Capability Maturity Model , 1991 .

[13]  Manuel Pérez Cota,et al.  Experiences in the Application of Software Process Improvement in SMES , 2004, Software Quality Journal.

[14]  António Menezes Leitão,et al.  Offline execution in workflow-enabled Web applications , 2007 .

[15]  Hang Li,et al.  Mining Open Answers in Questionnaire Data , 2001, IEEE Intell. Syst..

[16]  Mary Beth Chrissis,et al.  CMMI Interpretive Guidance Project: Preliminary Report , 2003 .