Inductive Design of Maturity Models: Applying the Rasch Algorithm for Design Science Research

Maturity models are an established means to systematically document and guide the development of organizations using archetypal capability levels. Often, these models lack a sound foundation and/or are derived on the basis of an arbitrary design method. In order to foster the design of relevant and rigorous artifacts, this paper presents a method for maturity model construction that applies the Rasch algorithm and cluster analysis as a sound methodical foundation. The Rasch algorithm is widely used to improve scholarly intelligence and attainment tests. In order to demonstrate the application of the proposed method and to evaluate its usability and applicability, we present a design exemplar in the business intelligence domain.

[1]  Robert Winter,et al.  Essential Layers, Artifacts, and Dependencies of Enterprise Architecture , 2006, 2006 10th IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW'06).

[2]  Thilini Ariyachandra,et al.  Data Warehousing Stages of Growth , 2001, Inf. Syst. Manag..

[3]  Robert Winter,et al.  Design science research in Europe , 2008 .

[4]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[5]  James M. Utterback,et al.  A dynamic model of process and product innovation , 1975 .

[6]  Pertti Järvinen.  On Reviewing of Results in Design Research , 2007, ECIS.

[7]  Dietmar Pfahl,et al.  Making Globally Distributed Software Development a Success Story, International Conference on Software Process, ICSP 2008, Leipzig, Germany, May 10-11, 2008, Proceedings , 2008, ICSP.

[8]  Tobias Mettler.  Supply Management im Krankenhaus : Konstruktion und Evaluation eines konfigurierbaren Reifegradmodells zur zielgerichteten Gestaltung , 2010 .

[9]  Markus Bühner.  Einführung in die Test- und Fragebogenkonstruktion , 2008 .

[10]  Philip B. Crosby,et al.  Quality Is Free: The Art of Making Quality Certain , 1979 .

[11]  Mike Gregory,et al.  The use of maturity models/grids as a tool in assessing product development capability , 2002, IEEE International Engineering Management Conference.

[12]  J. Simpson,et al.  The Oxford English Dictionary , 1884 .

[13]  Sasa M. Dekleva,et al.  Measuring Software Engineering Evolution: A Rasch Calibration , 1997, Inf. Syst. Res..

[14]  Robert Winter,et al.  Global Perspectives on Design Science Research, 5th International Conference, DESRIST 2010, St. Gallen, Switzerland, June 4-5, 2010. Proceedings , 2010, DESRIST.

[15]  P. John Clarkson,et al.  Developing maturity grids for assessing organisational capabilities: Practitioner guidance , 2009 .

[16]  Dave Zubrow,et al.  Moving On Up: Data and Experience Doing CMM-Based Software Process Improvement. , 1995 .

[17]  Michael Rosemann,et al.  Understanding the Main Phases of Developing a Maturity Assessment Model , 2005 .

[18]  Tobias Mettler,et al.  Situational maturity models as instrumental artifacts for organizational design , 2009, DESRIST.

[19]  G. De Soete,et al.  Clustering and Classification , 2019, Data-Driven Science and Engineering.

[20]  Richard Turner,et al.  CMMI Distilled: A Practical Introduction to Integrated Process Improvement , 2001 .

[21]  Markus M. Mäkelä,et al.  Measuring and Comparing the Adoption of Software Process Practices in the Software Product Industry , 2008, ICSP.

[22]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[23]  I. W. Molenaar,et al.  Rasch models: foundations, recent developments and applications , 1995 .

[24]  Marlies van Steenbergen,et al.  The Design of Focus Area Maturity Models , 2010, DESRIST.

[25]  Jeffrey Pfeffer,et al.  Knowing "What" to Do Is Not Enough: Turning Knowledge into Action , 1999 .

[26]  Robert Winter,et al.  Business Intelligence Maturity Models: An Overview , 2010 .

[27]  Deborah Bunker,et al.  Human Benefit through the Diffusion of Information Systems Design Science Research - IFIP WG 8.2/8.6 International Working Conference, Perth, Australia, March 30 - April 1, 2010. Proceedings , 2010, Human Benefit through the Diffusion of Information Systems Design Science Research.

[28]  Peter Fettke,et al.  Reference Modeling for Business Systems Analysis , 2006 .

[29]  Robert Winter,et al.  Towards a Classification of Maturity Models in Information Systems , 2010 .

[30]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[31]  R. Nolan,et al.  Managing the Four Stages of EDP Growth , 1974 .

[32]  Hisham M. Haddad,et al.  A survey of industrial experiences with CMM and the teaching of CMM practices , 2002 .

[33]  W. Härdle,et al.  Applied Multivariate Statistical Analysis , 2003 .

[34]  Jan Pries-Heje,et al.  Management Design Theories , 2010, Human Benefit through the Diffusion of Information Systems Design Science Research.

[35]  Michael Rosemann,et al.  Towards a Business Process Management Maturity Model , 2005, ECIS.

[36]  Björn Niehaves,et al.  Maturity Models in IS Research , 2010, ECIS.

[37]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[38]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[39]  Mark C. Paulk,et al.  Capability Maturity Model , 1991 .

[40]  Jörg Becker,et al.  Developing Maturity Models for IT Management , 2009, Bus. Inf. Syst. Eng..