Measuring organizational effectiveness in information and communication technology companies using item response theory.

The aim of this paper is to measure the effectiveness of the organizations Information and Communication Technology (ICT) from the point of view of the manager, using Item Response Theory (IRT). There is a need to verify the effectiveness of these organizations which are normally associated to complex, dynamic, and competitive environments. In academic literature, there is disagreement surrounding the concept of organizational effectiveness and its measurement. A construct was elaborated based on dimensions of effectiveness towards the construction of the items of the questionnaire which submitted to specialists for evaluation. It demonstrated itself to be viable in measuring organizational effectiveness of ICT companies under the point of view of a manager through using Two-Parameter Logistic Model (2PLM) of the IRT. This modeling permits us to evaluate the quality and property of each item placed within a single scale: items and respondents, which is not possible when using other similar tools.

[1]  Tom R. Burns,et al.  The Management of Innovation. , 1963 .

[2]  P. Allen-meares,et al.  Application of rasch analysis exploring differences in depression between african-american and white children , 1998 .

[3]  J. Rosenzweig,et al.  General systems theory: applications for organization and management. , 1972, The Journal of nursing administration.

[4]  Dalton Francisco de Andrade,et al.  Measuring web usability using item response theory: Principles, features and opportunities , 2011, Interact. Comput..

[5]  Brian M Kleiner,et al.  Macroergonomics: analysis and design of work systems. , 2006, Applied ergonomics.

[6]  Luís Otávio Façanha,et al.  Programas sociais: efetividade, eficiência e eficácia como dimensões operacionais da avaliação , 2001 .

[7]  De Ayala,et al.  The Theory and Practice of Item Response Theory , 2008 .

[8]  A new questionnaire specifically designed for patients affected by chronic obstructive pulmonary disease; The Italian Health Status Questionnaire. , 2006, Respiratory medicine.

[9]  Stuart Jay Deutsch,et al.  Organizational Effectiveness: A Multiple-Constituency Approach , 1980 .

[10]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[11]  J. Pfeffer,et al.  The External Control of Organizations. , 1978 .

[12]  F. Lord.  A theory of test scores. , 1952 .

[13]  Jan Dul,et al.  Ergonomics Contributions to Company Strategies , 2008, Applied ergonomics.

[14]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[15]  Detection of determinant genes and diagnostic via Item Response Theory , 2004 .

[16]  R. Radner.  Hierarchy: The Economics of Management , 1992 .

[17]  Hanna Schramm-Klein,et al.  Competitive Advantage of Nations and Regional Clusters , 2009 .

[18]  Richard L. Daft,et al.  4 – The Effectiveness of Interpretation Systems , 1983 .

[19]  David K. Banner,et al.  Designing Effective Organizations: Traditional and Transformational Views , 1994 .

[20]  P. Lawrence,et al.  Organization and environment , 1967 .

[21]  R K Hambleton,et al.  Emergence of item response modeling in instrument development and data analysis. , 2000, Medical care.

[22]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[23]  Robert Carton,et al.  Measuring organizational performance , 2006 .

[24]  Shahid A. Zia,et al.  Competitive Strategy: Techniques for Analyzing Industries & Competitors , 2013 .

[25]  J. McCann,et al.  Organizational Effectiveness: Changing Concepts for Changing Environments , 2004 .

[26]  Mary S. Thibodeaux,et al.  Organizational effectiveness and commitment through strategic management , 1996 .

[27]  Emrah Cengiz.  MEASURING CUSTOMER SATISFACTION: MUST OR NOT? , 2010 .

[28]  G. J. Mellenbergh,et al.  Generalized linear item response theory. , 1994 .

[29]  G. Yao,et al.  Evaluating Item Discrimination Power of WHOQOL-BREF from an Item Response Model Perspectives , 2009 .

[30]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[31]  John Rohrbaugh,et al.  A Spatial Model of Effectiveness Criteria: Towards a Competing Values Approach to Organizational Analysis , 1983 .

[32]  D. Whetten,et al.  Organizational Effectiveness: A Comparison of Multiple Models , 1984 .

[33]  Jagdip Singh,et al.  Tackling measurement problems with Item Response Theory: Principles, characteristics, and assessment, with an illustrative example , 2004 .

[34]  M. Buelens,et al.  A Two-Level Competing Values Approach to Measure Nonprofit Organizational Effectiveness , 2008 .

[35]  F. Glen.  The social psychology of organizations , 1976 .

[36]  Anne S. Tsui,et al.  A Multiple-Constituency Model of Effectiveness: An Empirical Examination at the Human Resource Subunit Level. , 1990 .

[37]  F. Samejima.  Estimation of latent ability using a response pattern of graded scores , 1968 .

[38]  Sally Coleman Selden,et al.  No Longer Unmeasurable? A Multidimensional Integrated Model of Nonprofit Organizational Effectiveness , 2004 .

[39]  J. Hammer,et al.  Which doctor? Combining vignettes and item response to measure clinical competence , 2005 .

[40]  M. Reckase.  Historical Background for Multidimensional Item Response Theory (MIRT) , 2009 .

[41]  Freddy Rangkuti,et al.  Measuring customer satisfaction , 2004 .

[42]  Hal W. Hendrick,et al.  Macroergonomics: An Introduction to Work System Design , 2000 .

[43]  R. Chang.  Measuring Organizational Performance: Mengukur Kinerja Organisasi , 2012 .

[44]  Jacob Bronowski,et al.  Science and Human Values , 1956 .

[45]  Arnold S. Tannenbaum,et al.  A Study of Organizational Effectiveness , 1957 .

[46]  Paul S. Goodman,et al.  7 – On the Demise of Organizational Effectiveness Studies1 , 1983 .