A comprehensive assessment of measurement equivalence in operations management

This paper provides a comprehensive framework for treating equivalence both prior to data collection and during subsequent analyses, and assesses the extent to which equivalence is considered in survey research in six leading empirical Operations Management (OM) journals (Decision Sciences, International Journal of Operations & Production Management, International Journal of Production Research, Journal of Operations Management, Management Science and Production and Operations Management). Measurement equivalence of latent variables in survey data is an important condition that should be met in order to meaningfully pool and/or compare data stemming from apparently heterogeneous sub-groups. We assess 465 survey articles from a six-year period from 2006 to 2011 and document these articles in relation to the four main stages of our comprehensive framework: identifying sources of heterogeneity; maximising equivalence prior to data collection; testing measurement equivalence after data collection; and dealing with partial and non-equivalence. We conclude that pooling of data from heterogeneous sub-groups is common practice in OM, but that awareness and testing of equivalence remains limited. Given these findings, we further elaborate the best practices detected in those few OM studies that do address equivalence in some way. We conclude that to improve the quality of OM survey research, authors, editors and reviewers should pay greater attention to equivalence, and we provide a pragmatic checklist of measurement equivalence issues across the four stages.

[1]  F. Drasgow.  Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues , 1984 .

[2]  Willem E. Saris.  Variation in response functions : a source of measurement error in attitude research , 1988 .

[3]  Mark E. Ferguson,et al.  PRODUCTION AND OPERATIONS MANAGEMENT , 2008 .

[4]  B. Byrne,et al.  Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. , 1989 .

[5]  L Kish,et al.  Multipopulation survey designs: five types with seven shared aspects. , 1994, International statistical review = Revue internationale de statistique.

[6]  Michael R. Mullen.  Diagnosing Measurement Equivalence in Cross-National Research , 1995 .

[7]  F. Schmidt.  Statistical Significance Testing and Cumulative Knowledge in Psychology: Implications for Training of Researchers , 1996 .

[8]  Roberto Filippini,et al.  Operations management research: some reflections on evolution, models and empirical studies in OM , 1997 .

[9]  C. Holsapple,et al.  Evaluating and classifying POM journals , 1997 .

[10]  J. Steenkamp,et al.  Assessing Measurement Invariance in Cross-National Consumer Research , 1998 .

[11]  V. Grover,et al.  An assessment of survey research in POM: from constructs to theory , 1998 .

[12]  P. Bentler,et al.  Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification , 1998 .

[13]  Gordon W. Cheung,et al.  Testing Factorial Invariance across Groups: A Reconceptualization and Proposed New Method , 1999 .

[14]  A. Soteriou,et al.  Assessing production and operations management related journals: the European perspective , 1999 .

[15]  R. Hensley.  A review of operations management studies using scale development techniques , 1999 .

[16]  N. Venkatraman,et al.  Testing metric equivalence in cross-national strategy research : An empirical test across the United States and Japan , 1999 .

[17]  Rohit Verma,et al.  MULTIPLE RATERS IN SURVEY‐BASED OPERATIONS MANAGEMENT RESEARCH: A REVIEW AND TUTORIAL , 2000 .

[18]  R. Vandenberg,et al.  A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research , 2000 .

[19]  Larry C. Giunipero,et al.  Organizational Learning in Global Purchasing: A Model and Test of Internal Users and Corporate Buyers , 2000, Decis. Sci..

[20]  S. Barman,et al.  Discipline note Perceived relevance and quality of POM journals: a decade later , 2001 .

[21]  R. Bhagat.  Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations , 2002 .

[22]  Larissa L. Smith.  On the Usefulness of Item Bias Analysis to Personality Psychology , 2002 .

[23]  Thomas Y. Choi,et al.  Survey research in operations management: historical analyses , 2003 .

[24]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[25]  Y. Poortinga,et al.  Response Styles in Rating Scales , 2004 .

[26]  B. Avolio,et al.  . , 2005, The Leadership Quarterly.

[27]  Xenophon Koufteros,et al.  Internal and External Integration for Product Development: The Contingency Effects of Uncertainty, Equivocality, and Platform Strategy , 2005, Decis. Sci..

[28]  Fabrizio Salvador,et al.  TQM across multiple countries: Convergence hypothesis versus national specificity arguments , 2005 .

[29]  Nikos Tsikriktsis,et al.  A review of techniques for treating missing data in OM survey research , 2005 .

[30]  C. Craig,et al.  On Improving the Conceptual Foundations of International Marketing Research , 2006 .

[31]  C. Carter,et al.  International supply relationships and non-financial performance—A comparison of U.S. and German practices , 2006 .

[32]  Utpal M. Dholakia,et al.  Open Source Software User Communities: A Study of Participation in Linux User Groups , 2006, Manag. Sci..

[33]  Mark A. Vonderembse,et al.  Mediating effects of computer-aided design usage: From concurrent engineering to product development performance , 2006 .

[34]  Kenneth K. Boyer,et al.  Customer behavioral intentions for online purchases: An examination of fulfillment method and customer experience level , 2006 .

[35]  Edmund Prater,et al.  A comparative model of firm size and the global operational dynamics of U.S. firms in Europe , 2006 .

[36]  Rachna Shah,et al.  Use of structural equation modeling in operations management research: Looking back and forward ☆ , 2006 .

[37]  G. Hult,et al.  Knowledge as a strategic resource in supply chains , 2006 .

[38]  George A. Marcoulides,et al.  Product development practices and performance: A structural equation modeling-based multi-group analysis , 2006 .

[39]  Hale Kaynak,et al.  Using replication research for just-in-time purchasing construct development , 2006 .

[40]  Jean-Paul Fox,et al.  Relaxing Measurement Invariance in Cross-National Consumer Research Using a Hierarchical IRT Model , 2007 .

[41]  S. Schwartz.  Value orientations: Measurement, antecedents and consequences across nations. , 2007 .

[42]  Dennis W. Krumwiede,et al.  Efficacy of environmental and supplier relationship investments—moderating effects of external environment , 2007 .

[43]  Caroline Roberts,et al.  Measuring Attitudes Cross-Nationally , 2007 .

[44]  Willem E. Saris,et al.  Design, Evaluation, and Analysis of Questionnaires for Survey Research: Saris/Design , 2007 .

[45]  Willem E. Saris,et al.  Design, Evaluation, and Analysis of Questionnaires for Survey Research , 2007 .

[46]  J. González‐Benito.  A theory of purchasing's contribution to business performance , 2007 .

[47]  Jafar Razmi,et al.  Assessing the impact of information technology on firm performance considering the role of intervening variables: organizational infrastructures and business processes reengineering , 2007 .

[48]  T. S. Lee,et al.  Pooling Data Across Transparently Different Groups of Key Informants: Measurement Equivalence and Survey Research , 2008, Decis. Sci..

[49]  Manoj K. Malhotra,et al.  Measurement Equivalence Using Generalizability Theory: An Examination of Manufacturing Flexibility Dimensions , 2008, Decis. Sci..

[50]  Nukhet Harmancioglu,et al.  Data equivalence in cross-cultural international business research: assessment and guidelines , 2008 .

[51]  David A. Johnston,et al.  The climate for co‐operation: buyer‐supplier beliefs and behavior , 2008 .

[52]  A. J. Cullen,et al.  Critical success factors for B2B e‐commerce use within the UK NHS pharmaceutical supply chain , 2009 .

[53]  Willem E. Saris,et al.  Testing Structural Equation Models or Detection of Misspecifications? , 2009 .

[54]  James A. Narus,et al.  Improving sourcing decisions in NPD projects: Monetary quantification of points of difference , 2009 .

[55]  Ana B. Escrig-Tena,et al.  An empirical assessment of the EFQM Excellence Model: Evaluation as a TQM framework relative to the MBNQA Model , 2009 .

[56]  R. J. Vokurka,et al.  Mapping the future of supply chain management: a Delphi study , 2009 .

[57]  Joseph P. Cannon,et al.  Building long-term orientation in buyer–supplier relationships: The moderating role of culture , 2010 .

[58]  Viswanath Venkatesh,et al.  Model of Migration and Use of Platforms: Role of Hierarchy, Current Generation, and Complementarities in Consumer Settings , 2010, Manag. Sci..

[59]  Daniel F. Lynch,et al.  Examining supply chain relationships: Do buyer and supplier perspectives on collaborative relationships differ? , 2010 .

[60]  Thomas J. Kull,et al.  Quality management effectiveness in Asia: The influence of culture , 2010 .

[61]  Stanley E. Fawcett,et al.  A Dynamic Collaboration Capability as a Source of Competitive Advantage , 2011, Decis. Sci..

[62]  Laura M. Birou,et al.  Applied logistics knowledge impact on financial performance , 2011 .

[63]  S. Dowlatshahi.  An empirical study of the ISO 9000 certification in global supply chain of maquiladoras , 2011 .

[64]  David Xiaosong Peng,et al.  Impacts of Information Technology on Mass Customization Capability of Manufacturing Plants , 2011 .

[65]  Chad W. Autry,et al.  Toward Greater Validation of Supply Chain Management Theory and Concepts: The Roles of Research Replication and Meta‐Analysis , 2011 .

[66]  Giovani J.C. da Silveira,et al.  Our own translation box: exploring proximity antecedents and performance implications of customer co-design in manufacturing , 2011 .

[67]  Fritz Drasgow,et al.  Effect size indices for analyses of measurement equivalence: understanding the practical importance of differences between groups. , 2011, The Journal of applied psychology.

[68]  John W. Henke,et al.  The boundary spanning capabilities of purchasing agents in buyer-supplier trust development , 2011 .

[69]  E. Davidov,et al.  Assessment of Measurement Equivalence with Cross-National and Longitudinal Surveys in Political Science , 2012 .

[70]  Gordon W. Cheung,et al.  A Direct Comparison Approach for Testing Measurement Invariance , 2012 .

[71]  Asta Salmi,et al.  Continental differences in purchasing strategies and tools , 2013 .

[72]  D. Knoppen,et al.  Operationalizing the Theory of Human Values: Balancing Homogeneity of Reflective Items and Theoretical Coverage , 2013 .

[73]  A. Weele,et al.  The Future of Purchasing and Supply Management Research: About Relevance and Rigor , 2014 .

[74]  M. Gheini,et al.  Intracranial Stenting: A Review of the Literature and Recommended Remedies , 2016, Galen Medical Journal.

[75]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[76]  Melanie Grunwald,et al.  Cross Cultural Survey Methods , 2016 .