Toward a continuum of measurement scales in Just-in-Time (JIT) research – an examination of the predictive validity of single-item and multiple-item measures

We compare the predictive validity of single-item and multiple-item measures utilized in Just-in-Time (JIT) research. The study examines if single-item measures could be used for some of the JIT practices, especially if the object of inquiry is concrete singular and if the attribute to be researched is concrete. Arguments are developed for the concrete nature of the JIT practice of “set-up time reduction” and we examine the ability of a single-item measure of this variable to predict the criterion variable (delivery performance). In addition, the study also examines the efficacy of using multiple-item measures for variables that are abstract in nature, and thereby attempts to develop a continuum of JIT constructs ranging from concrete to abstract. The results obtained by analyzing two sets of survey data show that multiple-item measures are not necessarily more valid than single-item measures for all constructs. The findings provide evidence that multiple-item measures and single-item measures for scale development should be contingent upon the nature of constructs. For concrete constructs, single-item measures are as valid as multi-item measures. Meanwhile, for abstract constructs it is important to ensure that multiple items are considered to capture the multi-dimensional nature of these constructs. Results also reveal that JIT practices display significant differences in terms of abstract/concrete perceptions. The paper presents theoretical and practical implications of the findings, and offers directions for future research.

[1]  J. P. Wanous,et al.  Overall job satisfaction: how good are single-item measures? , 1997, The Journal of applied psychology.

[2]  N. Venkatraman,et al.  Strategic Orientation of Business Enterprises: The Construct, Dimensionality and Measurement , 2015 .

[3]  Roger G. Schroeder,et al.  A FRAMEWORK AND MEASUREMENT INSTRUMENT FOR JUST‐IN‐TIME MANUFACTURING , 1993 .

[4]  Roger G. Schroeder,et al.  The impact of just-in-time manufacturing and its infrastructure on manufacturing performance , 1997 .

[5]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[6]  Adamantios Diamantopoulos,et al.  Measuring Abstract Constructs in Management and Organizational Research: The Case of Export Coordination , 2008 .

[7]  H. Kwon,et al.  The Feasibility of Single-Item Measures in Sport Loyalty Research , 2005 .

[8]  Damodar Y. Golhar,et al.  The just-in-time philosophy : a literature review , 1991 .

[9]  Terry L. Childers,et al.  Understanding mail survey response behavior: A meta-analysis. , 1991 .

[10]  J. P. Wanous,et al.  Single-Item Reliability: A Replication and Extension , 2001 .

[11]  J. Rossiter,et al.  The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs , 2007 .

[12]  W. Killgore.  The Visual Analogue Mood Scale: Can a Single-Item Scale Accurately Classify Depressive Mood State? , 1999, Psychological Reports.

[13]  Thomas V. Scannell,et al.  UPSTREAM SUPPLY CHAIN MANAGEMENT AND COMPETITIVE PERFORMANCE IN THE AUTOMOTIVE SUPPLY INDUSTRY , 2000 .

[14]  Rachna Shah,et al.  Use of structural equation modeling in operations management research: Looking back and forward ☆ , 2006 .

[15]  Soo Wook Kim,et al.  Manufacturing Practices and Strategy Integration: Effects on Cost Efficiency, Flexibility, and Market-Based Performance , 2005, Decis. Sci..

[16]  Sang M. Lee,et al.  Implementation of Just‐in‐time Systems in US Manufacturing Firms , 1989 .

[17]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[18]  Roger G. Schroeder,et al.  Relationship Between JIT and TQM: Practices and Performance , 1995 .

[19]  Cornelia Dröge,et al.  THE EFFECT OF JUST-IN-TIME WITH CUSTOMERS ON ORGANIZATIONAL DESIGN AND PERFORMANCE , 1999 .

[20]  S. Snell,et al.  THE STRATEGIC USE OF INTEGRATED MANUFACTURING: AN EMPIRICAL EXAMINATION , 1996 .

[21]  Pietro Romano,et al.  Leveraging fitness and lean bundles to build the cumulative performance sand cone model , 2015 .

[22]  Anand Nair,et al.  Relationship between just-in-time manufacturing practices and performance: A meta-analytic investigation , 2010 .

[23]  David R. Upton.  Just‐in‐time and performance measurement systems , 1998 .

[24]  Pietro Romano,et al.  Assessing the impact of just-in-time on operational performance at varying degrees of repetitiveness , 2013 .

[25]  Tai-Young Kim,et al.  Positioning among Organizations in a Population: Moves between Market Segments and the Evolution of Industry Structure , 2006 .

[26]  Richard G. Netemeyer,et al.  Scaling Procedures: Issues and Applications , 2003 .

[27]  R. B. Chase,et al.  The Service Factory , 1988 .

[28]  Cipriano Forza,et al.  Achieving superior operating performance from integrated pipeline management: an empirical study , 1996 .

[29]  R. Anthony Inman,et al.  Determining the Critical Elements of Just-In-Time Implementation , 1992 .

[30]  R. Schroeder,et al.  Relationships between implementation of TQM, JIT, and TPM and manufacturing performance , 2001 .

[31]  D. Dillman,et al.  Mail and telephone surveys , 1978 .

[32]  K. Trzesniewski,et al.  Measuring Global Self-Esteem: Construct Validation of a Single-Item Measure and the Rosenberg Self-Esteem Scale , 2001 .

[33]  D. G. Gardner,et al.  Single-Item Versus Multiple-Item Measurement Scales: An Empirical Comparison , 1998 .

[34]  Augustine A. Lado,et al.  Strategic purchasing, supply management, and firm performance , 2004 .

[35]  John R. Rossiter,et al.  The C-OAR-SE procedure for scale development in marketing , 2002 .

[36]  Peter T. Ward,et al.  Impact of Information Technology Integration and Lean/Just-In-Time Practices on Lead-Time Performance , 2006, Decis. Sci..

[37]  Alexander E. Ellinger,et al.  A SUMMARY AND ANALYSIS OF MULTI-ITEM SCALES USED IN LOGISTICS RESEARCH , 2002 .

[38]  Fariborz Damanpour,et al.  The Adoption of Technological, Administrative, and Ancillary Innovations: Impact of Organizational Factors , 1987 .

[39]  Samuel B. Bacharach,et al.  Organizational Theories: Some Criteria for Evaluation , 1989 .

[40]  James F. Cox,et al.  Designing performance measurement systems for just-in-time operations , 1990 .

[41]  Y. Sugimori,et al.  Toyota production system and Kanban system Materialization of just-in-time and respect-for-human system , 1977 .

[42]  Todd R. Zenger,et al.  Testing Alternative Theories of the Firm: Transaction Cost, Knowledge-Based, and Measurement Explanations for Make-or- Buy Decisions in Information Services , 1997 .

[43]  J. Wacker.  A theory of formal conceptual definitions: developing theory-building measurement instruments , 2004 .

[44]  Cipriano Forza,et al.  Survey research in operations management: a process‐based perspective , 2002 .

[45]  John N. Pearson,et al.  Jit Manufacturing: a Survey of Implementations in Small and Large U.S. Manufacturers , 1999 .

[46]  J. Rossiter,et al.  Tailor-made single-item measures of doubly concrete constructs , 2009 .

[47]  C Droge,et al.  THE JUST-IN-TIME INVENTORY EFFECT: DOES IT HOLD UNDER DIFFERENT CONTEXTURAL, ENVIRONMENTAL AND ORGANIZATIONAL CONDITIONS? , 1998 .

[48]  Soo Wook Kim,et al.  Disentangling leanness and agility: An empirical investigation , 2006 .

[49]  Ken A. Smith,et al.  Making Use of Difference: Diversity, Debate, and Decision Comprehensiveness in Top Management Teams , 1999 .

[50]  K. Tedin,et al.  The Effect of Cost and Importance Factors on the Return Rate for Single and Multiple Mailings , 1982 .

[51]  Stanley E. Fawcett,et al.  Product and employee development in advanced manufacturing: Implementation and impact , 2001 .

[52]  Ujwal Kayande,et al.  How fine is C-OAR-SE? A generalizability theory perspective on Rossiter's procedure , 2005 .

[53]  Rosemary R. Fullerton,et al.  The production performance benefits from JIT implementation , 2001 .

[54]  Bradley R. Staats,et al.  Lean principles, learning, and knowledge work: Evidence from a software services provider , 2011 .

[55]  Barbara B. Flynn,et al.  Empirical research methods in operations management , 1990 .

[56]  Peter T. Ward,et al.  Lean manufacturing: context, practice bundles, and performance , 2003 .

[57]  John R. Rossiter,et al.  Reminder: A horse is a horse , 2005 .

[58]  Roger G. Schroeder,et al.  THE IMPACT OF ELECTRONIC DATA INTERCHANGE ON DELIVERY PERFORMANCE , 2001 .

[59]  Stanley E. Fawcett,et al.  A contingency perspective of just-in-time purchasing: globalization, implementation, and performance , 1995 .

[60]  V. Grover,et al.  An assessment of survey research in POM: from constructs to theory , 1998 .

[61]  M. Frohlich.  Techniques for improving response rates in OM survey research , 2002 .

[62]  J. Scott Armstrong,et al.  Estimating nonresponse bias in mail surveys. , 1977 .

[63]  Jose Arturo Garza-Reyes,et al.  The impact of lean methods and tools on the operational performance of manufacturing organisations , 2014 .

[64]  Giorgia Dal Pont,et al.  Complementarity and lean manufacturing bundles: an empirical analysis , 2011 .

[65]  J. Hair.  Multivariate data analysis , 1972 .

[66]  Martin O’Driscoll.  Design for manufacture , 2002 .

[67]  R. Schroeder,et al.  Manufacturing practices, strategic fit and performance: A routine‐based view , 2004 .

[68]  Alberto De Toni,et al.  Operating Levels in Product and Process Design , 1991 .

[69]  Hale Kaynak,et al.  The relationship between just-in-time purchasing techniques and firm performance , 2002, IEEE Trans. Engineering Management.

[70]  R. A. Inman,et al.  Agile manufacturing: Relation to JIT, operational performance and firm performance , 2011 .

[71]  Laura M. Birou,et al.  Build‐to‐order and just‐in‐time as predictors of applied supply chain knowledge and market performance , 2005 .

[72]  Thomas Y. Choi,et al.  Survey research in operations management: historical analyses , 2003 .

[73]  R. Loo.  A caveat on using single‐item versus multiple‐item scales , 2002 .

[74]  Bhanu S. Ragu-Nathan,et al.  Development and validation of a measurement instrument for studying supply chain management practices , 2005 .

[75]  W. Fisher,et al.  Assessing Measurement Properties of Two Single-item General Health Measures , 2006, Quality of Life Research.

[76]  John T. Mentzer,et al.  LOGISTICS SALIENCE IN A CHANGING ENVIRONMENT , 2004 .

[77]  Elliot Rabinovich,et al.  Assessing the Effects of Operational Processes and Information Systems on Inventory Performance , 2006 .

[78]  R. Germain,et al.  THE IMPLICATIONS OF JUST-IN-TIME FOR LOGISTICS ORGANIZATION MANAGEMENT AND PERFORMANCE / , 1996 .

[79]  Titus Oshagbemi,et al.  Overall job satisfaction: how good are single versus multiple‐item measures? , 1999 .

[80]  Adamantios Diamantopoulos,et al.  The C-OAR-SE procedure for scale development in marketing: a comment , 2005 .