Conceptualizing models using multidimensional constructs: a review and guidelines for their use

While information on multidimensional constructs and empirical methods has become more accessible, there remain substantial challenges to theorizing about their form and implications. There are at least two ostensible reasons for such difficulties. First is the issue of terminology; many different terms are currently used to represent the same structural concept, and there is no evidence of standardization taking place around a single set of terms. Second, many studies do not clearly explain the theoretical reasons for choosing the specific multidimensional form of their constructs. To address these deficiencies, we use concepts from the research methods literature, and illustrations from the information systems (IS) literature, to review definitions and issues related to conceptualizing and operationalizing structural models that include multidimensional constructs. Such advice is necessary if we are going to develop and test increasingly sophisticated theoretical models in IS research. We also offer guidelines about how to conceptualize specific forms of multidimensional constructs. By lending greater conceptual clarity to the literature, we believe that this paper provides a foundation for future research incorporating multidimensional constructs in empirical analysis.

[1]  Herman Wold,et al.  Soft modelling: The Basic Design and Some Extensions , 1982 .

[2]  R. Bagozzi,et al.  A General Approach for Representing Constructs in Organizational Research , 1998 .

[3]  Viswanath Venkatesh,et al.  Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability , 2002, Inf. Syst. Res..

[4]  Omar El Sawy,et al.  The Four Tigers of Global E-Business Infrastructure: Strategies and Implications for Emerging Economies , 2003, Commun. Assoc. Inf. Syst..

[5]  S. Ashford,et al.  Content, Cause, and Consequences of Job Insecurity: A Theory-Based Measure and Substantive Test , 1989 .

[6]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[7]  Corey M. Angst,et al.  Reconceptualizing Compatibility Beliefs in Technology Acceptance , 2006 .

[8]  Albert H. Segars,et al.  Strategic Information Systems Planning Success: An Investigation of the Construct and Its Measurement , 1998, MIS Q..

[9]  Detmar W. Straub,et al.  Reconceptualizing System Usage: An Approach and Empirical Test , 2006, Inf. Syst. Res..

[10]  Charles J. Kacmar,et al.  Developing and Validating Trust Measures for e-Commerce: An Integrative Typology , 2002, Inf. Syst. Res..

[11]  R. R. Abidin Psychological Assessment Resources , 1995 .

[12]  Gayle J. Yaverbaum,et al.  Critical Factors in the User Environment: An Experimental Study of Users, Organizations and Tasks , 1988, MIS Q..

[13]  Jeffrey R. Edwards,et al.  An Examination Of Competing Versions Of The Person-Environment Fit Approach To Stress , 1996 .

[14]  Alan R. Dennis,et al.  Social Capital and Knowledge Integration in Digitally Enabled Teams , 2008, Inf. Syst. Res..

[15]  J. L. Holland,et al.  Making vocational choices : a theory of vocational personalities and work environments , 1984 .

[16]  Izak Benbasat,et al.  Business Competence of Information Technology Professionals: Conceptual Development and Influence on IT-Business Partnerships , 2004, MIS Q..

[17]  Wonseok Oh,et al.  On the Assessment of the Strategic Value of Information Technologies: Conceptual and Analytical Approaches , 2007, MIS Q..

[18]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[19]  Yolande E. Chan,et al.  Business Strategic Orientation, Information Systems Strategic Orientation, and Strategic Alignment , 1997, Inf. Syst. Res..

[20]  D. Jackson,et al.  Narrow reasoning about the use of broad personality measures for personnel selection , 1999 .

[21]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[22]  Samer Faraj,et al.  Why Should I Share? Examining Social Capital and Knowledge Contribution in Electronic Networks of Practice , 2005, MIS Q..

[23]  Ritu Agarwal,et al.  A field study of the adoption of software process innovations by information systems professionals , 2000, IEEE Trans. Engineering Management.

[24]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..

[25]  Shirley Gregor,et al.  Rethinking organisational size in IS research: meaning, measurement and redevelopment , 2009, Eur. J. Inf. Syst..

[26]  Ravinder Nath,et al.  An empirical examination of the impact of computer information systems on users , 1995, Inf. Manag..

[27]  Paul A. Pavlou,et al.  From IT Leveraging Competence to Competitive Advantage in Turbulent Environments: The Case of New Product Development , 2006, Inf. Syst. Res..

[28]  J. Edwards Multidimensional Constructs in Organizational Behavior Research: An Integrative Analytical Framework , 2001 .

[29]  Bernice L. Neugarten,et al.  Social Status in the City , 2011 .

[30]  Carol V. Brown,et al.  IT Human Resource Management Configurations and IT Turnover: Theoretical Synthesis and Empirical Analysis , 2005, Inf. Syst. Res..

[31]  Robert P. Bostrom,et al.  A psychometric study of the job characteristics scale of the job diagnostic survey in an MIS setting , 1991, SIGCPR '91.

[32]  Izak Benbasat,et al.  Research Report: Empirical Test of an EDI Adoption Model , 2001, Inf. Syst. Res..

[33]  Katherine J. Stewart,et al.  The Impact of Ideology on Effectiveness in Open Source Software Development Teams , 2006, MIS Q..

[34]  Kenneth L. Kraemer,et al.  Information Technology Payoff in E-Business Environments: An International Perspective on Value Creation of E-Business in the Financial Services Industry , 2004, J. Manag. Inf. Syst..

[35]  Philip Bobko,et al.  Content , Causes , and Consequences of Job Insecurity : A Theory-Based Measure and Substantive Test , 2007 .

[36]  Gurpreet Dhillon,et al.  TORKZADEH AND DHILLON Measuring Factors that Influence the Success of Internet , 2015 .

[37]  D. Rindskopf,et al.  Some Theory and Applications of Confirmatory Second-Order Factor Analysis. , 1988, Multivariate behavioral research.

[38]  M. D. Dunnette,et al.  Broadsided by broad traits: How to sink science in five dimensions or less , 1996 .

[39]  Izak Benbasat,et al.  Predicting Intention to Adopt Interorganizational Linkages: An Institutional Perspective , 2003, MIS Q..

[40]  H. Tompkins,et al.  Motivating IT professionals-the Hong Kong challenge , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[41]  Chockalingam Viswesvaran,et al.  Bandwidth-fidelity dilemma in personality measurement for personnel selection , 1996 .

[42]  Jason Bennett Thatcher,et al.  Conceptualizing and testing formative constructs: tutorial and annotated example , 2009, DATB.

[43]  Hüseyin Tanriverdi,et al.  Performance Effects of Information Technology Synergies in Multibusiness Firms , 2006, MIS Q..

[44]  Detmar W. Straub,et al.  Specifying Formative Constructs in Information Systems Research , 2007, MIS Q..

[45]  J. Edwards The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[46]  Rosann Webb Collins,et al.  Technology Requirements and Work Group Communication for Telecommuters , 2001, Inf. Syst. Res..

[47]  Hee-Dong Yang,et al.  An exploratory study on meta skills in software development teams: antecedent cooperation skills and personality for shared mental models , 2008, Eur. J. Inf. Syst..

[48]  T. C. Edwin Cheng,et al.  Extending the Understanding of End User Information Systems Satisfaction Formation: An Equitable Needs Fulfillment Model Approach , 2008, MIS Q..

[49]  Andrew B. Whinston,et al.  An Empirical Investigation of Net-Enabled Business Value , 2004, MIS Q..

[50]  Fatemeh Zahedi,et al.  The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach , 2002, Inf. Syst. Res..

[51]  R. Harvey,et al.  Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. , 1985 .

[52]  Adamantios Diamantopoulos,et al.  Advancing formative measurement models , 2008 .

[53]  Danny Miller,et al.  STRATEGY‐MAKING IN CONTEXT: TEN EMPIRICAL ARCHETYPES , 2007 .

[54]  Omar El Sawy,et al.  Absorptive Capacity Configurations in Supply Chains: Gearing for Partner-Enabled Market Knowledge Creation , 2005, MIS Q..

[55]  William J. Doll,et al.  The Meaning and Measurement of User Satisfaction: A Multigroup Invariance Analysis of the End-User Computing Satisfaction Instrument , 2004, J. Manag. Inf. Syst..

[56]  Claudia van Oppen,et al.  USING PLS PATH MODELING FOR ASSESSING HIERARCHICAL CONSTRUCT MODELS : GUIDELINES AND EMPIRICAL , 2022 .

[57]  Naresh K. Malhotra,et al.  Internet Users' Information Privacy Concerns (IUIPC): The Construct, the Scale, and a Causal Model , 2004, Inf. Syst. Res..

[58]  Michael D. Reilly Working Wives and Convenience Consumption , 1982 .

[59]  Eric Overby,et al.  Enterprise agility and the enabling role of information technology , 2006, Eur. J. Inf. Syst..

[60]  Nikunj P. Dalal,et al.  Understanding Web home page perception , 2005, Eur. J. Inf. Syst..

[61]  Jonathon N. Cummings,et al.  The Spatial, Temporal, and Configurational Characteristics of Geographic Dispersion in Teams , 2007, MIS Q..

[62]  Gary Johns,et al.  Aggregation or aggravation? The relative merits of a broad withdrawal construct , 1998 .

[63]  Paul A. Pavlou,et al.  Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior , 2006, MIS Q..

[64]  Vallabh Sambamurthy,et al.  Shaping UP for E-Commerce: Institutional Enablers of the Organizational Assimliation of Web Technologies , 2002, MIS Q..

[65]  Rajiv Kishore,et al.  The Role of Service Level Agreements in Relational Management of Information Technology Outsourcing: An Empirical Study , 2009, MIS Q..

[66]  Dewi Rooslani Tojib,et al.  User satisfaction with business-to-employee portals: conceptualization and scale development , 2008, Eur. J. Inf. Syst..

[67]  H. Marsh,et al.  Application of confirmatory factor analysis to the study of self-concept: First- and higher order factor models and their invariance across groups. , 1985 .

[68]  Edwin A. Locke,et al.  Job satisfaction. , 1969, Hospital administration currents.

[69]  Elena Karahanna,et al.  The Relative Advantage of Electronic Channels: A Multidimensional View , 2008, MIS Q..

[70]  Jeffrey R. Edwards,et al.  On the Use of Polynomial Regression Equations As An Alternative to Difference Scores in Organizational Research , 1993 .

[71]  Ritu Agarwal,et al.  Adoption of Electronic Health Records in the Presence of Privacy Concerns: The Elaboration Likelihood Model and Individual Persuasion , 2009, MIS Q..

[72]  Jason Bennett Thatcher,et al.  An Empirical Examination of Individual Traits as Antecedents to Computer Anxiety and Computer Self-Efficacy , 2002, MIS Q..

[73]  Weidong Xia,et al.  The ability of information systems development project teams to respond to business and technology changes: a study of flexibility measures , 2005, Eur. J. Inf. Syst..

[74]  T. Grandon Gill,et al.  Expert Systems Usage: Task Change and Intrinsic Motivation , 1996, MIS Q..

[75]  David A. Nadler,et al.  A Diagnostic Model for Organizational Behavior , 1977 .

[76]  Peter Chapman,et al.  Engagement in multimedia training systems , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[77]  William J. Kettinger,et al.  Perceived Service Quality and User Satisfaction with the Information Services Function , 1994 .

[78]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[79]  Detmar W. Straub,et al.  Examining Trust in Information Technology Artifacts: The Effects of System Quality and Culture , 2008, J. Manag. Inf. Syst..

[80]  Kevin Crowston,et al.  Defining Open Source Software Project Success , 2003, ICIS.

[81]  Sucheta Nadkarni,et al.  A Task-Based Model of Perceived Website Complexity , 2007, MIS Q..

[82]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[83]  Rajiv Sabherwal,et al.  Alignment Between Business and IS Strategies: A Study of Prospectors, Analyzers, and Defenders , 2001, Inf. Syst. Res..

[84]  Gary Klein,et al.  Measuring Information System Service Quality: SERVQUAL from the Other Side , 2002, MIS Q..

[85]  Cheryl Burke Jarvis,et al.  The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. , 2005, The Journal of applied psychology.

[86]  Weidong Xia,et al.  Complexity of Information Systems Development Projects: Conceptualization and Measurement Development , 2005, J. Manag. Inf. Syst..

[87]  A. V. D. Ven,et al.  The Concept of Fit in Contingency Theory. , 1984 .

[88]  Albert H. Segars,et al.  An Empirical Examination of the Concern for Information Privacy Instrument , 2002, Inf. Syst. Res..

[89]  Bill C. Hardgrave,et al.  Emotional Dissonance and the Information Technology Professional , 2008, MIS Q..

[90]  Izak Benbasat,et al.  Addressing the What and How of Online Services: Positioning Supporting-Services Functionality and Service Quality for Business-to-Consumer Success , 2008, Inf. Syst. Res..

[91]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[92]  Todd Dane Bozeman Job satisfaction. , 2007, Nursing management.

[93]  Thiagarajan Ravichandran,et al.  Quality Management in Systems Development: An Organizational System Perspective , 2000, MIS Q..

[94]  Christina Soh,et al.  Electronic Marketplaces and Price Transparency: Strategy, Information Technology, and Success , 2006, MIS Q..

[95]  Ryad Titah,et al.  Information System Use - Related Activity: An Expanded Behavioral Conceptualization of Individual-Level Information System Use , 2007, Inf. Syst. Res..

[96]  N. Venkatraman Performance Implications Of Strategic Coalignment: A Methodological Perspective , 1990 .

[97]  Dennis L. Hoffman,et al.  Marketing in Hypermedia Computer-Mediated Environments : Conceptual Foundations 1 ) , 1998 .

[98]  J. Webster,et al.  The Dimensionality and Correlates of Flow in Human-Computer Interactions. , 1993 .

[99]  Jan Pries-Heje,et al.  Aligning Software Processes with Strategy , 2006, MIS Q..

[100]  Jaeki Song,et al.  Dynamics of Trust Revision: Using Health Infomediaries , 2008, J. Manag. Inf. Syst..

[101]  Shu Lin,et al.  Plant Information Systems, Manufacturing Capabilities, and Plant Performance , 2006, MIS Q..

[102]  Otis Dudley Duncan,et al.  A socioeconomic index for all occupations. , 1996 .

[103]  Hüseyin Tanriverdi,et al.  Information Technology Relatedness, Knowledge Management Capability, and Performance of Multibusiness Firms , 2005, MIS Q..

[104]  I. B. Myers Manual: A Guide to the Development and Use of the Myers-Briggs Type Indicator , 1985 .

[105]  Blake Ives,et al.  Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effectiveness in Basic It Skills Training Author(s): Piccoli Et Al./web-based Virtual Learning Environments Web-based Virtual Learning Environments: a Research Framework and a Preliminary Assessment of Effe , 2022 .

[106]  Albert H. Segars,et al.  Knowledge Management: An Organizational Capabilities Perspective , 2001, J. Manag. Inf. Syst..

[107]  Kevin Zhu,et al.  The Complementarity of Information Technology Infrastructure and E-Commerce Capability: A Resource-Based Assessment of Their Business Value , 2004, J. Manag. Inf. Syst..

[108]  Izak Benbasat,et al.  The Influence of Business Managers' IT Competence on Championing IT , 2003, Inf. Syst. Res..

[109]  Robert G. Fichman,et al.  The Role of Aggregation in the Measurement of IT-Related Organizational Innovation , 2001, MIS Q..

[110]  H. Winklhofer,et al.  Index Construction with Formative Indicators: An Alternative to Scale Development , 2001 .

[111]  William J. Kettinger,et al.  Zones of Tolerance: Alternative Scales for Measuring Information Systems Service Quality , 2005, MIS Q..

[112]  David Gefen,et al.  Assessing Unidimensionality Through LISREL: An Explanation and an Example , 2003, Commun. Assoc. Inf. Syst..

[113]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[114]  Robert W. Zmud,et al.  Behavioral Intention Formation in Knowledge Sharing: Examining the Roles of Extrinsic Motivators, Social-Psychological Factors, and Organizational Climate , 2005, MIS Q..

[115]  R. Bagozzi,et al.  On the nature and direction of relationships between constructs and measures. , 2000, Psychological methods.

[116]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[117]  Mark Srite,et al.  The Role of Espoused National Cultural Values in Technology Acceptance , 2006, MIS Q..

[118]  W. Lloyd Warner,et al.  Social Class in America: A Manual of Procedure for the Measurement of Social Status , 1960 .

[119]  Rajiv Kohli,et al.  Antecedents of B2C Channel Satisfaction and Preference: Validating e-Commerce Metrics , 2002, Inf. Syst. Res..

[120]  Jeffrey R. Edwards,et al.  Latent Variable Modeling in Congruence Research , 2009 .

[121]  Kenneth S. Law,et al.  Toward A Taxonomy of Multidimensional Constructs , 1998 .

[122]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[123]  Jae-Nam Lee,et al.  IT Outsourcing Strategies: Universalistic, Contingency, and Configurational Explanations of Success , 2004, Inf. Syst. Res..

[124]  J. Hackman,et al.  Development of the Job Diagnostic Survey , 1975 .

[125]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[126]  Jane Webster,et al.  Enhancing the Design of Web Navigation Systems: The Influence of User Disorientation on Engagement and Performance , 2006, MIS Q..

[127]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[128]  Randy V. Bradley,et al.  Information Systems Success in the Context of Different Corporate Cultural Types: An Empirical Investigation , 2006, J. Manag. Inf. Syst..

[129]  Viswanath Venkatesh,et al.  E XPECTATION D ISCONFIRMATION AND T ECHNOLOGY A DOPTION : P OLYNOMIAL M ODELING AND R ESPONSE S URFACE A NALYSIS 1 , 2010 .

[130]  Monideepa Tarafdar,et al.  The Consequences of Technostress for End Users in Organizations: Conceptual Development and Empirical Validation , 2008, Inf. Syst. Res..

[131]  Pervaiz K. Ahmed,et al.  Knowledge management orientation: construct development and empirical validation , 2008, Eur. J. Inf. Syst..

[132]  Arun Rai,et al.  Firm performance impacts of digitally enabled supply chain integration capabilities , 2006 .

[133]  R. Bagozzi,et al.  A general approach to representing multifaceted personality constructs: Application to state self‐esteem , 1994 .

[134]  Barbara Wixom,et al.  An Empirical Investigation of the Factors Affecting Data Warehousing Success , 2001, MIS Q..

[135]  J. Edwards Ten Difference Score Myths , 2001 .

[136]  Terry Anthony Byrd,et al.  Measuring the Flexibility of Information Technology Infrastructure: Exploratory Analysis of a Construct , 2000, J. Manag. Inf. Syst..

[137]  R E Miles,et al.  Organizational strategy, structure, and process. , 1978, Academy of management review. Academy of Management.

[138]  Wynne W. Chin Issues and Opinion on Structural Equation Modeling by , 2009 .

[139]  Kevin R. Murphy,et al.  Implications of the multidimensional nature of job performance for the validity of selection tests , 1997 .

[140]  K. Law,et al.  Multidimensional constructs in structural equation analysis: An illustration using the job perception and job satisfaction constructs , 1999 .

[141]  Gary Klein,et al.  Resolving Difference Score Issues in Information Systems Research , 2009, MIS Q..

[142]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[143]  Wynne W. Chin,et al.  Adoption intention in GSS: relative importance of beliefs , 1995, DATB.

[144]  Henry C. Lucas,et al.  Disruptive technology: How Kodak missed the digital photography revolution , 2009, J. Strateg. Inf. Syst..

[145]  Sung S. Kim,et al.  Internet Users' Information Privacy-Protective Responses: A Taxonomy and a Nomological Model , 2008, MIS Q..

[146]  Paul A. Pavlou,et al.  Psychological Contract Violation in Online Marketplaces: Antecedents, Consequences, and Moderating Role , 2005, Inf. Syst. Res..

[147]  Danny Miller,et al.  Environmental Fit Versus Internal Fit , 1992 .

[148]  Henri Barki,et al.  Interpersonal Conflict and Its Management in Information System Development , 2001, MIS Q..

[149]  Norman A. Johnson,et al.  Personality traits and concern for privacy: an empirical study in the context of location-based services , 2008, Eur. J. Inf. Syst..

[150]  James C. McElroy,et al.  Dispositional Factors in Internet Use: Personality Versus Cognitive Style , 2007, MIS Q..

[151]  Aristeidis Theotokis,et al.  Formative Versus Reflective Measurement for Multidimensional Constructs , 2009 .

[152]  Amy L. Kristof PERSON-ORGANIZATION FIT: AN INTEGRATIVE REVIEW OF ITS CONCEPTUALIZATIONS, MEASUREMENT, AND IMPLICATIONS , 1996 .

[153]  Catherine E. Connelly,et al.  In Justice We Trust: Predicting User Acceptance of E-Customer Services , 2008, J. Manag. Inf. Syst..

[154]  Barbara Wixom,et al.  Antecedents of Information and System Quality: An Empirical Examination Within the Context of Data Warehousing , 2005, J. Manag. Inf. Syst..

[155]  Kenneth S. Law,et al.  On the Importance of Conducting Construct-Level Analysis for Multidimensional Constructs in Theory Development and Testing , 2008 .

[156]  Tabbye M. Chavous,et al.  Multidimensional Inventory of Black Identity: A Preliminary Investigation of Reliability and Construct Validity , 1997 .

[157]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..