An empirical investigation of employee portal success

Employee portals are utilized by many companies to improve companies' information exchange, communication, and employee collaboration, as well as to better support their business processes. Owing to limited IT budgets and the need to justify investments in employee portals, assessing the benefits of these is an important field in research and practice. Thus, the purpose of this study is to gain a better understanding of employee portal success. We introduce a theoretical model for this that is based on the DeLone and McLean IS Success Model. Furthermore, we develop hypotheses regarding the associations between different models' success dimensions and test them using more than 10,000 employees' responses collected in a survey of 22 companies. Our results indicate that besides the factors contributing to IS success in general, other success dimensions - like the quality of the collaboration and process support - have to be considered when aiming for a successful employee portal. The study's findings make it possible for practitioners to understand the levers with which to improve their employee portals. By empirically validating a comprehensive success model for employee portals, the study's results advance theoretical development in the area of collaboration-centered systems and present a basis for further research in this field.

[1]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .

[2]  Manfred Bruhn,et al.  Customer equity management as formative second-order construct , 2008 .

[3]  Seymour Geisser,et al.  The Predictive Sample Reuse Method with Applications , 1975 .

[4]  F. Bookstein,et al.  Two Structural Equation Models: LISREL and PLS Applied to Consumer Exit-Voice Theory , 1982 .

[5]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[6]  Dewi Rooslani Tojib,et al.  User satisfaction with business-to-employee portals: conceptualization and scale development , 2008, Eur. J. Inf. Syst..

[7]  Raffaella Bianchi,et al.  Intranet: different configurations and their effects on the performance of corporate value chain's activities , 2000, Proceedings of the 2000 IEEE Engineering Management Society. EMS - 2000 (Cat. No.00CH37139).

[8]  Helail Almutairi,et al.  An Empirical Application of the Delone and Mclean Model in the Kuwaiti Private Sector , 2005, J. Comput. Inf. Syst..

[9]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[10]  Rajeev Sharma,et al.  The Contingent Effects of Management Support and Task Interdependence on Successful Information Systems Implementation , 2003, MIS Q..

[11]  Michel Tenenhaus,et al.  PLS path modeling , 2005, Comput. Stat. Data Anal..

[12]  R. Hoyle.  Statistical Strategies for Small Sample Research , 1999 .

[13]  Ulrich Remus,et al.  Critical Success Factors of Implementing Enterprise Portals , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[14]  V. Grover,et al.  An assessment of survey research in POM: from constructs to theory , 1998 .

[15]  Luiz Antonio Joia,et al.  Analysis of the Effects of Technological and Organizational Features on Intranet and Portal Usage , 2008, AMCIS.

[16]  S. Rogelberg,et al.  Introduction Understanding and Dealing With Organizational Survey Nonresponse , 2007 .

[17]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[18]  Detmar W. Straub,et al.  Validation Guidelines for IS Positivist Research , 2004, Commun. Assoc. Inf. Syst..

[19]  Atreyi Kankanhalli,et al.  Contributing Knowledge to Electronic Knowledge Repositories: An Empirical Investigation , 2005, MIS Q..

[20]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[21]  Cutson Liu,et al.  Corporate portals as extranet support for the construction industry in Hong Kong and nearby regions of China , 2007, J. Inf. Technol. Constr..

[22]  Cláudia Dias,et al.  Corporate portals: a literature review of a new concept in Information Management , 2001, Int. J. Inf. Manag..

[23]  David Gefen,et al.  Assessing Unidimensionality Through LISREL: An Explanation and an Example , 2003, Commun. Assoc. Inf. Syst..

[24]  David W. Gerbing,et al.  An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment , 1988 .

[25]  Steven L. Alter.  18 Reasons Why IT-Reliant Work Systems Should Replace "The IT Artifact" as the Core Subject Matter of the IS Field , 2003, Commun. Assoc. Inf. Syst..

[26]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[27]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[28]  Cheryl Burke Jarvis,et al.  A Critical Review of Construct Indicators and Measurement Model Misspecification in Marketing and Consumer Research , 2003 .

[29]  Rajiv Sabherwal,et al.  The Relationship Between Information System Planning Sophistication and Information System Success: An Empirical Assessment* , 1999 .

[30]  Barbara Wixom,et al.  Antecedents of Information and System Quality: An Empirical Examination Within the Context of Data Warehousing , 2005, J. Manag. Inf. Syst..

[31]  Albert L. Lederer,et al.  A Meta-Analysis of the Role of Environment-Based Voluntariness in Information Technology Acceptance , 2009, MIS Q..

[32]  Detmar W. Straub,et al.  Structural Equation Modeling and Regression: Guidelines for Research Practice , 2000, Commun. Assoc. Inf. Syst..

[33]  William R. King,et al.  Measuring the Performance of Information Systems: A Functional Scorecard , 2005, J. Manag. Inf. Syst..

[34]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[35]  George A. Marcoulides,et al.  Modern methods for business research , 1998 .

[36]  S. Rogelberg,et al.  Understanding and Dealing With Organizational Survey Nonresponse , 2010 .

[37]  Abhijit Chaudhury,et al.  An empirical investigation of decision-making satisfaction in web-based decision support systems , 2004, Decis. Support Syst..

[38]  Darshana Sedera,et al.  Enterprise Systems Success: A Measurement Model , 2003, ICIS.

[39]  Ulrich Remus,et al.  Critical success factors for implementing enterprise portals: A comparison with ERP implementations , 2007, Bus. Process. Manag. J..

[40]  R. Bagozzi.  Advanced Methods of Marketing Research , 1994 .

[41]  Fatemeh Zahedi,et al.  The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach , 2002, Inf. Syst. Res..

[42]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[43]  William R. King,et al.  External Validity in IS Survey Research , 2005, Commun. Assoc. Inf. Syst..

[44]  Phil Johnson,et al.  Understanding Management Research: An Introduction to Epistemology , 2000 .

[45]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[46]  Ann Majchrzak,et al.  Perceived Individual Collaboration Know-How Development Through Information Technology-Enabled Contextualization: Evidence from Distributed Teams , 2005, Inf. Syst. Res..

[47]  Richard T. Watson,et al.  Service Quality: A Measure of Information System Effectiveness , 1995, MIS Q..

[48]  Albert H. Segars,et al.  Assessing the unidimensionality of measurement : a paradigm and illustration within the context of information systems research , 1997 .

[49]  Daniel Beimborn,et al.  The impact of process standardization on business process outsourcing success , 2008, Inf. Syst. Frontiers.

[50]  Dewi Rooslani Tojib,et al.  MODELLING USER SATISFACTION WITH AN EMPLOYEE PORTAL , 2006 .

[51]  Mohamad Noorman Masrek,et al.  Investigating corporate intranet effectiveness: a conceptual framework , 2007, Inf. Manag. Comput. Secur..

[52]  Terry Anthony Byrd,et al.  A methodology for construct development in MIS research , 2005, Eur. J. Inf. Syst..

[53]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[54]  M. Ronald Buckley,et al.  Measurement Errors in the Behavioral Sciences: The Case of Personality/Attitude Research , 1990 .

[55]  Martin J. Eppler,et al.  Improving knowledge intensive processes through an enterprise knowledge medium , 1999, SIGCPR '99.

[56]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[57]  Arun Rai,et al.  Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis , 2002, Inf. Syst. Res..

[58]  Uday R. Kulkarni,et al.  A Knowledge Management Success Model: Theoretical Development and Empirical Validation , 2006, J. Manag. Inf. Syst..

[59]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[60]  Lutz Kolbe,et al.  Continuum of Context Explication: Knowledge Discovery Through Process-Oriented Portals , 2005, Int. J. Knowl. Manag..

[61]  Nassim Belbaly,et al.  Corporate Portal: A Tool for Knowledge Management Synchronization , 2004, Int. J. Inf. Manag..

[62]  Michael Rosemann,et al.  Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks , 2008, MIS Q..

[63]  En Mao,et al.  A Theoretical and Empirical Validation of IS Success Models in a Temporal and Quasi Volitional Technology Usage Context , 2004, AMCIS.

[64]  Wei Wang,et al.  ScholarWorks @ Georgia State University , 2022 .

[65]  Frank Huber,et al.  Kausalmodellierung mit partial least squares : eine anwendungsorientierte Einführung , 2007 .

[66]  Rens Scheepers,et al.  A Stage Model of Intranet Technology. Implementation and Management , 1999, ECIS.

[67]  Hsiu-Fen Lin,et al.  Determinants of success for online communities: an empirical study , 2006, Behav. Inf. Technol..

[68]  Cheryl Burke Jarvis,et al.  The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. , 2005, The Journal of applied psychology.

[69]  Bih-Huang Jin,et al.  Measuring satisfaction with business-to-employee systems , 2004, Comput. Hum. Behav..

[70]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[71]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[72]  Ephraim R. McLean,et al.  Measuring information systems success: models, dimensions, measures, and interrelationships , 2008, Eur. J. Inf. Syst..

[73]  Weiguo Fan,et al.  Determining Success for Different Website Goals , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[74]  Rudolf R. Sinkovics,et al.  The Use of Partial Least Squares Path Modeling in International Marketing , 2009 .

[75]  Wynne W. Chin,et al.  Structural equation modeling analysis with small samples using partial least squares , 1999 .

[76]  Maarten Gelderman,et al.  The relation between user satisfaction, usage of information systems and performance , 1998, Inf. Manag..

[77]  Jen-Her Wu,et al.  An organizational memory information systems success model: an extension of DeLone and McLean's I/S success model , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[78]  P. Hackl,et al.  On measurement of intangible assets: A study of robustness of partial least squares , 2000 .

[79]  John M. Ward,et al.  Enterprise Portals: Addressing the Organisational and Individual Perspectives of Information Systems , 2005, ECIS.

[80]  K. Jöreskog,et al.  Intraclass Reliability Estimates: Testing Structural Assumptions , 1974 .

[81]  Alemayehu Molla,et al.  E-Commerce Systems Success: An Attempt to Extend and Respecify the Delone and MaClean Model of IS Success , 2001, J. Electron. Commer. Res..

[82]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[83]  Rainer Alt,et al.  Developing an integration architecture for process portals , 2005, Eur. J. Inf. Syst..

[84]  Juhani Iivari,et al.  An empirical test of the DeLone-McLean model of information system success , 2005, DATB.

[85]  Peter B. Seddon,et al.  A Partial Test and Development of the DeLone and McLean Model of IS Success , 1994, ICIS.

[86]  Frada Burstein,et al.  A Practical Measure of Employee Satisfaction with B2E Portals , 2007, ICIS.

[87]  Brian Detlor,et al.  The corporate portal as information infrastructure: towards a framework for portal design , 2000, Int. J. Inf. Manag..

[88]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[89]  Alan R. Dennis,et al.  Factors Affecting the Loyal Use of Knowledge Management Systems , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[90]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[91]  Matthew K. O. Lee,et al.  The Asymmetric Effect of Website Attribute Performance on Satisfaction: An Empirical Study , 2004, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[92]  Mohamad Noorman Masrek,et al.  Measuring campus portal effectiveness and the contributing factors , 2007 .

[93]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[94]  Chao-Min Chiu,et al.  Examining the integrated influence of fairness and quality on learners’ satisfaction and Web‐based learning continuance intention , 2007, Inf. Syst. J..

[95]  Dewi Rooslani Tojib,et al.  A conceptual model for B2E portal user satisfaction , 2006 .

[96]  Zheng Zhou,et al.  Development and validation of an instrument to measure user perceived service quality of information presenting Web portals , 2005, Inf. Manag..

[97]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[98]  S. Mark Young,et al.  Assessing the quality of evidence in empirical management accounting research: The case of survey studies , 2005 .

[99]  Jan-Bernd Lohmöller,et al.  Latent Variable Path Modeling with Partial Least Squares , 1989 .

[100]  Paul Jen-Hwa Hu,et al.  Evaluating telemedicine systems success: a revised model , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[101]  Wynne W. Chin.  The partial least squares approach for structural equation modeling. , 1998 .

[102]  Mariano Corso,et al.  An empirical roadmap for intranet evolution , 2009, Int. J. Inf. Manag..

[103]  Walter W.C. Chung,et al.  A framework to develop an enterprise information portal for contract manufacturing , 2002 .

[104]  Jane E. Klobas,et al.  User Developed Applications and Information Systems Success: A Test of DeLone and McLean's Model , 2003, Inf. Resour. Manag. J..

[105]  Edward J. Garrity,et al.  An experimental investigation of web-based information systems success in the context of electronic commerce , 2005, Decis. Support Syst..

[106]  Jong-min Choe,et al.  The Relationships among Performance of Accounting Information Systems, Influence Factors, and Evolution Level of Information Systems , 1996, J. Manag. Inf. Syst..

[107]  Prabhakar Raghavan,et al.  Social Networks: From the Web to the Enterprise , 2002, IEEE Internet Comput..

[108]  Gerold Riempp,et al.  The State of Research on Information Systems Success , 2009, Bus. Inf. Syst. Eng..

[109]  Mohamad Noorman Masrek,et al.  The utilization and effectiveness of intranet: A case study at selected Malaysian organizations , 2008 .

[110]  Lorne Olfman,et al.  A Knowledge Management Success Model: An Extension of DeLone and McLean's IS Success Model , 2003, AMCIS.

[111]  B. Galliers,et al.  The Journal of Strategic Information Systems , 1996 .

[112]  Ingoo Han,et al.  The impact of the online and offline features on the user acceptance of Internet shopping malls , 2004, Electron. Commer. Res. Appl..