Does big data enhance firm innovation competency? The mediating role of data-driven insights

Abstract Grounded in gestalt insight learning theory and organizational learning theory, we collected data from 280 middle and top-level managers to investigate the impact of each big data characteristic (i.e., data volume, data velocity, data variety, and data veracity) on firm innovation competency (i.e., exploitation competency and exploration competency), mediated through data-driven insight generation (i.e., descriptive insight, predictive insight, and prescriptive insight). Findings show that while data velocity, variety, and veracity enhance data-driven insight generation, data volume does not impact it. Additionally, results of the post hoc analysis indicate that while descriptive and predictive insights improve innovation competency, prescriptive insight does not affect it. These results provide interesting and unique theoretical and practical insights.

[1]  Ying Xie,et al.  Massive Data Analysis: Tasks, Tools, Applications, and Challenges , 2016 .

[2]  Sunil Erevelles,et al.  Big Data consumer analytics and the transformation of marketing , 2016 .

[3]  N. Anderson,et al.  Innovation and Creativity in Organizations , 2014 .

[4]  Gary L. Frankwick,et al.  Effects of big data analytics and traditional marketing analytics on new product success: A knowledge fusion perspective , 2016 .

[5]  M. Sobrero,et al.  Structuring Inter-firm Relationships: A Metaanalytic Approach , 1998 .

[6]  Ofir Turel,et al.  Increasing firm agility through the use of data analytics: The role of fit , 2017, Decis. Support Syst..

[7]  Hannes Zacher,et al.  Individual ambidexterity: the duality of exploration and exploitation and its relationship with innovative performance , 2017 .

[8]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[9]  M. Tushman,et al.  Ambidextrous Organizations: Managing Evolutionary and Revolutionary Change , 1996 .

[10]  Shahriar Akter,et al.  Big data analytics in E-commerce: a systematic review and agenda for future research , 2016, Electronic Markets.

[11]  Shahriar Akter,et al.  How ‘Big Data’ Can Make Big Impact: Findings from a Systematic Review and a Longitudinal Case Study , 2015 .

[12]  Rick Kazman,et al.  How Lufthansa Capitalized on Big Data for Business Model Renovation , 2017, MIS Q. Executive.

[13]  Li Zhao,et al.  Information quality and community municipal portal use , 2013, Gov. Inf. Q..

[14]  Viju Raghupathi,et al.  Big data analytics in healthcare: promise and potential , 2014, Health Information Science and Systems.

[15]  Z. Irani,et al.  Critical analysis of Big Data challenges and analytical methods , 2017 .

[16]  Cees T. A. M. de Laat,et al.  Addressing big data issues in Scientific Data Infrastructure , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[17]  Ganesh Chandra Deka.  Big Data Predictive and Prescriptive Analytics , 2016 .

[18]  Zi-Lin He,et al.  Exploration vs. Exploitation: An Empirical Test of the Ambidexterity Hypothesis , 2004, Organ. Sci..

[19]  Kim Hua Tan,et al.  Harvesting big data to enhance supply chain innovation capabilities: An analytic infrastructure based on deduction graph , 2015 .

[20]  Yichuan Wang,et al.  Exploring the path to big data analytics success in healthcare , 2017 .

[21]  Thomas J. Steenburgh,et al.  Motivating Salespeople: What Really Works , 2012, Harvard business review.

[22]  Paul A. Pavlou,et al.  Understanding and Mitigating Uncertainty in Online Exchange Relationships: A Principal-Agent Perspective , 2007, MIS Q..

[23]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[24]  Sepideh Ebrahimi,et al.  Data analytics competency for improving firm decision making performance , 2018, J. Strateg. Inf. Syst..

[25]  Shahriar Akter,et al.  Big data analytics and firm performance: Effects of dynamic capabilities , 2017 .

[26]  Stephen Shaoyi Liao,et al.  Leveraging Financial Social Media Data for Corporate Fraud Detection , 2018, J. Manag. Inf. Syst..

[27]  Daniel A. Levinthal,et al.  The myopia of learning , 1993 .

[28]  Alok R. Saboo,et al.  Leveraging Frontline Employees’ Small Data and Firm-Level Big Data in Frontline Management , 2017 .

[29]  Yogesh Kumar Dwivedi,et al.  Industrial Management & Data Systems Development of a survey instrument to examine consumer adoption of broadband , 2016 .

[30]  W. Köhler.  Gestalt Psychology: An Introduction to New Concepts in Modern Psychology , 1970 .

[31]  Angelika Dimoka,et al.  On Product Uncertainty in Online Markets: Theory and Evidence , 2011, MIS Q..

[32]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[33]  Richard T. Herschel,et al.  Knowledge management and business intelligence: the importance of integration , 2005, J. Knowl. Manag..

[34]  Andy Neely,et al.  Capturing value from big data – a taxonomy of data-driven business models used by start-up firms , 2016 .

[35]  Izak Benbasat,et al.  The Nature and Consequences of Trade-Off Transparency in the Context of Recommendation Agents , 2014, MIS Q..

[36]  Heshan Sun,et al.  Understanding User Revisions When Using Information Systems Features: Adaptive System Use and Triggers , 2012, MIS Q..

[37]  Benjamin T. Hazen,et al.  Big data and predictive analytics for supply chain and organizational performance , 2017 .

[38]  Roger H. L. Chiang,et al.  Big Data Research in Information Systems: Toward an Inclusive Research Agenda , 2016, J. Assoc. Inf. Syst..

[39]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .

[40]  Miklos A. Vasarhelyi,et al.  Impact of business analytics and enterprise systems on managerial accounting , 2017, Int. J. Account. Inf. Syst..

[41]  George Strawn,et al.  Data Scientist , 2016, IT Professional.

[42]  Julian Birkinshaw,et al.  Organizational Ambidexterity: Balancing Exploitation and Exploration for Sustained Performance , 2009, Organ. Sci..

[43]  Maryam Ghasemaghaei,et al.  Are firms ready to use big data analytics to create value? The role of structural and psychological readiness , 2019, Enterp. Inf. Syst..

[44]  Maryam Ghasemaghaei,et al.  The role of positive and negative valence factors on the impact of bigness of data on big data analytics usage , 2020, Int. J. Inf. Manag..

[45]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[46]  Ken G. Smith,et al.  The interplay between exploration and exploitation. , 2006 .

[47]  MaryAnne M. Gobble,et al.  Big Data: The Next Big Thing in Innovation , 2013 .

[48]  Sue Newell,et al.  Strategic opportunities (and challenges) of algorithmic decision-making: A call for action on the long-term societal effects of 'datification' , 2015, J. Strateg. Inf. Syst..

[49]  Kazuhisa Niki,et al.  Function of hippocampus in “insight” of problem solving , 2003, Hippocampus.

[50]  Darshana Sedera,et al.  Knowledge Management Competence for Enterprise System Success , 2010, J. Strateg. Inf. Syst..

[51]  Ray Hackney,et al.  How information-sharing values influence the use of information systems: An investigation in the business intelligence systems context , 2014, J. Strateg. Inf. Syst..

[52]  Wynne W. Chin.  The partial least squares approach for structural equation modeling. , 1998 .

[53]  Varun Grover,et al.  Creating Strategic Business Value from Big Data Analytics: A Research Framework , 2018, J. Manag. Inf. Syst..

[54]  K. Atuahene–Gima,et al.  Resolving the Capability–Rigidity Paradox in New Product Innovation , 2005 .

[55]  G. Day.  Continuous Learning about Markets , 1994 .

[56]  Kuo-Chih Cheng,et al.  The impact of quality of IS information and budget slack on innovation performance , 2009 .

[57]  Shahriar Akter,et al.  How to improve firm performance using big data analytics capability and business strategy alignment , 2016 .

[58]  Scott B. Friend,et al.  Big Data Facilitation, Utilization, and Monetization: Exploring the 3Vs in a New Product Development Process , 2017 .

[59]  N. Kshetri.  Big data's impact on privacy, security and consumer welfare , 2014 .

[60]  Frank J. Ohlhorst.  Big Data Analytics: Turning Big Data into Big Money , 2012 .

[61]  Benjamin D. Jee,et al.  Investigating Insight as Sudden Learning , 2012, J. Probl. Solving.

[62]  Lorin M. Hitt,et al.  Strength in Numbers: How Does Data-Driven Decisionmaking Affect Firm Performance? , 2011, ICIS 2011.

[63]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[64]  Detmar W. Straub,et al.  A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example , 2005, Commun. Assoc. Inf. Syst..

[65]  R. Calantone,et al.  Learning orientation, firm innovation capability, and firm performance , 2002 .

[66]  Gloria E. Phillips-Wren,et al.  An analytical journey towards big data , 2015, J. Decis. Syst..

[67]  Gloria E. Phillips-Wren,et al.  Ai Tools in Decision Making Support Systems: a Review , 2012, Int. J. Artif. Intell. Tools.

[68]  David A. Griffith,et al.  An Examination of Exploration and Exploitation Capabilities: Implications for Product Innovation and Market Performance , 2007 .

[69]  Shanlin Yang,et al.  Big data driven smart energy management: From big data to big insights , 2016 .

[70]  Maryam Ghasemaghaei,et al.  Improving Organizational Performance Through the Use of Big Data , 2018, J. Comput. Inf. Syst..

[71]  J. March.  Exploration and exploitation in organizational learning , 1991, STUDI ORGANIZZATIVI.

[72]  Claudio Soriente,et al.  StreamCloud: An Elastic and Scalable Data Streaming System , 2012, IEEE Transactions on Parallel and Distributed Systems.

[73]  R. Chandy,et al.  Sources and Financial Consequences of Radical Innovation: Insights from Pharmaceuticals , 2003 .

[74]  G. Huber.  Organizational Learning: The Contributing Processes and the Literatures , 1991 .

[75]  J. Roldán,et al.  From Entrepreneurial Orientation and Learning Orientation to Business Performance: Analysing the Mediating Role of Organizational Learning and the Moderating Effects of Organizational Size , 2014 .

[76]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[77]  C. Chou.  Organizational Orientations, Industrial Category, and Responsible Innovation , 2018 .

[78]  Wynne W. Chin.  How to Write Up and Report PLS Analyses , 2010 .

[79]  M. Janssen,et al.  Factors influencing big data decision-making quality , 2017 .

[80]  M. Wertheimer,et al.  A source book of Gestalt psychology. , 1939 .

[81]  Maryam Ghasemaghaei,et al.  Can big data improve firm decision quality? The role of data quality and data diagnosticity , 2019, Decis. Support Syst..

[82]  Maryam Ghasemaghaei,et al.  Does data analytics use improve firm decision making quality? The role of knowledge sharing and data analytics competency , 2019, Decis. Support Syst..

[83]  W. Kamakura,et al.  Quantitative Trendspotting , 2012 .

[84]  P. Rajan Varadarajan,et al.  Standardization versus Adaptation of International Marketing Strategy: An Empirical Investigation , 1993 .

[85]  Izak Benbasat,et al.  Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation , 1991, Inf. Syst. Res..

[86]  Rolf Reber,et al.  Gaining Insight Into the “Aha” Experience , 2010 .

[87]  K. Atuahene–Gima,et al.  An Empirical Investigation of the Effect of Market Orientation and Entrepreneurship Orientation Alignment on Product Innovation , 2001 .

[88]  M. Pretorius,et al.  Investigating managerial practices for data and information overload in decision making , 2016 .

[89]  Antonio Davila,et al.  Performance Measurement and Control Systems for Implementing Strategy: Text and Cases , 1999 .

[90]  Sulin Ba,et al.  The Effectiveness of Online Shopping Characteristics and Well-Designed Websites on Satisfaction , 2012, MIS Q..

[91]  J. Barney,et al.  Resource-Based Theory: Creating and Sustaining Competitive Advantage , 2007 .

[92]  Morgan Swink,et al.  How the Use of Big Data Analytics Affects Value Creation in Supply Chain Management , 2015, J. Manag. Inf. Syst..

[93]  T. Oliveira,et al.  Assessing business value of Big Data Analytics in European firms , 2017 .

[94]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[95]  Arun Ross,et al.  Social Media Analytics for Smart Health , 2014, IEEE Intelligent Systems.

[96]  C. Fornell,et al.  Evaluating Structural Equation Models with Unobservable Variables and Measurement Error , 1981 .

[97]  Omar E. M. Khalil,et al.  Knowledge Management and organizational Performance in the Egyptian software Firms , 2007, Int. J. Knowl. Manag..

[98]  Sune Dueholm Müller,et al.  Managing Ambidexterity in Startups Pursuing Digital Innovation , 2019, Commun. Assoc. Inf. Syst..

[99]  Werner Severin,et al.  Another look at cue summation , 1967 .

[100]  Willow A. Sheremata.  Centrifugal and Centripetal Forces in Radical New Product Development Under Time Pressure , 2000 .

[101]  Kim B. Clark,et al.  Architectural Innovation: The Reconfiguration of Existing Product Technologies and the Failure of , 1990 .

[102]  Rajendra Akerkar,et al.  Analytics on Big Aviation Data: Turning Data into Insights , 2014, Int. J. Comput. Sci. Appl..

[103]  Gabriel Maciá-Fernández,et al.  Tackling the Big Data 4 vs for anomaly detection , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).