A big data framework for facilitating product innovation processes

Purpose The purpose of this paper is to suggest how firms could use big data to facilitate product innovation processes, by shortening the time to market, improving customers’ product adoption and reducing costs. Design/methodology/approach The research is based on a two-step approach. First, this research identifies four potential key success factors for organisations to integrate big data in accelerating their product innovation processes. The proposed factors are further examined and developed by conducting interviews with different organisation experts and academic researchers. Then a framework is developed based on the interview outputs. The framework sets out the key success factors involved in leveraging big data to reduce lead times and costs in product innovation processes. Findings The three determined key success factors are: accelerated innovation process; customer connection; and an ecosystem of innovation. The authors believe that the developed framework based on big data represents a paradigm shift. It can help firms to make new product development dramatically faster and less costly. Research limitations/implications The proposed accelerated innovation processes demand a shift in traditional organisational culture and practices. It is, though, meaningful only for products and services with short life cycles. Moreover, the framework has not yet been widely tested. Practical implications This paper points to the vital role of big data in helping firms to accelerate product innovation processes. First of all, it allows organisations to launch new products to market as quickly as possible. Second, it helps organisations to determine the weaknesses of the product earlier in the development cycle. Third, it allows functionalities to be added to a product that customers are willing to pay a premium for, while eliminating features they do not want. Last, but not least, it identifies and then prioritises customer needs for specific markets. Originality/value The research shows that firms could harvest external knowledge and import ideas across organisational boundaries. An accelerated innovation process based on big data is characterised by a multidimensional process involving intelligence efforts, relentless data collection and flexible working relationships with team members.

[1]  R. Cooper,et al.  Benchmarking the Firm's Critical Success Factors in New Product Development , 1995 .

[2]  Robert G. Cooper,et al.  What's Next?: After Stage-Gate , 2014 .

[3]  Ulrike de Brentani Success and Failure in New Industrial Services , 1989 .

[4]  Donald O. Neubaum,et al.  The Relationship between Team Autonomy and New Product Development Performance under Different Levels of Technological Turbulence , 2014 .

[5]  Kwaku Atuahene-Gima,et al.  An Exploratory Analysis of the Impact of Market Orientation on New Product Performance , 1995 .

[6]  M. Parry,et al.  A Cross-National Comparative Study of New Product Development Processes: Japan and the United States , 1997 .

[7]  L. Dwyer,et al.  Organizational Environment, New Product Process Activities, and Project Outcomes , 1991 .

[8]  Dursun Delen,et al.  Leveraging the capabilities of service-oriented decision support systems: Putting analytics and big data in cloud , 2013, Decis. Support Syst..

[9]  Umesh R. Hodeghatta,et al.  Business Analytics Process and Data Exploration , 2017 .

[10]  Kim Hua Tan,et al.  Harvesting big data to enhance supply chain innovation capabilities: An analytic infrastructure based on deduction graph , 2015 .

[11]  W. Souder,et al.  The R&D/marketing interface: Results from an empirical study of innovation projects , 1978, IEEE Transactions on Engineering Management.

[12]  Robert G. Cooper,et al.  New Products: The Key Factors in Success , 1990 .

[13]  Friedrich Grosse-Dunker,et al.  Sustainability Innovation Cube - A Framework to Evaluate Sustainability-Oriented Innovations , 2009 .

[14]  R. Calantone,et al.  New Product Activities and Performance: The Moderating Role of Environmental Hostility , 1997 .

[15]  Shahriar Akter,et al.  How ‘Big Data’ Can Make Big Impact: Findings from a Systematic Review and a Longitudinal Case Study , 2015 .

[16]  Kim Hua,et al.  Harvesting Big Data to Enhance Supply Chain Innovation Capabilities : An Analytic Infrastructure Based on Deduction Graph , 2016 .

[17]  Paul M. Horn The Changing Nature of Innovation , 2005 .

[18]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[19]  M. Nieto,et al.  The importance of diverse collaborative networks for the novelty of product innovation , 2007 .

[20]  Rado Gazo,et al.  Methodology for determining key internal business processes based on critical success factors: A case study in furniture industry , 2007, Bus. Process. Manag. J..

[21]  Ray Y. Zhong,et al.  Visualization of RFID-enabled shopfloor logistics Big Data in Cloud Manufacturing , 2015, The International Journal of Advanced Manufacturing Technology.

[22]  Hei-Kuang Lee,et al.  A proposed process for systematic innovation , 2011 .

[23]  L. Välikangas,et al.  The art of rapid, hands‐on execution innovation , 2011 .

[24]  Koen Verhoest,et al.  Innovation-Oriented Culture in the Public Sector: Do managerial autonomy and result control lead to innovation? , 2014 .

[25]  Stella Wooder,et al.  Extracting Key Lessons in Service Innovation , 2012 .

[26]  T. Davenport Competing on analytics. , 2006, Harvard business review.

[27]  R. Cooper,et al.  Winning Businesses in Product Development: The Critical Success Factors , 1996 .

[28]  B. Zirger,et al.  A study of success and failure in product innovation: The case of the U.S. electronics industry , 1984, IEEE Transactions on Engineering Management.

[29]  Roger Smith The Risk-Driven Business Model: Four Questions That Will Define Your Company , 2014 .

[30]  Daniel C. Smith,et al.  Cross-Functional Product Development Teams, Creativity, and the Innovativeness of New Consumer Products , 2001 .

[31]  Ummaha Hazra,et al.  Interpreting simultaneous use of an existing technology and its replacement innovation , 2014 .

[32]  Leslie P. Willcocks,et al.  Business process outsourcing and dynamic innovation , 2014 .

[33]  W. Souder,et al.  New product development success factors in American and British firms , 1999 .

[34]  MaryAnne M. Gobble,et al.  Big Data: The Next Big Thing in Innovation , 2013 .

[35]  Mary Anne M. Gobble Innovation and Ethics in China , 2018 .

[36]  Roger Calantone,et al.  An Integrative Model of the New Product Development Process: An Empirical Validation , 1988 .

[37]  Jason Thibeault,et al.  Recommend This!: Delivering Digital Experiences that People Want to Share , 2014 .

[38]  P. Luarn,et al.  Fan-centric social media: The Xiaomi phenomenon in China , 2014 .

[39]  Darrell Mann,et al.  Sustainable Services & Systems (3s) through systematic innovation methods , 2002 .

[40]  A. Griffin PDMA Research on New Product Development Practices: Updating Trends and Benchmarking Best Practices , 1997 .

[41]  Paul Zikopoulos,et al.  Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data , 2011 .

[42]  T. V. D. Vaart,et al.  Does ICT influence supply chain management and performance? A review of survey-based research , 2011 .

[43]  W. Qualls,et al.  The Interplay of Customer and Product Innovation Dynamics: An Exploratory Study , 2010 .

[44]  Sally Thorne,et al.  Meta-Study of Qualitative Health Research , 2001 .

[45]  Malcolm Wright,et al.  MANAGERS' KNOWLEDGE OF MARKETING PRINCIPLES : THE CASE OF NEW PRODUCT DEVELOPMENT , 2002 .

[46]  A. Rubenstein,et al.  Factors Influencing Innovation Success at the Project Level , 1976 .

[47]  Ali Yakhlef,et al.  Customer involvement in new service development: a conversational approach , 2004 .

[48]  Ron Adner Match your innovation strategy to your innovation ecosystem. , 2006, Harvard business review.

[49]  Tony C. Garrett,et al.  Success through customer-driven new product development: A comparison of U.S. and New Zealand small entrepreneurial high technology firms , 1997 .

[50]  Sanjay Mishra,et al.  Factors affecting new product success: Cross-country comparisons☆ , 1996 .

[51]  P. Duin,et al.  The evolution of innovation management towards contextual innovation , 2008 .

[52]  Harry Boer,et al.  Knowledge and continuous innovation: The CIMA methodology , 2001 .

[53]  Debra L. Shapiro,et al.  Maximizing cross-functional new product teams' innovativeness and constraint adherence: A conflict communications perspective. , 2001 .

[54]  A. Carr,et al.  Communication methods, information sharing, supplier development and performance , 2007 .

[55]  Peter J. Williamson,et al.  Accelerated innovation: : The new challenge from China , 2014 .

[56]  Ying Liao,et al.  Knowledge acquisition and product innovation flexibility in SMEs , 2015, Bus. Process. Manag. J..

[57]  R. Yin Case Study Research: Design and Methods , 1984 .

[58]  Vijay Gupta,et al.  Flexible strategic framework for managing innovation from perspective of continuity and change: A study of SMEs in India , 2014, Bus. Process. Manag. J..

[59]  Friedrich Grosse-Dunker,et al.  Sustainbility Innovation Cube , 2009 .

[60]  Maryanne M. Gobble,et al.  Design Thinking , 2010, The Palgrave Encyclopedia of the Possible.

[61]  S. Dopson,et al.  When Does Search Openness Really Matter? A Contingency Study of Health‐Care Innovation Projects , 2013 .

[62]  Robert G. Cooper,et al.  Stage-gate systems: A new tool for managing new products , 1990 .

[63]  Daniel Baier,et al.  Success Factors for Innovation Management in Networks of Small and Medium Enterprises , 2011 .

[64]  Ping Wang An Integrative Framework for Understanding the Innovation Ecosystem , 2009 .

[65]  Dominic Barton,et al.  Making advanced analytics work for you. , 2012, Harvard business review.

[66]  T. J. Allen,et al.  The process of innovation in five industries in Europe and Japan , 1976, IEEE Transactions on Engineering Management.

[67]  Robert G. Cooper,et al.  How to Identify Potential New Product Winners , 1980 .

[68]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[69]  Ru-Jen Lin,et al.  Customer relationship management and innovation capability: an empirical study , 2010, Ind. Manag. Data Syst..

[70]  M. Parry,et al.  Identifying New Product Successes in China , 1994 .

[71]  J. Marshall Open Innovation: The New Imperative for Creating and Profiting from Technology , 2004 .

[72]  R. Cooper Perspective third-generation new product processes , 1994 .

[73]  Edward S. Steinfeld,et al.  innovation lessons from China , 2014 .

[74]  J. Bessant,et al.  The manufacturing strategy‐capabilities links in mass customisation and agile manufacturing – an exploratory study , 2003 .

[75]  He Xu,et al.  Sourcing under cost information asymmetry when facing time-sensitive customers , 2013 .

[76]  Heiner Evanschitzky,et al.  Success Factors of Product Innovation: An Updated Meta‐Analysis , 2012 .

[77]  Patrick Barwise,et al.  Innovating Beyond the Familiar , 2012 .

[78]  Darren W. Dahl,et al.  Self-Threat and Product Failure: How Internal Attributions of Blame Affect Consumer Complaining Behavior , 2012 .

[79]  Mohamed Zairi,et al.  BPR implementation process: an analysis of key success and failure factors , 1999, Bus. Process. Manag. J..

[80]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[81]  G. Barczak New product strategy, structure, process, and performance in the telecommunications industry , 1995 .

[82]  Roy Rothwell,et al.  SAPPHO updated - project SAPPHO phase II , 1993 .

[83]  C. Prahalad,et al.  The Future of Competition: Co-Creating Unique Value With Customers , 2004 .

[84]  C. Whan Park,et al.  Cross-functional product development teams and the innovativeness of new consumer prodcts , 2001 .

[85]  Stefan Stieglitz,et al.  A role model-based approach for modelling collaborative processes , 2014, Bus. Process. Manag. J..

[86]  Henrik Berglund,et al.  Business Model Innovation from an Open Systems Perspective: Structural challenges and managerial solutions. , 2013 .