Refinements to the variety metric for idea evaluation

Systematically developing innovative products demands effective idea generation methods. The effectiveness can be verified based on a set of metrics, of which the variety metric is one. It is demonstrated that this metric exhibits several shortcomings, such as the lack of level-based measurements, and arbitrarily defined level weights. The currently applied variety metrics, furthermore, do not measure the degree of uniformness of the distribution of ideas over nodes on an abstraction level. A level-based, correctly normalized variety metric which accounts for the degree of uniformness of the distribution of concepts over nodes, is proposed, and is shown to resolve the above issues.

[1]  O. C. Herfindahl.  Concentration in the steel industry , 1950 .

[2]  Christian Wagner,et al.  Stimulating ideas through creativity software , 1994 .

[3]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[4]  Thomas Lee Rodgers,et al.  Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation , 2006, J. Assoc. Inf. Syst..

[5]  Joost R. Duflou,et al.  Identifying candidates for design-by-analogy , 2011, Comput. Ind..

[6]  Amaresh Chakrabarti,et al.  A functional representation for aiding biomimetic and artificial inspiration of new ideas , 2005, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[7]  E. Rietzschel,et al.  From quantity to quality : cognitive, motivational and social aspects of creative idea generation and selection , 2001 .

[8]  A. Osborn.  Applied imagination : principles and procedures of creative problem-solving , 1957 .

[9]  A. Chakrabarti,et al.  Investigating novelty–outcome relationships in engineering design , 2010, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[10]  Julie S. Linsey.  Design-by-analogy and representation in innovative engineering concept generation , 2007 .

[11]  Julie S. Linsey,et al.  Increasing Innovation in Multi-Function Systems: Evaluation and Experimentation of Two Ideation Methods for Design , 2009 .

[12]  J. Valacich,et al.  Effects of anonymity and evaluative tone on idea generation in computer-mediated groups , 1990 .

[13]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[14]  Jami J. Shah,et al.  Evaluation of idea generation methods for conceptual design: Effectiveness metrics and design of experiments , 2000 .

[15]  Sheldon M. Ross,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 1987 .

[16]  T. Bouchard,et al.  Size, performance, and potential in brainstorming groups. , 1970, The Journal of applied psychology.

[17]  Amaresh Chakrabarti,et al.  Sapphire – an Approach to Analysis and Synthesis , 2009 .

[18]  Jef R. Peeters,et al.  Refined Metrics for Measuring Novelty in Ideation , 2010 .

[19]  Simon Szykman,et al.  A functional basis for engineering design: Reconciling and evolving previous efforts , 2002 .

[20]  David W. Rosen,et al.  Refined metrics for measuring ideation effectiveness , 2009 .

[21]  Shad Dowlatshahi,et al.  Product design in a concurrent engineering environment : an optimization approach , 1992 .

[22]  A. Atkinson.  On the measurement of inequality , 1970 .

[23]  Steven M. Smith,et al.  Metrics for measuring ideation effectiveness , 2003 .

[24]  M. Diehl,et al.  Productivity loss in brainstorming groups: Toward the solution of a riddle. , 1987 .

[25]  Philip Samuel,et al.  The Innovator's Toolkit: 50+ Techniques for Predictable and Sustainable Organic Growth , 2008 .

[26]  David W. Rosen,et al.  The effects of biological examples in idea generation , 2010 .

[27]  Kristin L. Wood,et al.  “Collaborating To Success”: An Experimental Study of Group Idea Generation Techniques , 2005 .

[28]  G. S. Alʹtshuller,et al.  The Innovation Algorithm:TRIZ, systematic innovation and technical creativity , 1999 .

[29]  G. D. Taylor,et al.  Design determines 70% of cost? A review of implications for design evaluation , 2001 .