Requirements fixation

There is a broad consensus that understanding system desiderata (requirements) and design creativity are both important for software engineering success. However, little research has addressed the relationship between design creativity and the way requirements are framed or presented. This paper therefore aims to investigate the possibility that the way desiderata are framed or presented can affect design creativity. Forty two participants took part in a randomized control trial where one group received desiderata framed as “requirements” while the other received desiderata framed as “ideas”. Participants produced design concepts which were judged for originality. Participants who received requirements framing produced significantly less original designs than participants who received ideas framing (Mann-Whitney U=116.5, p=0.004). We conclude that framing desiderata as “requirements” may cause requirements fixation where designers’ preoccupation with satisfying explicit requirements inhibits their creativity.

[1]  Silvia Mara Abrahão,et al.  Managing requirements uncertainty in engine control systems development , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[2]  Fausto Giunchiglia,et al.  Tropos: An Agent-Oriented Software Development Methodology , 2004, Autonomous Agents and Multi-Agent Systems.

[3]  Christos Tjortjis,et al.  A metric of confidence in requirements gathered from legacy systems: two industrial case studies , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[4]  T.C. Lethbridge,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK) and the Software Engineering Education Knowledge (SEEK) - a preliminary mapping , 2001, 10th International Workshop on Software Technology and Engineering Practice.

[5]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[6]  R. Weisberg,et al.  Following the wrong footsteps: fixation effects of pictorial examples in a design problem-solving task. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[7]  I. Levin,et al.  How Consumers Are Affected by the Framing of Attribute Information Before and After Consuming the Product , 1988 .

[8]  Tsun Chow,et al.  A survey study of critical success factors in agile software projects , 2008, J. Syst. Softw..

[9]  Paul Ralph,et al.  Introducing an Empirical Model of Design , 2011 .

[10]  Matti Perttula,et al.  The idea exposure paradigm in design idea generation , 2007 .

[11]  M. Boden.  The creative mind : myths & mechanisms , 1991 .

[12]  Bashar Nuseibeh,et al.  Leveraging Inconsistency in Software Development , 2000, Computer.

[13]  Didar Zowghi,et al.  Analysis of requirements volatility during software development life cycle , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[14]  Chad Saunders,et al.  Cognitive heuristics in software engineering applying and extending anchoring and adjustment to artifact reuse , 2004, IEEE Transactions on Software Engineering.

[15]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  Mark Keil,et al.  The effects of optimistic and pessimistic biasing on software project status reporting , 2007, Inf. Manag..

[17]  A. Hughes.  Oxford English Dictionary. , 2008, Isis; an international review devoted to the history of science and its cultural influences.

[18]  Julio Cesar Sampaio do Prado Leite,et al.  On Non-Functional Requirements in Software Engineering , 2009, Conceptual Modeling: Foundations and Applications.

[19]  R. Sternberg,et al.  What is the common thread of creativity? Its dialectical relation to intelligence and wisdom. , 2001, The American psychologist.

[20]  K. T. Yeo,et al.  Critical failure factors in information system projects , 2002 .

[21]  Terri Gullickson.  The Creative Mind: Myths and Mechanisms. , 1995 .

[22]  Neil A. M. Maiden,et al.  Provoking Creativity: Imagine What Your Requirements Could Be Like , 2004, IEEE Softw..

[23]  Kees Dorst,et al.  Comparing paradigms for describing design activity , 1995 .

[24]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[25]  George Wright,et al.  Behavioral Decision Making , 2011 .

[26]  Alistair G. Sutcliffe,et al.  Experience with user-centred requirements engineering , 2011, Requirements Engineering.

[27]  John S. Gero,et al.  Fixation Effects: Do They Exist in Design Problem Solving? , 1993 .

[28]  Neil A. M. Maiden,et al.  Integrating creativity workshops into structured requirements processes , 2004, DIS '04.

[29]  Betty H. C. Cheng,et al.  Research Directions in Requirements Engineering , 2007, Future of Software Engineering (FOSE '07).

[30]  Abhijit Chakraborty,et al.  The Role of Requirement Engineering in Software Development Life Cycle , 2012 .

[31]  Neil A. M. Maiden,et al.  Where Do Requirements Come From? , 2001, IEEE Softw..

[32]  Marina Bosch.  The Rational Unified Process An Introduction , 2016 .

[33]  M. E. Johnson,et al.  A Comparative Study of Tests for Homogeneity of Variances, with Applications to the Outer Continental Shelf Bidding Data , 1981 .

[34]  Paul Ralph,et al.  Improving Coverage of Design in Information Systems Education , 2012, ICIS.

[35]  Capers Jones,et al.  Why software fails , 1996 .

[36]  Masaki Suwa,et al.  Unexpected discoveries and S-invention of design requirements , 2000 .

[37]  Ivar Jacobson,et al.  The Unified Software Development Process , 1999 .

[38]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[39]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[40]  Khaled El Emam,et al.  A Replicated Survey of IT Software Project Failures , 2008, IEEE Software.

[41]  D. Moore,et al.  The trouble with overconfidence. , 2008, Psychological review.

[42]  John S. Gero,et al.  Design and other types of fixation , 1996 .

[43]  David Arnott,et al.  Cognitive biases and decision support systems development: a design science approach , 2006, Inf. Syst. J..

[44]  James Robertson,et al.  Eureka! Why Analysts Should Invent Requirements , 2002, IEEE Softw..

[45]  John S. Gero,et al.  Effects of examples on the results of a design activity , 1992, Knowl. Based Syst..

[46]  Didar Zowghi,et al.  A study of the impact of requirements volatility on software project performance , 2002, Ninth Asia-Pacific Software Engineering Conference, 2002..

[47]  Joachim Karlsson,et al.  Software requirements prioritizing , 1996, Proceedings of the Second International Conference on Requirements Engineering.

[48]  Joan Meyers-Levy,et al.  The Influence of Message Framing and Issue Involvement , 1990 .

[49]  J Nakamura,et al.  Catalytic creativity. The case of Linus Pauling. , 2001, The American psychologist.

[50]  John Mylopoulos,et al.  Conceptual Modeling: Foundations and Applications - Essays in Honor of John Mylopoulos , 2009, Conceptual Modeling: Foundations and Applications.

[51]  John Mylopoulos,et al.  Representing and Using Nonfunctional Requirements: A Process-Oriented Approach , 1992, IEEE Trans. Software Eng..

[52]  Paul Ralph,et al.  Comparing Two Software Design Process Theories , 2010, DESRIST.

[53]  Peter Checkland,et al.  Systems Thinking, Systems Practice , 1981 .

[54]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[55]  A. T. Bahill,et al.  Discovering system requirements , 1996 .

[56]  Frederick P. Brooks,et al.  The Design of Design: Essays from a Computer Scientist , 2010 .

[57]  Arthur J. Cropley,et al.  Creativity: A social approach , 2006 .

[58]  Mary Lou Maher,et al.  Formalising Design Exploration as Co-Evolution , 1996 .

[59]  Uday R. Kulkarni,et al.  Critical success factors for software projects , 1998, ICIS '98.

[60]  C. H. Dorst,et al.  Describing Design - A comparison of paradigms , 1997 .

[61]  Karan Harbison,et al.  User-Centered Requirements: The Scenario-Based Engineering Process , 1997 .

[62]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[63]  R.N. Charette,et al.  Why software fails [software failure] , 2005, IEEE Spectrum.

[64]  Zhang Lujun.  Design fixation and solution quality under exposure to example solution , 2011, 2011 IEEE 2nd International Conference on Computing, Control and Industrial Engineering.

[65]  D. DeMeo,et al.  A Comparative Study of Tests for Homogeneity of Variances with Application to DNA Methylation Data , 2015, PloS one.

[66]  Karl Cox,et al.  Requirements Engineering and Software Project Success: an industrial survey in Australia and the U.S , 2005, Australas. J. Inf. Syst..

[67]  P. Krutchen,et al.  The Rational Unified Process: An Introduction , 2000 .

[68]  Hans Lind,et al.  A note on the robustness of a classical framing result , 1992 .

[69]  Paul Ralph,et al.  Toward a Theory of Debiasing Software Development , 2011, SIGSAND.

[70]  Webb Stacy,et al.  Cognitive bias in software engineering , 1995, CACM.

[71]  Frada Burstein,et al.  Australian Journal of Information Systems , 2001 .

[72]  Paul Ralph,et al.  Software engineering process theory: A multi-method comparison of Sensemaking-Coevolution-Implementation Theory and Function-Behavior-Structure Theory , 2013, Inf. Softw. Technol..

[73]  Martin Glinz,et al.  On Non-Functional Requirements , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[74]  Gregory D. Abowd,et al.  Storyboarding: an empirical determination of best practices and effective guidelines , 2006, DIS '06.

[75]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.

[76]  Eric Yu,et al.  Conceptual Modeling: Foundations and Applications: Essays in Honor of John Mylopoulos , 2009 .

[77]  Peter Salovey,et al.  The Influence of Message Framing on Intentions to Perform Health Behaviors , 1993 .

[78]  Venkataraman Ramesh,et al.  Improving information requirements determination: a cognitive perspective , 2002, Inf. Manag..

[79]  W. Lyddon.  Creativity in Context: Update to "The Social Psychology of Creativity" , 1998 .

[80]  Mark A. Runco,et al.  Commentary: Divergent Thinking Is Not Synonymous With Creativity , 2008 .

[81]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[82]  Eric S. K. Yu,et al.  Towards modelling and reasoning support for early-phase requirements engineering , 1997, Proceedings of ISRE '97: 3rd IEEE International Symposium on Requirements Engineering.

[83]  John S. Gero,et al.  Design Fixation and Intelligent Design AIDS , 1994 .

[84]  Ian J. Deary,et al.  What Intelligence Tests Miss: The Psychology of Rational Thought , 2010 .

[85]  LeMai Nguyen,et al.  Supporting and monitoring the creativity of IS personnel during the requirements engineering process , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[86]  Stephen Fickas,et al.  Goal-Directed Requirements Acquisition , 1993, Sci. Comput. Program..

[87]  M. Mumford.  Where Have We Been, Where Are We Going? Taking Stock in Creativity Research , 2003 .

[88]  Nigel Cross,et al.  Creativity in the design process: co-evolution of problem–solution , 2001 .

[89]  Scott Curland Chase,et al.  Transforming shape in design: observations from studies of sketching , 2009 .

[90]  Ken Schwaber,et al.  Agile Project Management with Scrum , 1980 .

[91]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[92]  Anthony Finkelstein,et al.  Requirements stability assessment using scenarios , 2003, Proceedings. 11th IEEE International Requirements Engineering Conference, 2003..

[93]  Fei-Fei Cheng,et al.  Debiasing the framing effect: The effect of warning and involvement , 2010, Decis. Support Syst..

[94]  Benjamin Kuipers,et al.  A Description of Think Aloud Method and Protocol Analysis , 1993 .

[95]  Axelos.  Managing Successful Projects with PRINCE2 , 2009 .

[96]  Sara Jones,et al.  Requirements Engineering as Creative Problem Solving: A Research Agenda for Idea Finding , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[97]  Nigel Cross,et al.  Research in design Thinking , 1992 .

[98]  Paul Ralph.  The illusion of requirements in software development , 2012, Requirements Engineering.

[99]  York P. Freund.  Critical success factors , 1988 .

[100]  Rachel Harrison,et al.  A method for assessing confidence in requirements analysis , 2011, Inf. Softw. Technol..

[101]  Andrew P. Sage,et al.  Handbook of Systems Engineering and Management , 2011 .

[102]  A. Luchins,et al.  Rigidity of behavior : a variational approach to the effect of Einstellung , 1961 .

[103]  J. Guilford.  Three faces of intellect. , 1959 .

[104]  Robert J. Youmans,et al.  The effects of physical prototyping and group work on the reduction of design fixation , 2011 .

[105]  Mordechai Ben-Menachem,et al.  Writing effective use cases , 2001, SOEN.

[106]  Axel van Lamsweerde,et al.  Goal-oriented requirements enginering: a roundtrip from research to practice [enginering read engineering] , 2004, Proceedings. 12th IEEE International Requirements Engineering Conference, 2004..

[107]  Annie I. Antón,et al.  Goal-based requirements analysis , 1996, Proceedings of the Second International Conference on Requirements Engineering.

[108]  Schneider,et al.  All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects. , 1998, Organizational behavior and human decision processes.

[109]  Cameron M. Ford.  The futurity of decisions as a facilitator of organizational creativity and change , 2002 .

[110]  Paul Ralph,et al.  The Sensemaking-Coevolution-Implementation Theory of software design , 2013, Sci. Comput. Program..