Investigating Retrieval-Induced Forgetting During Information Requirements Determination

Radha Appan Nance College of Business Administration Cleveland State University radha.appan@gmail.com Glenn J. Browne McIntire School of Commerce University of Virginia gbrowne@virginia.edu Successful systems development requires that appropriate and accurate information be gathered from people who use or will use the system. One critical issue in information gathering is the recall of relevant information by users and other stakeholders. Prior research has shown that users do not recall all the relevant information they have about the requirements for systems, and we suggest that this problem is exacerbated by current systems development practice, in which the same users are often interviewed multiple times by analysts. A potential theoretical explanation for recall failure in requirements determination is the psychological phenomenon known as Retrieval-Induced Forgetting. Retrieval-Induced Forgetting (RIF) theory and empirical findings show that when people are asked to recall information about a situation multiple times, they are likely to recall the same information on subsequent attempts as they recalled on the first attempt (to the exclusion of other relevant information). Although the RIF phenomenon has been investigated in several contexts, such as eyewitness testimony, there have been no studies that have examined the issue in applied contexts such as systems development, in which prior domain knowledge exists and has been learned over a period of time by users and other stakeholders. In the current study, experimental results showed the presence of RIF in both short-term and longer-term information requirements determination (IRD) contexts, thereby providing a memory-based explanation for missing requirements in IRD. Our results have strong implications for the type and sequencing of requirements elicitation techniques and demonstrate threats to both traditional and iterative development methodologies.

[1]  Jo Saunders,et al.  New evidence on the suggestibility of memory: the role of retrieval-induced forgetting in misinformation effects. , 2002, Journal of experimental psychology. Applied.

[2]  M. Conway,et al.  Assessing the inhibitory account of retrieval-induced forgetting with implicit-memory tests. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Franz Lehner,et al.  Requirements Engineering as a Success Factor in Software Projects , 2001, IEEE Softw..

[4]  M. Bazerman Judgment in Managerial Decision Making , 1990 .

[5]  Erik M Altmann,et al.  Functional decay of memory for tasks , 2002, Psychological research.

[6]  Hugh F. Juergens Attributes of Information System Development , 1977, MIS Q..

[7]  Robert W. Zmud,et al.  A Synthesis of Research on Requirements Analysis and Knowledge Acquisition Techniques , 1992, MIS Q..

[8]  Robert W. Zmud,et al.  The Use of Mental Imagery to Facilitate Information Identification in Requirements Analysis , 1993, J. Manag. Inf. Syst..

[9]  Thomas H. Carr,et al.  Inhibitory Semantic Priming of Lexical Decisions Due to Failure to Retrieve Weakly Activated Codes , 1990 .

[10]  C. Macrae,et al.  On recollections lost: When practice makes imperfect , 1999 .

[11]  Jessie H. Chen-Yu,et al.  Website Evaluation Criteria Among Us College Student Consumers with Different Shopping Orientations and Internet Channel Usage , 2007 .

[12]  R. Fisher,et al.  Field test of the Cognitive Interview: enhancing the recollection of actual victims and witnesses of crime. , 1989, The Journal of applied psychology.

[13]  P. Atkinson,et al.  Making sense of qualitative data , 1996 .

[14]  Gordon B. Davis,et al.  Strategies for Information Requirements Determination , 1982, IBM Syst. J..

[15]  Eric D. Carlson,et al.  Case Studies of End User Requirements for Interactive Problem-Solving Systems , 1977, MIS Q..

[16]  Zara M. Bergström,et al.  The University of Birmingham ( Live System ) Neural markers of inhibition in human memory retrieval , 2016 .

[17]  Robert A. Bjork,et al.  Retrieval-induced forgetting in an eyewitness-memory paradigm , 1995, Psychonomic bulletin & review.

[18]  Benjamin C. Storm,et al.  Is retrieval success a necessary condition for retrieval-induced forgetting? , 2006, Psychonomic bulletin & review.

[19]  Rosío Alvarez,et al.  Tell me a good story: using narrative analysis to examine information requirements interviews during an ERP implementation , 2002, DATB.

[20]  H. Wolff The complete introductory lectures on psychoanalysis , 1967 .

[21]  C WetherbeJames Executive information requirements , 1991 .

[22]  Karl-Heinz T. Bäuml,et al.  Strong items get suppressed, weak items do not: The role of item strength in output interference , 1998 .

[23]  Frank Maurer,et al.  Requirements engineering and agile software development , 2003, WET ICE 2003. Proceedings. Twelfth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2003..

[24]  James C. Wetherbe Executive Information Requirements: Getting It Right , 1991, MIS Q..

[25]  Venkataraman Ramesh,et al.  Understanding Conceptual Schemas: Exploring the Role of Application and IS Domain Knowledge , 2006, Inf. Syst. Res..

[26]  Daniel L. Schacter,et al.  Facilitation and impairment of event memory produced by photograph review , 1999, Memory & cognition.

[27]  Rebekah E. Smith,et al.  The influence of distinctive processing on retrieval-induced forgetting , 2000, Memory & cognition.

[28]  Robert P. Bostrom,et al.  Successful application of communication techniques to improve the systems development process , 1989, Inf. Manag..

[29]  Michael C. Anderson,et al.  Retrieval-induced forgetting: Evidence for a recall-specific mechanism , 2000, Psychonomic bulletin & review.

[30]  Moshe Telem,et al.  Information requirements specification II: Brainstorming collective decision-making technique , 1988, Inf. Process. Manag..

[31]  RameshV.,et al.  Improving information requirements determination , 2002 .

[32]  R. Bjork Retrieval inhibition as an adaptive mechanism in human memory. , 1989 .

[33]  Malcolm D. MacLeod,et al.  Retrieval‐induced forgetting in eyewitness memory: forgetting as a consequence of remembering , 2002 .

[34]  Ron Weber,et al.  Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests , 2001, Inf. Syst. Res..

[35]  Michael C. Anderson,et al.  Suppressing unwanted memories by executive control , 2001, Nature.

[36]  Iris Vessey,et al.  Learning to Specify Information Requirements: The Relationship between Application and Methodology , 1993, J. Manag. Inf. Syst..

[37]  A. R. Lurii︠a︡ Human brain and psychological processes , 1966 .

[38]  Michael C. Anderson,et al.  Remembering can cause forgetting: retrieval dynamics in long-term memory. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[39]  R. Fisher,et al.  Memory-Enhancing Techniques for Investigative Interviewing: The Cognitive Interview , 1992 .

[40]  Donald J. Reifer,et al.  How good are agile methods? , 2002, IEEE Software.

[41]  Michael C. Anderson,et al.  Integration as a general boundary condition on retrieval-induced forgetting , 1999 .

[42]  J. Shanteue COMPETENCE IN EXPERTS: THE ROLE OF TASK CHARACTERISTICS , 1992 .

[43]  Michael C. Anderson Rethinking interference theory: Executive control and the mechanisms of forgetting. , 2003 .

[44]  Moshe Telem,et al.  Information requirements specification I: Brainstorming collective decision-making approach , 1988, Inf. Process. Manag..

[45]  M. Macleod,et al.  Can inhibition resolve retrieval competition through the control of spreading activation? , 2006, Memory & cognition.

[46]  Michael C. Anderson Active Forgetting , 2001 .

[47]  J. H. Neely Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. , 1977 .

[48]  E. Loftus,et al.  The influence of one memory retrieval on a subsequent memory retrieval , 1974, Memory & cognition.

[49]  William L. Cull,et al.  Expanding understanding of the expanding-pattern-of-retrieval mnemonic: Toward confidence in applicability , 1996 .

[50]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[51]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[52]  H L Roediger,et al.  Inhibiting effects of recall , 1974, Memory & cognition.

[53]  J. D. Couger,et al.  Creativity/Innovation in Information Systems Organizations Introduction to Session , 1996, Proceedings of HICSS-29: 29th Hawaii International Conference on System Sciences.

[54]  Elizabeth J. Davidson,et al.  Technology Frames and Framing: A Socio-Cognitive Investigation of Requirements Determination , 2002, MIS Q..

[55]  C. N. Macrae,et al.  Gone but Not Forgotten: The Transient Nature of Retrieval-Induced Forgetting , 2001, Psychological science.

[56]  P. Atkinson,et al.  Making Sense of Qualitative Data: Complementary Research Strategies , 1996 .

[57]  T. Carr,et al.  Inhibitory Processes in Attention, Memory and Language , 1994 .

[58]  J. Raaijmakers,et al.  A model for interference and forgetting , 1988 .

[59]  Ehren L. Newman,et al.  A neural network model of retrieval-induced forgetting. , 2007, Psychological review.

[60]  Fraser A. Bleasdale,et al.  Retrieval difficulty and subsequent recall , 1973, Memory & cognition.

[61]  Glenn J. Browne,et al.  Stopping rule use during information search in design problems , 2004 .

[62]  Stephen M. Fiore,et al.  At a Loss From Words: Verbal Overshadowing of Perceptual Memories , 1997 .

[63]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[64]  Hollyn M. Johnson,et al.  Processes of successful intentional forgetting. , 1994 .

[65]  Glenn J. Browne,et al.  Stopping Behavior of Systems Analysts During Information Requirements Elicitation , 2004, J. Manag. Inf. Syst..

[66]  A P Shimamura,et al.  Retrieval-induced forgetting in episodic memory. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[67]  Nicholas P. Vitalari,et al.  Differences Between Novice and Expert Systems Analysts: What Do We Know and What Do We Do? , 1998, J. Manag. Inf. Syst..

[68]  T A Blaxton,et al.  Inhibition from semantically related primes: Evidence of a category-specific inhibition , 1983, Memory & cognition.

[69]  Henry L. Roediger,et al.  Output Interference in the Recall of Categorized and Paired-Associate Lists , 1980 .

[70]  G. A. Allen,et al.  Effects of recall tests on long-term retention of paired associates , 1969 .

[71]  Alan M. Davis,et al.  A Unified Model of Requirements Elicitation , 2004, J. Manag. Inf. Syst..

[72]  P. E. Morris,et al.  Practical aspects of memory , 1980 .

[73]  J. Waters,et al.  The Experimenting Organization: Using The Results of Behavioral Science Research , 1978 .

[74]  Julie E. Kendall,et al.  Systems analysis and design , 1981 .

[75]  Rodolfo Alfredo Bertone,et al.  Software engineering: Theory and practice, 2nd Edition. Shari Lawrence Pfleeger. Prentice Hall, 2001 , 2005 .

[76]  Barry W. Boehm,et al.  Get Ready for Agile Methods, with Care , 2002, Computer.

[77]  Jan Pries-Heje,et al.  Short cycle time systems development , 2004, Inf. Syst. J..

[78]  Hugh J. Watson,et al.  Determining Information Requirements for an EIS , 1993, MIS Q..

[79]  Barry W. Boehm,et al.  Using Risk to Balance Agile and Plan-Driven Methods , 2003, Computer.

[80]  Roland T. Mittermeir,et al.  Alternatives to Overcome the Communications Problem of Formal Requirements Analysis. , 1982 .

[81]  Paul H. Cheney,et al.  A Theoretically Grounded Approach to Assist Memory Recall During Information Requirements Determination , 1998, J. Manag. Inf. Syst..

[82]  Edward E. Smith,et al.  Fact retrieval and the paradox of interference , 1978, Cognitive Psychology.

[83]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[84]  Michael C. Anderson,et al.  On the status of inhibitory mechanisms in cognition: memory retrieval as a model case. , 1995, Psychological review.

[85]  William Hirst,et al.  Forgetting the Unforgettable Through Conversation , 2009, Psychological science.

[86]  Glenn J. Browne,et al.  An Empirical Investigation of User Requirements Elicitation: Comparing the Effectiveness of Prompting Techniques , 2001, J. Manag. Inf. Syst..

[87]  Alan R. Dennis,et al.  Information Exchange and Use in Group Decision Making: You Can Lead a Group to Information, but You Can't Make It Think , 1996, MIS Q..

[88]  William Hirst,et al.  Silence Is Not Golden , 2007, Psychological science.

[89]  Venkataraman Ramesh,et al.  Improving information requirements determination: a cognitive perspective , 2002, Inf. Manag..