Understanding requirement prioritization artifacts: a systematic mapping study

The importance of prioritizing requirements stems from the fact that not all requirements can usually be met with available time and resource constraints. Efficient and trustworthy methods for prioritizing requirements are therefore in high demand. In this article, we present results of a systematic mapping study in order to appreciate the different considerations that have influenced prioritization of software requirements, identify the various types of artifacts proposed toward prioritizing software requirements, and examine certain characterizations of these artifacts. The results emphasize the heightened attention the domain of requirement prioritization has received in recent years. On the basis of this study, we are able to provide the following inferences regarding possible future research trajectories in software requirement prioritization artifacts: (1) focus on frameworks and tools; (2) emphasis on specialization; and (3) proposition of theory-based artifacts. Additional research possibilities are also pointed out at the end and are expected to stimulate further research on the topic.

[1]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[2]  D. Jannach,et al.  Evaluation of Novel Approaches to Software Engineering , 2017, Communications in Computer and Information Science.

[3]  Ian Sommerville,et al.  Requirements Engineering: Processes and Techniques , 1998 .

[4]  M. Arfan Jaffar,et al.  Value Based Fuzzy Requirement Prioritization and Its Evaluation Framework , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[5]  Sarah Hatton,et al.  Choosing the Right Prioritisation Method , 2008, 19th Australian Conference on Software Engineering (aswec 2008).

[6]  Jane Cleland-Huang,et al.  Lessons Learned from Open Source Projects for Facilitating Online Requirements Processes , 2009, REFSQ.

[7]  Frank J. Mitropoulos,et al.  Capturing, eliciting, predicting and prioritizing (CEPP) non-functional requirements metadata during the early stages of agile software development , 2015, SoutheastCon 2015.

[8]  Dietmar Pfahl,et al.  Trade-off Analysis for Requirements Selection , 2003, Int. J. Softw. Eng. Knowl. Eng..

[9]  Des Greer,et al.  Software release planning: an evolutionary and iterative approach , 2004, Inf. Softw. Technol..

[10]  Daniel M. Berry,et al.  Distributed priority ranking of strategic preliminary requirements for management information systems in economic organizations , 2007, Inf. Softw. Technol..

[11]  Roel Wieringa,et al.  Agile Requirements Prioritization: What Happens in Practice and What Is Described in Literature , 2011, REFSQ.

[12]  Chen Yi-zeng,et al.  A fuzzy game approach to prioritize customer requirements in Quality Function Deployment , 2014, 2014 International Conference on Management Science & Engineering 21th Annual Conference Proceedings.

[13]  Rita Almeida Ribeiro,et al.  Hybrid assessment method for software engineering decisions , 2011, Decis. Support Syst..

[14]  J. Kruskal.  On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[15]  Joachim Karlsson,et al.  Improved practical support for large-scale requirements prioritising , 1997, Requirements Engineering.

[16]  Karl E. Wiegers.  First Things First: Prioritizing Requirements , 1999 .

[17]  B Downe-Wamboldt,et al.  Content analysis: method, applications, and issues. , 1992, Health care for women international.

[18]  Tony Gorschek,et al.  Prioritization of quality requirements: State of practice in eleven companies , 2011, 2011 IEEE 19th International Requirements Engineering Conference.

[19]  Christoph Riedl,et al.  Tool-Supported Innovation Management in Service Ecosystems , 2011 .

[20]  A. Herrmann,et al.  Requirements Prioritization Based on Benefit and Cost Prediction: An Agenda for Future Research , 2008, 2008 16th IEEE International Requirements Engineering Conference.

[21]  Md. Rizwan Beg,et al.  Reduction in number of comparisons for requirement prioritization using B-Tree , 2009, 2009 IEEE International Advance Computing Conference.

[22]  Odorico Machado Mendizabal,et al.  Log-based approach for performance requirements elicitation and prioritization , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[23]  Jorge García Duque,et al.  Composing requirements specifications from multiple prioritized sources , 2008, Requirements Engineering.

[24]  Dayang N. A. Jawawi,et al.  PHandler: An expert system for a scalable software requirements prioritization process , 2015, Knowl. Based Syst..

[25]  Claes Wohlin,et al.  A product management challenge: Creating software product value through requirements selection , 2008, J. Syst. Archit..

[26]  Fiorenzo Franceschini,et al.  Customer requirement prioritization on QFD: a new proposal based on the generalized Yager’s algorithm , 2015 .

[27]  Jane Cleland-Huang,et al.  Towards Automated Requirements Triage , 2007, 15th IEEE International Requirements Engineering Conference (RE 2007).

[28]  A. Vinaya Babu,et al.  Interval Evidential Reasoning Algorithm for Requirements Prioritization , 2012 .

[29]  Kashif Ahmed Khan,et al.  A Systematic Review of Software Requirements Prioritization , 2006 .

[30]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[31]  Aldo Dagnino,et al.  Architectural requirements prioritization and analysis applied to software technology evaluation , 2009, SAC '09.

[32]  Marten Schönherr,et al.  Artifact Types in Information Systems Design Science - A Literature Review , 2010, DESRIST.

[33]  Jian-Bo Yang,et al.  The evidential reasoning approach for multi-attribute decision analysis under interval uncertainty , 2006, Eur. J. Oper. Res..

[34]  A. Susi,et al.  An Empirical Study to Compare the Accuracy of AHP and CBRanking Techniques for Requirements Prioritization , 2007, 2007 Fifth International Workshop on Comparative Evaluation in Requirements Engineering.

[35]  Balsam A. Mustafa,et al.  An experimental design to compare software requirements prioritization techniques , 2014, 2014 International Conference on Computational Science and Technology (ICCST).

[36]  Claes Wohlin,et al.  Requirements prioritisation: an experiment on exhaustive pair-wise comparisons versus planning game partitioning , 2004, ICSE 2004.

[37]  Patrik Berander,et al.  Hierarchical Cumulative Voting (hcv) - Prioritization of Requirements in Hierarchies , 2006, Int. J. Softw. Eng. Knowl. Eng..

[38]  Marjo Kauppinen,et al.  Empirical Evaluation of Two Requirements Prioritization Methods in Product Development Projects , 2004, EuroSPI.

[39]  Martin Höst,et al.  Evaluating the practical use of different measurement scales in requirements prioritisation , 2006, ISESE '06.

[40]  Xiaoqing Frank Liu,et al.  Priority assessment of software requirements from multiple perspectives , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[41]  Barbara Paech,et al.  Practical challenges of requirements prioritization based on risk estimation , 2009, Empirical Software Engineering.

[42]  Seyed Ali Marjaie,et al.  Recognition of Hidden Factors in Requirements Prioritization Using Factor Analysis , 2010, 2010 International Conference on Computational Intelligence and Software Engineering.

[43]  Shirley Gregor,et al.  Building theory in the sciences of the artificial , 2009, DESRIST.

[44]  Jörg Dörr,et al.  A Systematic Literature Review of Requirements Prioritization Criteria , 2015, REFSQ.

[45]  John Mylopoulos,et al.  Representing and reasoning about preferences in requirements engineering , 2011, Requirements Engineering.

[46]  Stephen Cavanagh Rgn,et al.  Content analysis: concepts, methods and applications. , 1997, Nurse researcher.

[47]  Xiaoqing Frank Liu,et al.  Business-oriented software process improvement based on CMMI using QFD , 2010, Inf. Softw. Technol..

[48]  Klaas Sikkel,et al.  Do We Know Enough about Requirements Prioritization in Agile Projects: Insights from a Case Study , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[49]  Joachim Karlsson,et al.  A Cost-Value Approach for Prioritizing Requirements , 1997, IEEE Softw..

[50]  Jerffeson Souza,et al.  A Fuzzy Approach to Requirements Prioritization , 2011, SSBSE.

[51]  João M. Fernandes,et al.  Comparing AHP and ELECTRE I for prioritizing software requirements , 2015, 2015 IEEE/ACIS 16th International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD).

[52]  Sanjaya Kumar Saxena,et al.  Decisively: Application of Quantitative Analysis and Decision Science in Agile Requirements Engineering , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[53]  BarrosMárcio,et al.  Software requirements selection and prioritization using SBSE approaches , 2015 .

[54]  Jean Tabaka,et al.  Collaboration Explained: Facilitation Skills for Software Project Leaders , 2006 .

[55]  Nick Boucart,et al.  Demystifying Release Definition: From Requirements Prioritization to Collaborative Value Quantification , 2009, REFSQ.

[56]  Varun Gupta,et al.  Incremental development & revolutions of E-learning software systems in education sector: a case study approach , 2013, Human-centric Computing and Information Sciences.

[57]  Patrik Berander,et al.  Evaluating two ways of calculating priorities in requirements hierarchies - An experiment on hierarchical cumulative voting , 2009, J. Syst. Softw..

[58]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[59]  Muhammad Imran Babar,et al.  Challenges and future trends in software requirements prioritization , 2011, International Conference on Computer Networks and Information Technology.

[60]  Peng Shao,et al.  Sample selection: an algorithm for requirements prioritization , 2008, ACM-SE 46.

[61]  Roel Wieringa,et al.  A conceptual model and process for client-driven agile requirements prioritization , 2010, 2010 Fourth International Conference on Research Challenges in Information Science (RCIS).

[62]  Dragan Gasevic,et al.  Stratified Analytic Hierarchy Process: Prioritization and Selection of Software Features , 2010, SPLC.

[63]  Isabelle Mirbel,et al.  A tool to improve requirements review in collaborative software development platforms , 2014, 2014 IEEE Eighth International Conference on Research Challenges in Information Science (RCIS).

[64]  Yuanyuan Zhang,et al.  Comparing the performance of metaheuristics for the analysis of multi-stakeholder tradeoffs in requirements optimisation , 2011, Inf. Softw. Technol..

[65]  Barbara Paech,et al.  Elicitation and Documentation of Non-Functional Requirements for Sociotechnical Systems , 2005 .

[66]  Keqing He,et al.  An Algorithm for Priority Ranking of Individualized Functional Requirements in Networked Software , 2008, 2008 Seventh International Conference on Grid and Cooperative Computing.

[67]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[68]  Barry W. Boehm,et al.  Selecting an appropriate framework for value-based requirements prioritization , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[69]  Eman S. Nasr,et al.  A goal-based technique for requirements prioritization , 2014, 2014 9th International Conference on Informatics and Systems.

[70]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[71]  Ceyda Güngör Sen,et al.  Fuzzy quality function deployment based methodology for acquiring enterprise software selection requirements , 2010, Expert Syst. Appl..

[72]  Anthony Finkelstein,et al.  Ieee Transactions on Software Engineering, Manuscript Id Stakerare: Using Social Networks and Collaborative Filtering for Large-scale Requirements Elicitation , 2022 .

[73]  Frank Moisiadis,et al.  The fundamentals of prioritising requirements , 2002 .

[74]  Ralph L. Keeney,et al.  Foundations for making smart decisions , 1999 .

[75]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[76]  Martin Höst,et al.  A Quality Performance Model for Cost-Benefit Analysis of Non-functional Requirements Applied to the Mobile Handset Domain , 2007, REFSQ.

[77]  Martin Höst,et al.  An Industrial Case Study on Distributed Prioritisation in Market-Driven Requirements Engineering for Packaged Software , 2001, Requirements Engineering.

[78]  D. Sackett,et al.  Cochrane Collaboration , 1994, BMJ.

[79]  Albert C. Yeh,et al.  Requirements engineering support technique (REQUEST): a market driven requirements management process , 1992, [1992] Proceedings of the Second Symposium on Assessment of Quality Software Development Tools.

[80]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[81]  Claes Wohlin,et al.  An evaluation of methods for prioritizing software requirements , 1998, Inf. Softw. Technol..

[82]  Rahul Thakurta,et al.  A framework for prioritization of quality requirements for inclusion in a software project , 2012, Software Quality Journal.

[83]  Rob J. Kusters,et al.  Quality specification and metrication, results from a case-study in a mission-critical software domain , 2010, Software Quality Journal.

[84]  Marjo Kauppinen,et al.  Suitability of requirements prioritization methods for market-driven software product development , 2006, Softw. Process. Improv. Pract..

[85]  Hans Christian Benestad,et al.  Does the prioritization technique affect stakeholders' selection of essential software product features? , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[86]  Jörg Dörr,et al.  An Analysis of Priority-Based Decision Heuristics for Optimizing Elicitation Efficiency , 2014, REFSQ.

[87]  Radziah Mohamad,et al.  Requirements prioritization techniques and different aspects for prioritization a systematic literature review protocol , 2014, 2014 8th. Malaysian Software Engineering Conference (MySEC).

[88]  Márcio de Oliveira Barros,et al.  Software requirements selection and prioritization using SBSE approaches: A systematic review and mapping of the literature , 2015, J. Syst. Softw..

[89]  Inge van de Weerd,et al.  Binary Priority List for Prioritizing Software Requirements , 2010, REFSQ.

[90]  Jane Cleland-Huang,et al.  Injecting Value-Thinking into Prioritization Decisions , 2015, IEEE Software.

[91]  Norman Riegel,et al.  Model-based prioritization in business-process-driven software development , 2012, 2012 20th IEEE International Requirements Engineering Conference (RE).

[92]  Adarsh Kumar Kakar.  Investigating the penalty reward calculus of software users and its impact on requirements prioritization , 2015, Inf. Softw. Technol..

[93]  Randy K. Smith,et al.  Value-Oriented Requirements Prioritization in a Small Development Organization , 2007, IEEE Software.

[94]  Kevin Logue,et al.  Handling Uncertainty in Agile Requirement Prioritization and Scheduling Using Statistical Simulation , 2008, Agile 2008 Conference.

[95]  Joachim Karlsson,et al.  Software requirements prioritizing , 1996, Proceedings of the Second International Conference on Requirements Engineering.

[96]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[97]  Pearl Brereton,et al.  Using Mapping Studies in Software Engineering , 2008, PPIG.

[98]  Sai Peck Lee,et al.  Application of Hybrid Assessment Method for Priority Assessment of Functional and Non-Functional Requirements , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[99]  Nupul Kukreja,et al.  Decision theoretic requirements prioritization A two-step approach for sliding towards value realization , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[100]  Radziah Mohamad,et al.  Multi-aspects based requirements priortization technique for value-based software developments , 2014, 2014 International Conference on Emerging Technologies (ICET).

[101]  Ali Selamat,et al.  A systematic literature review of software requirements prioritization research , 2014, Inf. Softw. Technol..

[102]  Jyrki Wallenius,et al.  Multiple Criteria Decision Making: From Early History to the 21st Century , 2011 .

[103]  Xinggang Luo,et al.  Determining the final priority ratings of customer requirements in product planning by MDBM and BSC , 2012, Expert Syst. Appl..

[104]  Patrik Berander,et al.  Using students as subjects in requirements prioritization , 2004, Proceedings. 2004 International Symposium on Empirical Software Engineering, 2004. ISESE '04..

[105]  Sjaak Brinkkemper,et al.  Integrated Requirement Selection and Scheduling for the Release Planning of a Software Product , 2007, REFSQ.

[106]  Paolo Tonella,et al.  Interactive requirements prioritization using a genetic algorithm , 2013, Inf. Softw. Technol..

[107]  Jonas S. Karlsson.  Towards a strategy for software requirements selection , 1995 .

[108]  Alan M. Davis,et al.  Just Enough Requirements Management: Where Software Development Meets Marketing , 2005 .

[109]  Punam Bedi,et al.  An Application of Multi-Person Decision-Making Model for Negotiating and Prioritizing Requirements in Agent-Oriented Paradigm , 2010, 2010 International Conference on Data Storage and Data Engineering.

[110]  Bruno Rossi,et al.  Requirements prioritization in software engineering: A systematic mapping study , 2013, 2013 3rd International Workshop on Empirical Requirements Engineering (EmpiRE).

[111]  J. Higgins.  Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[112]  Muhammad Atif Iqbal,et al.  A New Requirement Prioritization Model for Market Driven Products Using Analytical Hierarchical Process , 2010, 2010 International Conference on Data Storage and Data Engineering.

[113]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[114]  Jean-Louis Guigou,et al.  B. Rouget. Modèles de gravitation et théorie des graphes. Paris, Dunod, Collection de l'institut de Mathématiques Economiques, n° 2, 1971 , 1972 .

[115]  Arfan Jaffar,et al.  Analysis and optimization of software requirements prioritization techniques , 2010, 2010 International Conference on Information and Emerging Technologies.

[116]  Paolo Tonella,et al.  Using Interactive GA for Requirements Prioritization , 2010, 2nd International Symposium on Search Based Software Engineering.