CrowdRE in a Governmental Setting: Lessons from Two Case Studies

Crowd-based Requirements Engineering, or CrowdRE, is a recent paradigm that promotes the active participation of a large number of stakeholders in RE. In CrowdRE, requirements elicitation can be crowdsourced by creating an online platform that allows stakeholders to formulate ideas regarding the specific product. Although some case studies on crowd-based elicitation exist, no conclusive evidence can be derived on the effectiveness of such techniques. In this paper, we study crowd-based elicitation within a large governmental organization. We conduct two case studies of CrowdRE within the Royal Netherlands Marechaussee. For this, we construct the KMar-Crowd method, which adapts CrowdRE ideas to the needs of governmental organizations. While one case compares the crowd-generated ideas with requirements elicited via interviews and similar techniques, the other measures the usefulness of the gathered ideas for a product for which no prior elicitation was conducted. The results of the case studies, which attracted larger crowds than in previous studies, indicate that CrowdRE can be successfully applied to engage the users of a software product in requirements elicitation. Contradicting earlier studies, the inclusion of gamification elements in the CrowdRE method did not increase the motivation to participate, possibly due to the nature of governmental organizations.

[1]  Anna Perini,et al.  Analysis of Online Discussions in Support of Requirements Discovery , 2017, CAiSE.

[2]  Martin Glinz,et al.  GARUSO: a gamification approach for involving stakeholders outside organizational reach in requirements engineering , 2019, Requirements Engineering.

[3]  Harald C. Gall,et al.  How can i improve my app? Classifying user reviews for software maintenance and evolution , 2015, 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[4]  Søren Lauesen,et al.  Communication gaps in a tender process , 2005, Requirements Engineering.

[5]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[6]  Travis D. Breaux,et al.  Scaling requirements extraction to the crowd: Experiments with privacy policies , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[7]  Matthias Jarke,et al.  Requirements Bazaar: Social requirements engineering for community-driven innovation , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[8]  Colin Bentley,et al.  PRINCE2: A Practical Handbook , 2009 .

[9]  Stuart Bretschneider,et al.  Management Information Systems in Public and Private Organizations: An Empirical Test. , 1990 .

[10]  Mahmood Hosseini,et al.  Towards Crowdsourcing for Requirements Engineering , 2014, REFSQ Workshops.

[11]  Norbert Seyff,et al.  A Needle in a Haystack: What Do Twitter Users Say about Software? , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[12]  Grant Williams,et al.  Mining Twitter Feeds for Software User Requirements , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[13]  Sjaak Brinkkemper,et al.  Identifying and Classifying User Requirements in Online Feedback via Crowdsourcing , 2020, REFSQ.

[14]  C Berger,et al.  KANO’S METHODS FOR UNDERSTANDING CUSTOMER-DEFINED QUALITY , 1993 .

[15]  Fabiano Dalpiaz,et al.  RE-SWOT: From User Feedback to Requirements via Competitor Analysis , 2019, REFSQ.

[16]  Raian Ali,et al.  Crowd Intelligence in Requirements Engineering: Current Status and Future Directions , 2019, REFSQ.

[17]  Walid Maalej,et al.  SAFE: A Simple Approach for Feature Extraction from App Descriptions and App Reviews , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[18]  Anna Perini,et al.  Crowdsourcing for Software Engineering The Crowd in Requirements Engineering The Landscape and Challenges , 2017 .

[19]  Kipling D. Williams,et al.  Interpersonal Relations and Group Processes Social Loafing: a Meta-analytic Review and Theoretical Integration , 2022 .

[20]  Walid Maalej,et al.  On the automatic classification of app reviews , 2016, Requirements Engineering.

[21]  Peter Sawyer,et al.  Canary: Extracting Requirements-Related Information from Online Discussions , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[22]  Sjaak Brinkkemper,et al.  User Story Writing in Crowd Requirements Engineering: The Case of a Web Application for Sports Tournament Planning , 2019, 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW).

[23]  Eduard C. Groen,et al.  Towards Crowd-Based Requirements Engineering A Research Preview , 2015, REFSQ.

[24]  A. Cropley In Praise of Convergent Thinking , 2006 .

[25]  Kelly Blincoe,et al.  Can a Conversation Paint a Picture? Mining Requirements In Software Forums , 2019, 2019 IEEE 27th International Requirements Engineering Conference (RE).

[26]  Walid Maalej,et al.  Democratic mass participation of users in Requirements Engineering? , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[27]  Sjaak Brinkkemper,et al.  REfine: A gamified platform for participatory requirements engineering , 2015, 2015 IEEE 1st International Workshop on Crowd-Based Requirements Engineering (CrowdRE).

[28]  Robert M. Davison,et al.  Principles of canonical action research , 2004, Inf. Syst. J..

[29]  Munindar P. Singh,et al.  Acquiring Creative Requirements from the Crowd: Understanding the Influences of Personality and Creative Potential in Crowd RE , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[30]  Martin Glinz CrowdRE: Achievements, Opportunities and Pitfalls , 2019, 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW).

[31]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).