REfine: A gamified platform for participatory requirements engineering

The active involvement of stakeholders in Requirements Engineering (RE) is crucial, for the system under design should fulfill their expectations. In software products, which evolve under the control of Software Product Organizations (SPOs), stakeholders' involvement is limited to SPO represen- tatives and key clients. Thus, key stakeholders are excluded, including current and prospective users. Two emerging trends can help to shift towards a more participatory RE: crowdsourc- ing eases the access to a large number of stakeholders, and gamification provides means to keep them motivated through feedback loops (that reward the useful participants). In this paper, we build on this potential and propose REfine, a gamified online platform for requirements elicitation and refinement by involving a crowd of stakeholders: users, developers, analysts, etc. We report encouraging results from a case study that show how REfine has led to useful requirements, stakeholders' engagement, and valuable interactions.

[1]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[2]  Sjaak Brinkkemper,et al.  Crowd-centric requirements engineering: A method based on crowdsourcing and gamification , 2015 .

[3]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[4]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[5]  Marjo Kauppinen,et al.  The role of user involvement in requirements quality and project success , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[6]  Alimohammad Shahri,et al.  Configuring crowdsourcing for requirements elicitation , 2015, 2015 IEEE 9th International Conference on Research Challenges in Information Science (RCIS).

[7]  Brendan T. O'Connor,et al.  Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks , 2008, EMNLP.

[8]  Anthony Finkelstein,et al.  Ieee Transactions on Software Engineering, Manuscript Id Stakerare: Using Social Networks and Collaborative Filtering for Large-scale Requirements Elicitation , 2022 .

[9]  Davor Svetinovic,et al.  CrowdREquire: A Requirements Engineering Crowdsourcing Platform , 2012, AAAI Spring Symposium: Wisdom of the Crowd.

[10]  Miguel Mira da Silva,et al.  iThink: A Game-Based Approach Towards Improving Collaboration and Participation in Requirement Elicitation , 2012, VS-GAMES.

[11]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[12]  Daniela E. Damian,et al.  StakeSource2.0: using social networks of stakeholders to identify and prioritise requirements , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[13]  Mahmood Hosseini,et al.  Towards Crowdsourcing for Requirements Engineering , 2014, REFSQ Workshops.

[14]  Miguel Mira da Silva,et al.  Gamifying requirement elicitation: Practical implications and outcomes in improving stakeholders collaboration , 2014, Entertain. Comput..

[15]  Daniel J. Veit,et al.  More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk , 2011, AMCIS.

[16]  Alimohammad Shahri,et al.  Crowd-centric Requirements Engineering , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[17]  Juho Hamari,et al.  Social Motivations To Use Gamification: An Empirical Study Of Gamifying Exercise , 2013, ECIS.

[18]  Padmini Srinivasan,et al.  Quality through flow and immersion: gamifying crowdsourced relevance assessments , 2012, SIGIR '12.

[19]  Matthias Jarke,et al.  Requirements Bazaar: Social requirements engineering for community-driven innovation , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[20]  Dale E. Zand,et al.  Theory of Change and the Effective Use of Management Science. , 1975 .

[21]  Leela Damodaran,et al.  User involvement in the systems design process-a practical guide for users , 1996, Behav. Inf. Technol..

[22]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[23]  Daren C. Brabham.  Moving the crowd at iStockphoto: The composition of the crowd and motivations for participation in a crowdsourcing application , 2008, First Monday.

[24]  Slinger Jansen,et al.  Customer Involvement in Requirements Management: Lessons from Mass Market Software Development , 2009, 2009 17th IEEE International Requirements Engineering Conference.