Authentic Individual Assessment for Team-based Software Engineering Projects

In order to give students an authentic learning experience and better prepare them for the life-long learning required in contemporary workplaces, educational institutions increasingly use project-based learning in teams. However, this poses the challenge of developing authentic and equitable assessment criteria that reflect individual contributions in a team-work setting without jeopardizing project outcomes. We present a novel and innovative portfolio-based assessment framework that focuses on qualitative outcomes and ensures that the level of achievement reflects a student's competency across each of the defined learning dimensions, including professional behaviour, teamwork, process and relevant contributions towards project deliverables. In this paper, we present the main motivation behind devising and introducing the framework and also reflect on the educational outcomes and challenges of implementing the framework in the context of two final year Software Engineering project units.

[1]  Casper Lassenius,et al.  Collaborating with Industrial Customers in a Capstone Project Course: The Customers' Perspective , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[2]  J. Biggs.  Enhancing teaching through constructive alignment , 1996 .

[3]  Feifei Chen,et al.  Adopting Industry Agile Practices in Large-scale Capstone Education , 2020, 2020 IEEE/ACM 42nd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[4]  Casper Lassenius,et al.  How Does Participating in a Capstone Project with Industrial Customers Affect Student Attitudes? , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[5]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .

[6]  Ingo Stengel,et al.  Teaching agile principles and software engineering concepts through real-life projects , 2018, 2018 IEEE Global Engineering Education Conference (EDUCON).

[7]  Rajesh Vasa,et al.  Agile practices in software development - experiences from student projects , 2006, Australian Software Engineering Conference (ASWEC'06).

[8]  Robert F. Dugan,et al.  A survey of computer science capstone course literature , 2011, Comput. Sci. Educ..

[9]  Siim Karus.  Experience Report on a Move to Techniques-Oriented Student Project Grading , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[10]  Marie Schmidt,et al.  Learning to Teach in Higher Education , 1992 .

[11]  Beth Berghoff,et al.  WHAT TEACHERS AND ADMINISTRATORS "NEED TO KNOW" ABOUT PROJECT-BASED LEARNING IMPLEMENTATION , 2010 .

[12]  M. Cecilia Bastarrica,et al.  What Can Students Get from a Software Engineering Capstone Course? , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET).

[13]  Debbie Richards,et al.  Designing Project-Based Courses with a Focus on Group Formation and Assessment , 2009, TOCE.

[14]  G. Gibbs,et al.  Conditions Under Which Assessment Supports Students’ Learning , 2005 .

[15]  Hakan Erdogmus,et al.  Are Computer Science and Engineering Graduates Ready for the Software Industry? Experiences from an Industrial Student Training Program , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[16]  Heidi Ellis.  Software engineering: effective teaching and learning approaches and practices , 2007, SOEN.

[17]  D. Boud,et al.  Sustainable assessment revisited , 2016 .

[18]  S. Freud.  In Over Our Heads. The Mental Demands of Modern Life , 1997 .

[19]  Andraž Cej,et al.  Agile software development with Scrum , 2010 .

[20]  E. Sonny Butler,et al.  Knowledge and Skill Requirements for it Graduates , 2009, J. Comput. Inf. Syst..

[21]  John W. Thomas,et al.  A REVIEW OF RESEARCH ON PROJECT-BASED LEARNING , 2000 .

[22]  Anders Jonsson,et al.  Facilitating productive use of feedback in higher education , 2013 .

[23]  Matthew W. Easterday,et al.  Opportunities for educational innovations in authentic project-based learning: understanding instructor perceived challenges to design for adoption , 2019, Educational Technology Research and Development.

[24]  Joanna C. Dunlap.  Problem-based learning and self-efficacy: How a capstone course prepares students for a profession , 2005 .

[25]  Axel Schmolitzky,et al.  Transferring Experience from Software Engineering Training in Industry to Mass University Education - The Big Picture , 2005, 18th Conference on Software Engineering Education & Training (CSEET'05).

[26]  Guillermo Rodríguez,et al.  Measuring the Impact of Agile Coaching on Students’ Performance , 2016, IEEE Transactions on Education.

[27]  Andrew Cain,et al.  Focusing on learning through constructive alignment with task-oriented portfolio assessment , 2018 .

[28]  Michael J. Prince,et al.  Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases , 2006 .

[29]  Margaret C. Lohman.  Factors influencing teachers' engagement in informal learning activities , 2006 .

[30]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[31]  Arnold Pears,et al.  Why are We Here? The Educational Value Model (EVM) as a Framework to Investigate the Role of Students’ Professional Identity Development , 2018, 2018 IEEE Frontiers in Education Conference (FIE).

[32]  Jocelyn Armarego,et al.  Constructive alignment in SE education: aligning to what? , 2009 .

[33]  Bernd Brügge,et al.  Software Engineering Project Courses with Industrial Clients , 2015, TOCE.

[34]  Richard W. Morshead.  Taxonomy of Educational Objectives Handbook II: Affective Domain , 1965 .

[35]  D. Boud,et al.  Learning from others at work: communities of practice and informal learning , 2003 .

[36]  Lorraine Johnston,et al.  eXtreme programming at universities - an educational perspective , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[37]  Andrew Cain,et al.  User Perceptions of Using an Open Learner Model Visualisation Tool for Facilitating Self-regulated Learning , 2017, ACE '17.

[38]  Jil Klünder,et al.  Walking Through the Method Zoo: Does Higher Education Really Meet Software Industry Demands? , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[39]  Mohammad. Rasul,et al.  Getting it right: the case for supervisors assessing process in capstone projects , 2015 .

[40]  Denny Davis,et al.  Capstone Design Courses and Assessment: A National Study , 2004 .

[41]  T. Germain,et al.  Process activities in a project based course in software engineering , 2002, 32nd Annual Frontiers in Education.

[42]  Andrew Cain,et al.  Reflections on Applying Constructive Alignment with Formative Feedback for Teaching Introductory Programming and Software Architecture , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).