Aligning software engineering education with industrial needs: A meta-analysis

Abstract Context According to various reports, many software engineering (SE) graduates often face difficulties when beginning their careers, which is mainly due to misalignment of the skills learned in university education with what is needed in the software industry. Objective Our objective is to perform a meta-analysis to aggregate the results of the studies published in this area to provide a consolidated view on how to align SE education with industry needs, to identify the most important skills and also existing knowledge gaps. Method To synthesize the body of knowledge, we performed a systematic literature review (SLR), in which we systematically selected a pool of 35 studies and then conducted a meta-analysis using data extracted from those studies. Results Via a meta-analysis and using data from 13 countries and over 4,000 data points, highlights of the SLR include: (1) software requirements, design, and testing are the most important skills; and (2) the greatest knowledge gaps are in configuration management, SE models and methods, SE process, design (and architecture), as well as in testing. Conclusion This paper provides implications for both educators and hiring managers by listing the most important SE skills and the knowledge gaps in the industry.

[1]  John Impagliazzo,et al.  ACM/IEEE-CS Information Technology Curriculum 2017: A Status Update , 2015, SIGITE.

[2]  Hakan Erdogmus,et al.  Are Computer Science and Engineering Graduates Ready for the Software Industry? Experiences from an Industrial Student Training Program , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET).

[3]  Ricardo Colomo Palacios,et al.  A Systematic Mapping Study on Software Process Education , 2015, SPETP@SPICE.

[4]  Daniela Cruzes,et al.  How is Security Testing Done in Agile Teams? A Cross-Case Analysis of Four Software Teams , 2017, XP.

[5]  Mark E. McMurtrey,et al.  Critical Skill Sets of Entry-Level IT Professionals: An Empirical Examination of Perceptions from Field Personnel , 2008, J. Inf. Technol. Educ..

[6]  Ruth Breu,et al.  Model‐based security testing: a taxonomy and systematic classification , 2016, Softw. Test. Verification Reliab..

[7]  Ali Idri,et al.  Requirements engineering education: a systematic mapping study , 2013, Requirements Engineering.

[8]  Vahid Garousi,et al.  Cost, benefits and quality of software development documentation: A systematic mapping , 2015, J. Syst. Softw..

[9]  Vahid Garousi,et al.  Web application testing: A systematic literature review , 2014, J. Syst. Softw..

[10]  Claes Wohlin,et al.  Guidelines for snowballing in systematic literature studies and a replication in software engineering , 2014, EASE '14.

[11]  Francisco J. García-Peñalvo,et al.  Competence gaps in software personnel: A multi-organizational study , 2013, Comput. Hum. Behav..

[12]  Daniela Cruzes,et al.  Synthesizing evidence in software engineering research , 2010, ESEM '10.

[13]  Paul Luo Li,et al.  What Makes a Great Software Engineer? , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[14]  Vahid Garousi,et al.  When and what to automate in software testing? A multi-vocal literature review , 2016, Inf. Softw. Technol..

[15]  T.C. Lethbridge,et al.  Guide to the Software Engineering Body of Knowledge (SWEBOK) and the Software Engineering Education Knowledge (SEEK) - a preliminary mapping , 2001, 10th International Workshop on Software Technology and Engineering Practice.

[16]  Pearl Brereton,et al.  An investigation of software engineering curricula , 2005, J. Syst. Softw..

[17]  Yongbeom Kim,et al.  An Update on the IS/IT Skills Gap , 2006, J. Inf. Syst. Educ..

[18]  Dwayne Van Eerd,et al.  Searching for grey literature for systematic reviews: challenges and benefits , 2014, Research synthesis methods.

[19]  Barry Boehm,et al.  A view of 20th and 21st century software engineering , 2006, ICSE.

[20]  Norman E. Gibbs,et al.  A Master of software engineering curriculum: recommendations from the Software Engineering Institute , 1989, Computer.

[21]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[22]  Susan R. Williams,et al.  Knowledge and Skill Requirements for Entry-Level Information Technology Workers: Do Employers in the IT Industry View These Differently than Employers in Other Industries? , 2009 .

[23]  Vahid Garousi,et al.  Citations, research topics and active countries in software engineering: A bibliometrics study , 2016, Comput. Sci. Rev..

[24]  Kelly Blincoe,et al.  Attitudes towards software engineering education in the New Zealand industry , 2017 .

[25]  Saad Zafar,et al.  A Systematic Mapping Study on Software Engineering Education , 2012 .

[26]  Vahid Garousi,et al.  Testing embedded software: A survey of the literature , 2018, Inf. Softw. Technol..

[27]  Phil Edwards,et al.  Survey Errors and Survey Costs , 1991 .

[28]  Edmundo Tovar Caro,et al.  Identifying Technical Competences of IT Professionals: The Case of Software Engineers , 2010, Int. J. Hum. Cap. Inf. Technol. Prof..

[29]  Jordan Shropshire,et al.  IT Program Curriculum Recommendations Based on a Survey of Knowledge and Skill Requirements for Entry-Level IT Workers , 2011 .

[30]  Vahid Garousi,et al.  Current State of the Software Testing Education in North American Academia and Some Recommendations for the New Educators , 2010, 2010 23rd IEEE Conference on Software Engineering Education and Training.

[31]  T. Greenhalgh,et al.  Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources , 2005, BMJ : British Medical Journal.

[32]  Rogério F. da Silva,et al.  The Challenge of Evaluating Virtual Communities of Practice: A Systematic Mapping Study , 2020, Interdisciplinary Journal of Information, Knowledge, and Management.

[33]  A Straw,et al.  Guide to the Software Engineering Body of Knowledge , 1998 .

[34]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[35]  S. Leatherdale,et al.  Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada , 2015, Systematic Reviews.

[36]  Vahid Garousi,et al.  Industry–academia collaborations in software testing: experience and success stories from Canada and Turkey , 2016, Software Quality Journal.

[37]  Timothy Lethbridge,et al.  Priorities for the education and training of software engineers , 2000, J. Syst. Softw..

[38]  M. Delgado-Rodríguez,et al.  Systematic review and meta-analysis. , 2017, Medicina intensiva.

[39]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[40]  Vahid Garousi,et al.  Challenges and best practices in industry-academia collaborations in software engineering: A systematic literature review , 2016, Inf. Softw. Technol..

[41]  Claes Wohlin,et al.  Achieving industrial relevance in software engineering education , 1999, Proceedings 12th Conference on Software Engineering Education and Training (Cat. No.PR00131).

[42]  Ioana Chan Mow,et al.  An Evaluation of Relevance of Computing curricula to Industry Needs , 2015 .

[43]  Michael Felderer,et al.  A systematic classification of security regression testing approaches , 2015, International Journal on Software Tools for Technology Transfer.

[44]  Sergio F. Ochoa,et al.  A systematic mapping study on practical approaches to teaching software engineering , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[45]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[46]  A. Huberman,et al.  Qualitative Data Analysis: A Methods Sourcebook , 1994 .

[47]  Vahid Garousi Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned , 2010, IEEE Transactions on Education.

[48]  Marlene Scardamalia,et al.  Education for the Knowledge Age: Design-Centered Models of Teaching and Instruction , 2006 .

[49]  Vahid Garousi A bibliometric analysis of the Turkish software engineering research community , 2015, Scientometrics.

[50]  Soheil Khajenoori,et al.  Collaborations: Closing the Industry-Academia Gap , 1997, IEEE Softw..

[51]  Andrew Begel,et al.  Struggles of new college graduates in their first software development job , 2008, SIGCSE '08.

[52]  Stuart R. Faulk Achieving industrial relevance with academic excellence: lessons from the Oregon master of software engineering , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[53]  Vahid Garousi Incorporating real-world industrial testing projects in software testing courses: Opportunities, challenges, and lessons learned , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[54]  Samer Hanna,et al.  Reducing the Gap between Software Engineering Curricula and Software Industry in Jordan , 2014 .

[55]  Jean Adams,et al.  Searching and synthesising ‘grey literature’ and ‘grey information’ in public health: critical reflections on three case studies , 2016, Systematic Reviews.

[56]  Mark J. Sebern,et al.  SE 2014: Curriculum Guidelines for Undergraduate Degree Programs in Software Engineering , 2015, Computer.

[57]  Lionel Briand,et al.  Embracing the Engineering Side of Software Engineering , 2012, IEEE Softw..

[58]  Ryan T. Wright,et al.  IS 2010: Curriculum Guidelines for Undergraduate Degree Programs in Information Systems , 2010, Commun. Assoc. Inf. Syst..

[59]  Alex David Radermacher,et al.  Evaluating the gap between the skills and abilities of senior undergraduate computer science students and the expectations of industry , 2012 .

[60]  Vahid Garousi,et al.  Software test maturity assessment and test process improvement: A multivocal literature review , 2017, Inf. Softw. Technol..

[61]  Vahid Garousi An Open Modern Software Testing Laboratory Courseware – An Experience Report , 2010, 2010 23rd IEEE Conference on Software Engineering Education and Training.

[62]  Richard Norman,et al.  Industry expectations of soft skills in IT graduates: a regional survey , 2016, ACSW.

[63]  Jocelyn Armarego,et al.  Requirements Engineering: a close look at industry needs and a model curricula , 2005, Australas. J. Inf. Syst..

[64]  Magda Huisman,et al.  Software: University Courses versus Workplace Practice , 2015 .

[65]  David Lorge Parnas,et al.  Software Engineering Programs Are Not Computer Science Programs , 1999, IEEE Softw..

[66]  Ruth Breu,et al.  Software paradigms, assessment types and non-functional requirements in model-based integration testing: a systematic literature review , 2014, EASE '14.

[67]  H. Jeff Smith,et al.  Aligning undergraduate IS curricula with industry needs , 2010, CACM.

[68]  Amit X Garg,et al.  Systematic review and meta-analysis: when one study is just not enough. , 2008, Clinical journal of the American Society of Nephrology : CJASN.

[69]  Vahid Garousi,et al.  Software test-code engineering: A systematic mapping , 2015, Inf. Softw. Technol..

[70]  Alex Radermacher,et al.  Gaps between industry expectations and the abilities of graduates , 2013, SIGCSE '13.

[71]  James Miller,et al.  Applying meta-analytical procedures to software engineering experiments , 2000, J. Syst. Softw..

[72]  R. L. Katz Skills of an Effective Administrator , 2009 .

[73]  Eric R. Ziegel,et al.  Survey Errors and Survey Costs , 1990 .

[74]  Blaženka Divjak,et al.  Preparing ICT Graduates for Real-World Challenges: Results of a Meta-Analysis , 2017, IEEE Transactions on Education.

[75]  Svetlana Peltsverger,et al.  ACM/IEEE-CS Information Technology Curriculum 2017: A Status Update , 2016, SIGITE.

[76]  Neal R Haddaway,et al.  The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching , 2015, PloS one.