A survey on graduates’ curriculum-based knowledge gaps in software testing

This research full paper presents a study on graduates’ knowledge gaps in software testing according to industry needs. Several studies indicate that students graduate from computing programs with a knowledge gap in software testing. In this sense, we aimed to investigate in details this broader testing gap, by considering gaps in the level of testing topics. We conducted a survey with Brazilian practitioners in order to collect data (N=90). For each testing topic, knowledge gaps were calculated as the difference between what respondents’ learned/practiced in undergraduate courses and what they actually applied in industry after graduating. Results provide evidence on points that could be improved in software testing education. Firstly, for all testing topics there was a negative gap on practice activities. This means that students could benefit from more testing assignments throughout the curriculum. Regarding gaps in concepts, some testing topics presented negative gaps (such as test in web applications) and others positive (such as test in aspect oriented software and mutation analysis). Therefore, results suggest that it is possible to counterbalance them in order to reduce the existing gaps. We also present respondents’ opinions about their experience in software testing education and industry practices.

[1]  Tsong Yueh Chen,et al.  A preliminary survey on software testing practices in Australia , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[2]  Jeffrey C. Carver,et al.  Evaluating the testing ability of senior-level computer science students , 2011, 2011 24th IEEE-CS Conference on Software Engineering Education and Training (CSEE&T).

[3]  Alex Radermacher,et al.  Gaps between industry expectations and the abilities of graduates , 2013, SIGCSE '13.

[4]  J.C. Maldonado,et al.  Integrated teaching of programming foundations and software testing , 2008, 2008 38th Annual Frontiers in Education Conference.

[5]  Per Runeson,et al.  A survey of unit testing practices , 2006, IEEE Software.

[6]  Ana María Moreno,et al.  Balancing software engineering education and industrial needs , 2012, J. Syst. Softw..

[7]  Timothy Lethbridge,et al.  What knowledge is important to a software professional? , 2000, Computer.

[8]  Jacqueline L. Whalley,et al.  A unit testing approach to building novice programmers' skills and confidence , 2011, ACE 2011.

[9]  Per Runeson,et al.  A Qualitative Survey of Regression Testing Practices , 2010, PROFES.

[10]  Shari Lawrence Pfleeger,et al.  Personal Opinion Surveys , 2008, Guide to Advanced Empirical Software Engineering.

[11]  Jorge L. Díaz-Herrera,et al.  Improving software practice through education: Challenges and future trends , 2007, Future of Software Engineering (FOSE '07).

[12]  Pearl Brereton,et al.  An investigation of software engineering curricula , 2005, J. Syst. Softw..

[13]  Vahid Garousi,et al.  A survey of software testing practices in Canada , 2013, J. Syst. Softw..