Inferring Automatic Test Oracles

We propose the use of search based learning from existing open source test suitesto automatically generate partially correct test oracles. We argue that mutation testing and n-version computing(augmented by deep learningand other soft computingtechniques), will be able to predict whether a program's output is correct sufficiently accurately to be useful.

[1]  Mark Harman,et al.  The Oracle Problem in Software Testing: A Survey , 2015, IEEE Transactions on Software Engineering.

[2]  Alexander L. Wolf,et al.  Multiplicity computing: a vision of software engineering for next-generation computing platform applications , 2010, FoSER '10.

[3]  Mark Harman,et al.  Multi Objective Higher Order Mutation Testing with Genetic Programming , 2009 .

[4]  Peter G. Bishop,et al.  PODS — A project on diverse software , 1986, IEEE Transactions on Software Engineering.

[5]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[6]  Westley Weimer,et al.  A human study of patch maintainability , 2012, ISSTA 2012.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  John A. Clark,et al.  The GISMOE challenge: constructing the pareto program surface using genetic programming to find better programs (keynote paper) , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[9]  Sushil Krishna Bajracharya,et al.  Mining search topics from a code search engine usage log , 2009, 2009 6th IEEE International Working Conference on Mining Software Repositories.

[10]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[11]  Westley Weimer,et al.  Advances in Automated Program Repair and a Call to Arms , 2013, SSBSE.

[12]  William B. Langdon,et al.  Genetically Improved Software , 2015, Handbook of Genetic Programming Applications.

[13]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[14]  Mark Harman,et al.  Ieee Transactions on Evolutionary Computation 1 , 2022 .

[15]  Kajal T. Claypool,et al.  XSnippet: mining For sample code , 2006, OOPSLA '06.

[16]  Cheng Zhang,et al.  Automated Test Oracles: A Survey , 2015, Adv. Comput..

[17]  Mark Harman,et al.  Search-based software engineering , 2001, Inf. Softw. Technol..

[18]  Paulo Augusto Nardi,et al.  A Survey on Test Oracles , 2015 .