What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection
暂无分享,去创建一个
[1] Jian Sun,et al. Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).
[2] Anthony Ventresque,et al. Demo: PIT a Practical Mutation Testing Tool for Java , 2016 .
[3] Annibale Panichella,et al. Oracle Issues in Machine Learning and Where to Find Them , 2020, ICSE.
[4] Demis Hassabis,et al. Mastering the game of Go without human knowledge , 2017, Nature.
[5] Mark Harman,et al. Machine Learning Testing: Survey, Landscapes and Horizons , 2019, IEEE Transactions on Software Engineering.
[6] Lei Ma,et al. DeepMutation: Mutation Testing of Deep Learning Systems , 2018, 2018 IEEE 29th International Symposium on Software Reliability Engineering (ISSRE).
[7] Mark Harman,et al. An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.
[8] Andy Zaidman,et al. A systematic literature review of how mutation testing supports quality assurance processes , 2018, Softw. Test. Verification Reliab..
[9] Foutse Khomh,et al. On Testing Machine Learning Programs , 2018, J. Syst. Softw..
[10] Luca Bertinetto,et al. Making Better Mistakes: Leveraging Class Hierarchies With Deep Networks , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
[11] Michael D. Ernst,et al. Are mutants a valid substitute for real faults in software testing? , 2014, SIGSOFT FSE.
[12] Jun Wan,et al. MuNN: Mutation Analysis of Neural Networks , 2018, 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C).
[13] Gabriele Bavota,et al. Taxonomy of Real Faults in Deep Learning Systems , 2019, 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE).
[14] Bob L. Sturm. A Simple Method to Determine if a Music Information Retrieval System is a “Horse” , 2014, IEEE Transactions on Multimedia.
[15] Yves Le Traon,et al. Chapter Six - Mutation Testing Advances: An Analysis and Survey , 2019, Adv. Comput..
[16] Richard J. Lipton,et al. Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.
[17] Paolo Tonella,et al. An Empirical Evaluation of Mutation Operators for Deep Learning Systems , 2020, 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST).
[18] Baowen Xu,et al. Testing and validating machine learning classifiers by metamorphic testing , 2011, J. Syst. Softw..
[19] Franz Wotawa,et al. Investigating the Effectiveness of Mutation Testing Tools in the Context of Deep Neural Networks , 2019, IWANN.
[20] Jason Yosinski,et al. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[21] Lei Ma,et al. DeepMutation++: A Mutation Testing Framework for Deep Learning Systems , 2019, 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE).
[22] A. Jefferson Offutt,et al. Investigations of the software testing coupling effect , 1992, TSEM.
[23] Shin Yoo,et al. Are Mutation Scores Correlated with Real Fault Detection? A Large Scale Empirical Study on the Relationship Between Mutants and Real Faults , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).
[24] Lionel C. Briand,et al. Is mutation an appropriate tool for testing experiments? , 2005, ICSE.