Combinatorial Testing for an Automotive Hybrid Electric Vehicle Control System: A Case Study

Embedded electrical systems for passenger vehicles are highly complex distributed systems with varying system boundaries. The surge towards further electrification of vehicles demands the deployment of high voltage systems that provide propulsion through an electric motor as part of a hybrid electric or pure electric drive train. This demands additional care and robust deployment to ensure the safety of the end user and the environment around them. Exhaustive testing is not feasible for large systems and the use of formal approaches can be restrictive. In the presented work a combinatorial test approach is applied to a real Hybrid Electric Vehicle control system as part of a hardware-in-the-loop test system. 2-way, 3-way and mixed strength up to 4-way testing is carried out. The concept of CAN main and local is devised to intercept CAN messages and replace them with the generated combinatorial tests using the HIL simulator's own processor to assure real-time testing. Early results indicate that the approach is effective in exposing incidents in system behavior not normally found during traditional functional testing.

[1]  Hareton K. N. Leung,et al.  A survey of combinatorial testing , 2011, CSUR.

[2]  Jeff Yu Lei,et al.  Practical Combinatorial Testing: Beyond Pairwise , 2008, IT Professional.

[3]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[4]  Oliver Bühler,et al.  Evolutionary functional testing , 2008, Comput. Oper. Res..

[5]  James Marco,et al.  Robustness Testing of Real-Time Automotive Systems Using Sequence Covering Arrays , 2013 .

[6]  Myra B. Cohen,et al.  A variable strength interaction testing of components , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[7]  Myra B. Cohen,et al.  Towards incremental adaptive covering arrays , 2007, ESEC-FSE '07.

[8]  Tim A. Majchrzak,et al.  Improving Software Testing , 2012 .

[9]  Andreas Krämer,et al.  Model-Based Testing of Automotive Systems , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[10]  Myra B. Cohen,et al.  Interaction testing of highly-configurable systems in the presence of constraints , 2007, ISSTA '07.

[11]  Manfred Broy,et al.  Engineering Automotive Software , 2007, Proceedings of the IEEE.

[12]  D. Richard Kuhn,et al.  FAILURE MODES IN MEDICAL DEVICE SOFTWARE: AN ANALYSIS OF 15 YEARS OF RECALL DATA , 2001 .

[13]  Tim A. Majchrzak Improving Software Testing: Technical and Organizational Developments , 2012 .

[14]  Jeff Yu Lei,et al.  Combinatorial Methods for Event Sequence Testing , 2012, 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation.

[15]  Jeff Yu Lei,et al.  Combinatorial Software Testing , 2009, Computer.

[16]  Dominique Paret Multiplexed Networks for Embedded Systems: CAN, LIN, FlexRay, Safe-by-Wire , 2014 .

[17]  Mirko Conrad,et al.  A Systematic Approach to Testing Automotive Control Software , 2004 .

[18]  D. Richard Kuhn,et al.  Evaluation of Fault Detection Effectiveness for Combinatorial and Exhaustive Selection of Discretized Test Inputs , 2012 .

[19]  R. L. Erickson,et al.  Improved quality of protocol testing through techniques of experimental design , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.