Automated Differential Testing for Energy-Efficient Control Software

Cyber-physical systems (CPS) are integrated systems of computerbased algorithms and physical components interacting with en­ vironmental effects. In such systems, autonomous behaviors and overall performance mainly depend on a control software. Thus, it is crucial to test and analyze the control software of the CPS in various perspectives. One of the critical perspectives is energy efficiency because many cyber-physical systems (e.g. unmanned aerial vehicles, autonomous cars, health-care devices) operate with limited energy sources such as batteries. In this paper, we pro­ pose CPSDiff: an energy-aware differential testing framework that generates test inputs to expose the maximal difference between two control programs in energy consumption. Our test generation technique uses meta-heuristic searching to find the input that max­ imizes the energy consumption difference. The difference-revealing ability of our technique outperforms the random search algorithm and hill-climbing search algorithm. Our evaluation on two popu­ lar unmanned aerial vehicle control programs provides a detailed comparison of their energy consumption under the same condition with a universal robotics simulator; CPSDiff found the input which exposes maximum battery consumption difference of around 47%.

[1]  Boris Beizer,et al.  Black Box Testing: Techniques for Functional Testing of Software and Systems , 1996, IEEE Software.

[2]  W. M. McKeeman,et al.  Differential Testing for Software , 1998, Digit. Tech. J..

[3]  Helmut Veith,et al.  Progress on the State Explosion Problem in Model Checking , 2001, Informatics.

[4]  Yun Li,et al.  PID control system analysis, design, and technology , 2005, IEEE Transactions on Control Systems Technology.

[5]  Rance Cleaveland,et al.  An Instrumentation-Based Approach to Controller Model Validation , 2006, ASWSD.

[6]  Andreas Windisch,et al.  Search-based testing of complex simulink models containing stateflow diagrams , 2009, 2009 31st International Conference on Software Engineering - Companion Volume.

[7]  S. Ramesh,et al.  Randomized directed testing (REDIRECT) for Simulink/Stateflow models , 2008, EMSOFT '08.

[8]  Somanath Majhi,et al.  A New Objective Function for Controller Tuning , 2008 .

[9]  Jin Ma,et al.  Research on PID parameters optimization of synchronous generator excitation control system , 2010, 2010 5th International Conference on Critical Infrastructure (CRIS).

[10]  Tsong Yueh Chen,et al.  Adaptive Random Testing: The ART of test case diversity , 2010, J. Syst. Softw..

[11]  M. Harman,et al.  Testing Web Services : A Survey , 2011 .

[12]  Lubos Brim,et al.  Executing Model Checking Counterexamples in Simulink , 2012, 2012 Sixth International Symposium on Theoretical Aspects of Software Engineering.

[13]  Olympia Roeva,et al.  PID Controller Tuning based on Metaheuristic Algorithms for Bioprocess Control , 2012 .

[14]  Hasan Sözer,et al.  A Survey of Software Testing in the Cloud , 2012, 2012 IEEE Sixth International Conference on Software Security and Reliability Companion.

[15]  Hojung Cha,et al.  AppScope: Application Energy Metering Framework for Android Smartphone Using Kernel Activity Monitoring , 2012, USENIX Annual Technical Conference.

[16]  Leandro Buss Becker,et al.  Energy Profile Evaluation of a Cyber-Physical System , 2012, 2012 Brazilian Symposium on Computing System Engineering.

[17]  Leandro Buss Becker,et al.  Remaining Battery Lifetime Determination in Cyber-Physical Systems , 2012, ANT/MobiWIS.

[18]  Samarjit Chakraborty,et al.  Battery- and Aging-Aware Embedded Control Systems for Electric Vehicles , 2014, 2014 IEEE Real-Time Systems Symposium.

[19]  Romain Rouvoy,et al.  Unit testing of energy consumption of software libraries , 2014, SAC.

[20]  Ranveer Chandra,et al.  On the energy overhead of mobile storage systems , 2014, FAST.

[21]  S. Ramesh,et al.  Automatic test case generation from Simulink/Stateflow models using model checking , 2014, Softw. Test. Verification Reliab..

[22]  Shuo Wang,et al.  PID Parameter Optimization Based on Fuzzy Control , 2014 .

[23]  Mark Harman,et al.  The Oracle Problem in Software Testing: A Survey , 2015, IEEE Transactions on Software Engineering.

[24]  Sergiy Vilkomir,et al.  Testing-as-a-Service for Mobile Applications: State-of-the-Art Survey , 2015 .

[25]  Ranveer Chandra,et al.  WearDrive: Fast and Energy-Efficient Storage for Wearables , 2015, USENIX Annual Technical Conference.

[26]  C. Martin 2015 , 2015, Les 25 ans de l’OMC: Une rétrospective en photos.

[27]  Alireza Sadeghi,et al.  Energy-aware test-suite minimization for Android apps , 2016, ISSTA.

[28]  Lionel C. Briand,et al.  Automated Test Suite Generation for Time-Continuous Simulink Models , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[29]  智治 横大路 2015 , 2015, Light Power: Half a Century of Solar Electricity Research.

[30]  姜寅求 1970 , 1970, Literatur in der SBZ/DDR.