A Comparison of Multi-task learning and Single-task learning Approaches

. In this paper, we provide experimental evidence for the benefits of multi-task learning in the context of masked AES implementations (via the ASCADv1-r and ASCADv2 databases). We develop an approach for comparing single-task and multi-task approaches rather than comparing specific resulting models: we do this by training many models with random hyperparameters (instead of comparing a few highly tuned models). We find that multi-task learning has significant practical advantages that make it an attractive option in the context of device evaluations: the multi-task approach leads to performant networks quickly in particular in situations where knowledge of internal randomness is not available during training.

[1]  François-Xavier Standaert,et al.  Don't Learn What You Already Know Scheme-Aware Modeling for Profiling Side-Channel Analysis against Masking , 2022, IACR Trans. Cryptogr. Hardw. Embed. Syst..

[2]  Stjepan Picek,et al.  Exploring Feature Selection Scenarios for Deep Learning-based Side-Channel Analysis , 2022, IACR Cryptol. ePrint Arch..

[3]  Annelie Heuser,et al.  The Curse of Class Imbalance and Conflicting Metrics with Machine Learning for Side-channel Evaluations , 2018, IACR Cryptol. ePrint Arch..

[4]  Zhe Zhao,et al.  Modeling Task Relationships in Multi-task Learning with Multi-gate Mixture-of-Experts , 2018, KDD.

[5]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[6]  Emmanuel Prouff,et al.  Affine Masking against Higher-Order Side Channel Analysis , 2010, IACR Cryptol. ePrint Arch..

[7]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[8]  E. Oswald,et al.  Exploring multi-task learning in the context of two masked AES implementations , 2023, IACR Cryptology ePrint Archive.

[9]  Rémi Strullu,et al.  Side Channel Analysis against the ANSSI's protected AES implementation on ARM , 2021, IACR Cryptol. ePrint Arch..

[10]  Houssem Maghrebi,et al.  Deep Learning based Side-Channel Attack: a New Profiling Methodology based on Multi-Label Classification , 2020, IACR Cryptol. ePrint Arch..

[11]  Xinbo Gao,et al.  Exploiting Related and Unrelated Tasks for Hierarchical Metric Learning and Image Classification , 2020, IEEE Transactions on Image Processing.

[12]  Cécile Canovas,et al.  Study of Deep Learning Techniques for Side-Channel Analysis and Introduction to ASCAD Database , 2018, IACR Cryptol. ePrint Arch..

[13]  Emmanuel Prouff,et al.  Convolutional Neural Networks with Data Augmentation Against Jitter-Based Countermeasures - Profiling Attacks Without Pre-processing , 2017, CHES.

[14]  Massimiliano Pontil,et al.  Exploiting Unrelated Tasks in Multi-Task Learning , 2012, AISTATS.