Efficient Integer Vector Homomorphic Encryption Using Deep Learning for Neural Networks

Machine learning techniques based on neural networks have achieved significant applications in a wide variety of areas. There is a great risk on disclosing users’ privacy when we train a high-performance model with a large number of datasets collected from users without any protection. To protect user privacy, we propose an Efficient Integer Vector Homomorphic Encryption (EIVHE) scheme using deep learning for neural networks. We use EIVHE to encrypt users’ datasets, then feed the encrypted datasets into a neural network model, and finally obtain the trained model for neural networks. EIVHE is an innovative bridge between cryptography and deep learning, which aims at protecting users’ privacy. The experiments demonstrate that the deep neural networks can be trained by encrypted datasets without privacy leakage, and achieve an accuracy of 89.05% on MNIST. Moreover, this scheme allows us to conduct computation in an efficient and secure way.

[1]  Shiho Moriai,et al.  Privacy-Preserving Deep Learning via Additively Homomorphic Encryption , 2018, IEEE Transactions on Information Forensics and Security.

[2]  Yongxin Yang,et al.  Frankenstein: Learning Deep Face Representations Using Small Data , 2016, IEEE Transactions on Image Processing.

[3]  Meng Wang,et al.  Zero-Shot Learning via Attribute Regression and Class Prototype Rectification , 2018, IEEE Transactions on Image Processing.

[4]  Michael Naehrig,et al.  Improved Security for a Ring-Based Fully Homomorphic Encryption Scheme , 2013, IMACC.

[5]  Frederik Vercauteren,et al.  Somewhat Practical Fully Homomorphic Encryption , 2012, IACR Cryptol. ePrint Arch..

[6]  Adi Shamir,et al.  A method for obtaining digital signatures and public-key cryptosystems , 1978, CACM.

[7]  Vinod Vaikuntanathan,et al.  Efficient Fully Homomorphic Encryption from (Standard) LWE , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[8]  Gregory W. Wornell,et al.  Efficient homomorphic encryption on integer vectors and its applications , 2014, 2014 Information Theory and Applications Workshop (ITA).

[9]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[10]  Craig Gentry,et al.  Fully homomorphic encryption using ideal lattices , 2009, STOC '09.

[11]  Craig Gentry,et al.  (Leveled) fully homomorphic encryption without bootstrapping , 2012, ITCS '12.

[12]  Boris Murmann,et al.  Approximate SRAM for Energy-Efficient, Privacy-Preserving Convolutional Neural Networks , 2017, 2017 IEEE Computer Society Annual Symposium on VLSI (ISVLSI).

[13]  Craig Gentry,et al.  Packed Ciphertexts in LWE-Based Homomorphic Encryption , 2013, Public Key Cryptography.

[14]  Ian Goodfellow,et al.  Deep Learning with Differential Privacy , 2016, CCS.

[15]  Dan Boneh,et al.  Evaluating 2-DNF Formulas on Ciphertexts , 2005, TCC.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.