Identification, classification, and quantification of three physical mechanisms in oil-in-water emulsions using AlexNet with transfer learning

Abstract Physical mechanisms of emulsion are generally observed by microscopy images and subjectively identified or judged by experimenters. However, results are not scientific or convincing due to the lack of specific qualitative or quantitative indicators. To overcome this drawback, AlexNet with transfer learning was employed to automatically identify, classify, and quantify three different physical mechanisms of emulsions. The proposed network achieved good performance with high classification accuracy, and fast training and testing time. Feature visualization of the last fully connected layer represents the common and high-level features of each mechanism, especially the feature image of coalescence, which clearly shows a large droplet is consisting of two or more merged small droplets. Moreover, information entropy calculated the disorder level in feature images of each mechanism, and strongest activations demonstrated the proposed network learns correct features. Therefore, these results contribute to a better understanding of emulsion science from the perspective of deep learning.

[1]  Fei Liu,et al.  Application of Deep Learning in Food: A Review. , 2019, Comprehensive reviews in food science and food safety.

[2]  Tao Yao,et al.  Monitoring sugar crystallization with deep neural networks , 2020, Journal of Food Engineering.

[3]  Yudong Zhang,et al.  Smart deep learning-based approach for non-destructive freshness diagnosis of common carp fish , 2020 .

[4]  G. Narsimhan,et al.  Drop Coalescence during Emulsion Formation in a High-Pressure Homogenizer for Tetradecane-in-Water Emulsion Stabilized by Sodium Dodecyl Sulfate. , 2001, Journal of colloid and interface science.

[5]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[6]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[7]  O. Matar,et al.  Impact of droplets on immiscible liquid films. , 2018, Soft matter.

[8]  T. V. Ranganathan,et al.  Emulsion and it ’ s Applications in Food Processing – A Review , 2014 .

[9]  Darsh T. Wasan,et al.  Emulsion stability — kinetics of flocculation and coalescence , 1992 .

[10]  Rafael Marcos Luque Baena,et al.  Study and classification of plum varieties using image analysis and deep learning techniques , 2018, Progress in Artificial Intelligence.

[11]  V. Jideani,et al.  Factors Affecting the Stability of Emulsions Stabilised by Biopolymers , 2018, Science and Technology Behind Nanoemulsions.

[12]  Sepand Haghighi,et al.  PyCM: Multiclass confusion matrix library in Python , 2018, J. Open Source Softw..

[13]  Robert M. Gresham,et al.  When oil and water do mix , 2008 .

[14]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[15]  Juliane Floury,et al.  Effect of high-pressure homogenization on droplet size distributions and rheological properties of model oil-in-water emulsions , 2000 .

[16]  Reinhard Klette,et al.  Detection of Red-Meat Adulteration by Deep Spectral-Spatial Features in Hyperspectral Images , 2018, J. Imaging.

[17]  Earl J. Kirkland,et al.  Advanced Computing in Electron Microscopy , 1998 .

[18]  Mahmoud Omid,et al.  An automatic sorting system for unwashed eggs using deep learning , 2020 .

[19]  Du-Yih Tsai,et al.  Information Entropy Measure for Evaluation of Image Quality , 2008, Journal of Digital Imaging.

[20]  Mauro Castelli,et al.  How Deeply to Fine-Tune a Convolutional Neural Network: A Case Study Using a Histopathology Dataset , 2020, Applied Sciences.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Monica Mordonini,et al.  Food Image Recognition Using Very Deep Convolutional Networks , 2016, MADiMa @ ACM Multimedia.

[23]  N. Nguyen,et al.  Expression of passively transferred immunity against an established tumor depends on generation of cytolytic T cells in recipient. Inhibition by suppressor T cells , 1983, The Journal of experimental medicine.

[24]  K. Sakamoto,et al.  Emulsion and Emulsification Technology , 2017 .

[25]  Zhihai Lu,et al.  Pathological brain detection based on AlexNet and transfer learning , 2019, J. Comput. Sci..

[26]  Deborah Silver,et al.  Feature Visualization , 1994, Scientific Visualization.

[27]  M. Serdaroğlu,et al.  An Overview of Food Emulsions: Description, Classification and Recent Potential Applications , 2015 .

[28]  Prashant Kumar Maurya,et al.  Thresholding Techniques applied for Segmentation of RGB and multispectral images , 2012 .

[29]  David Julian McClements,et al.  Food Emulsions: Principles, Practice, and Techniques , 1998 .

[30]  David Julian McClements,et al.  Critical Review of Techniques and Methodologies for Characterization of Emulsion Stability , 2007, Critical reviews in food science and nutrition.

[31]  S. Zendehboudi,et al.  A Comprehensive Review on Emulsions and Emulsion Stability in Chemical and Energy Industries , 2018, The Canadian Journal of Chemical Engineering.

[32]  Shuyi Mao,et al.  A Mature-Tomato Detection Algorithm Using Machine Learning and Color Analysis † , 2019, Sensors.

[33]  Kenia Picos Intuitionistic and Type-2 Fuzzy Logic Enhancements in Neural and Optimization Algorithms: Theory and Applications , 2020 .

[34]  Guoping Zeng,et al.  On the confusion matrix in credit scoring and its analytical properties , 2020, Communications in Statistics - Theory and Methods.

[35]  S. Rajaram,et al.  Big Data in Medical Image Processing , 2018 .

[36]  M. Popovic Researchers in an Entropy Wonderland: A Review of the Entropy Concept , 2017, 1711.07326.

[37]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.