Hybrid machine learning assisted modelling framework for particle processes

Abstract Particle processes are used broadly in industry and are frequently used for removal of insolubles, product isolation, purification and polishing. These processes are challenging to control due to their complex dynamics and physical-chemical properties. With the developments in particle monitoring tools make it possible to gain real-time insights into some of these process dynamics. In this work, a systematic modelling framework is proposed for particle processes based on a hybrid modelling concept, which integrates first-principles with machine-learning approaches. Here, we utilize on-line/at-line sensor data to train a machine learning based soft-sensor that predicts particle phenomena kinetics by combining it with a mechanistic population balance model. This approach allows flexibility towards use of process sensors and the model predictions do not violate physical constraints. Application of the framework is demonstrated through a laboratory-scale lactose crystallization, a laboratory-scale flocculation, and an industrial-scale pharmaceutical crystallization, using only limited prior process knowledge.

[1]  Cordelia Schmid,et al.  End-to-End Incremental Learning , 2018, ECCV.

[2]  Luis A. Ricardez-Sandoval,et al.  New frontiers, challenges, and opportunities in integration of design and control for enterprise-wide sustainability , 2020, Comput. Chem. Eng..

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Sarjinder Singh Simple Random Sampling , 2003 .

[5]  SiskindJeffrey Mark,et al.  Automatic differentiation in machine learning , 2017 .

[6]  A. Klamt Conductor-like Screening Model for Real Solvents: A New Approach to the Quantitative Calculation of Solvation Phenomena , 1995 .

[7]  V. Venkatasubramanian The promise of artificial intelligence in chemical engineering: Is it here, finally? , 2018, AIChE Journal.

[8]  Luis A. Ricardez-Sandoval,et al.  Optimization and control of a thin film growth process: A hybrid first principles/artificial neural network based multiscale modelling approach , 2018, Comput. Chem. Eng..

[9]  Y. Meng,et al.  Hybrid modeling based on mechanistic and data-driven approaches for cane sugar crystallization , 2019, Journal of Food Engineering.

[10]  Venkat Venkatasubramanian,et al.  Design of Fuel Additives Using Neural Networks and Evolutionary Algorithms , 2001 .

[11]  Bernhard Sendhoff,et al.  Structure optimization of neural networks for evolutionary design optimization , 2005, Soft Comput..

[12]  Rimvydas Simutis,et al.  Hybrid process models for process optimisation, monitoring and control , 2004, Bioprocess and biosystems engineering.

[13]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[14]  Krist V. Gernaey,et al.  Novel strategies for predictive particle monitoring and control using advanced image analysis , 2019, Computer Aided Chemical Engineering.

[15]  L. Shampine,et al.  Some practical Runge-Kutta formulas , 1986 .

[16]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[17]  Jarka Glassey,et al.  Hybrid Modeling in Process Industries , 2018 .

[18]  Geoffrey Zweig,et al.  Recent advances in deep learning for speech research at Microsoft , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  D. Wilkinson,et al.  Crystal Shape Characterisation of Dry Samples using Microscopic and Dynamic Image Analysis , 2009 .

[20]  Venkat Venkatasubramanian,et al.  Population Balance Model-Based Hybrid Neural Network for a Pharmaceutical Milling Process , 2010, Journal of Pharmaceutical Innovation.

[21]  John William Strutt,et al.  Scientific Papers: On the Scattering of Light by small Particles , 2009 .

[22]  D. Ramkrishna,et al.  On the solution of population balance equations by discretization—II. A moving pivot technique , 1996 .

[23]  M. Andersson,et al.  First-Principles Prediction of Liquid/Liquid Interfacial Tension. , 2014, Journal of chemical theory and computation.

[24]  A. Klamt,et al.  Refinement and Parametrization of COSMO-RS , 1998 .

[25]  Harry Boyer,et al.  Hybrid Modelling of the Sucrose Crystal Growth Rate , 2001 .

[26]  Wei-Kang Yuan,et al.  A hybrid neural network-first principles model for fixed-bed reactor , 1999 .

[27]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..