Application of a Stochastic Gradient Descent-Based SVR Online Modeling Method to Time-Varying Forging Processes

In practice, forging processes have many unknown dynamics and fast time-varying characteristics due to transient load variation. This often results in insufficient data samples. Usually, support vector regression (SVR) can accurately model small sample data due to its good sparsity. However, using sequential minimum optimization (SMO) algorithms increases the computational costs during the solution process, making it difficult to model fast time-varying systems. Aiming to address this problem, we developed an approach using online stochastic gradient descent (SGD) to improve SVR modeling efficiency. First, we used loss coefficients derived from the loss function to represent support vector loss. This effectively ensured sparsity in the modeling process. In this way, the SVR solving process was transformed into a loss coefficient calculation. This calculation was easy to achieve using SGD; thus, the solving process complexity was greatly reduced compared to SMO. On this basis, we developed an online incremental strategy to adapt the time-varying dynamics using online updating of step length, loss coefficients, and bias term. Additional analysis demonstrated the convergence of the proposed online modeling method. Furthermore, the modeling effect of this method is verified by using actual experiments with a 40-MN isothermal die forging press. Index Data-driven model, deformation force, die forging system, online model, support vector regression (SVR).

[1]  Naveed Ishtiaq Chaudhary,et al.  Design of auxiliary model based normalized fractional gradient algorithm for nonlinear output-error systems , 2022, Chaos, Solitons & Fractals.

[2]  Naveed Ishtiaq Chaudhary,et al.  Design of fractional hierarchical gradient descent algorithm for parameter estimation of nonlinear control autoregressive systems , 2022, Chaos, Solitons & Fractals.

[3]  Naveed Ishtiaq Chaudhary,et al.  Hierarchical Quasi-Fractional Gradient Descent Method for Parameter Estimation of Nonlinear ARX Systems Using Key Term Separation Principle , 2021, Mathematics.

[4]  Cheng Xu,et al.  Error Constraint Enhanced Particle Filter Using Quantum Particle Swarm Optimization , 2021, IEEE Sensors Journal.

[5]  Rabian Wangkeeree,et al.  Stochastic Subgradient for Large-Scale Support Vector Machine Using the Generalized Pinball Loss Function , 2021, Symmetry.

[6]  Yingjie Zhang,et al.  Mobile Robot Path Planning Based on Improved Localized Particle Swarm Optimization , 2021, IEEE Sensors Journal.

[7]  Yong-Ping Zhao,et al.  A modeling method for aero-engine by combining stochastic gradient descent with support vector regression , 2020 .

[8]  Minghui Huang,et al.  Estimation of dynamic behaviors of hydraulic forging press machine in slow-motion manufacturing process , 2019, Nonlinear Dynamics.

[9]  Bin Gu,et al.  Accelerating Sequential Minimal Optimization via Stochastic Subgradient Descent , 2019, IEEE Transactions on Cybernetics.

[10]  Aman Pal,et al.  Generalized Pinball Loss SVMs , 2018, Neurocomputing.

[11]  XinJiang Lu,et al.  Nonlinear dynamic analysis of complex hydraulic driving processes , 2018, Journal of Sound and Vibration.

[12]  Jian Yang,et al.  On Selecting Effective Patterns for Fast Support Vector Regression Training , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Jie Lei,et al.  Nonlinear-Dynamic-Analysis Based Fuzzy PID Control Approach for Complex Hydraulic Driving Process , 2018, International Journal of Precision Engineering and Manufacturing.

[14]  Zongxia Xie,et al.  Large-scale support vector regression with budgeted stochastic gradient descent , 2018, Int. J. Mach. Learn. Cybern..

[15]  Yibo Li,et al.  New approach of friction model and identification for hydraulic system based on MAPSO-NMDS optimization Elman neural network , 2017 .

[16]  Wenbo Liu,et al.  Probabilistic Weighted Support Vector Machine for Robust Modeling With Application to Hydraulic Actuator , 2017, IEEE Transactions on Industrial Informatics.

[17]  Jian Yang,et al.  Finding the samples near the decision plane for support vector learning , 2017, Inf. Sci..

[18]  Enrico Zio,et al.  An adaptive online learning approach for Support Vector Regression: Online-SVR-FID , 2016 .

[19]  Shaoping Wang,et al.  Remaining useful life prediction based on the Wiener process for an aviation axial piston pump , 2016 .

[20]  Minghui Huang,et al.  Dempster-Shafer theory-based robust least squares support vector machine for stochastic modelling , 2016, Neurocomputing.

[21]  Minghui Huang,et al.  Regularized online sequential extreme learning machine with adaptive regulation factor for time-varying nonlinear system , 2016, Neurocomputing.

[22]  Fang Zhou,et al.  Displacement and dual-pressure compound control for fast forging hydraulic system , 2016 .

[23]  Chuanfa Chen,et al.  A robust weighted least squares support vector regression based on least trimmed squares , 2015, Neurocomputing.

[24]  Krzysztof Sopyla,et al.  Stochastic Gradient Descent with Barzilai-Borwein update step for SVM , 2015, Inf. Sci..

[25]  Chang Liu,et al.  Online Probabilistic Extreme Learning Machine for Distribution Modeling of Complex Batch Forging Processes , 2015, IEEE Transactions on Industrial Informatics.

[26]  Kyoung Kwan Ahn,et al.  Trajectory control of an electro hydraulic actuator using an iterative backstepping control scheme , 2015 .

[27]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[28]  XinJiang Lu,et al.  Two-Level Modeling Based Intelligent Integration Control for Time-Varying Forging Processes , 2015 .

[29]  Minghui Huang,et al.  A Novel LS-SVM Modeling Method for a Hydraulic Press Forging Process With Multiple Localized Solutions , 2015, IEEE Transactions on Industrial Informatics.

[30]  Yong Zhu,et al.  Study on nonlinear dynamics characteristics of electrohydraulic servo system , 2015 .

[31]  T. Piatkowski,et al.  Dahl and LuGre dynamic friction models — The analysis of selected properties , 2014 .

[32]  Xinjiang Lu,et al.  Operation-Region-Decomposition-Based Singular Value Decomposition/Neural Network Modeling Method for Complex Hydraulic Press Machines , 2013 .

[33]  Her-Terng Yau,et al.  Identification and Compensation of Nonlinear Friction Characteristics and Precision Control for a Linear Motor Stage , 2013, IEEE/ASME Transactions on Mechatronics.

[34]  Olivier Pantalé,et al.  Influence of the Constitutive Flow Law in FEM Simulation of the Radial Forging Process , 2013 .

[35]  Jian Yang,et al.  Recursive robust least squares support vector regression based on maximum correntropy criterion , 2012, Neurocomputing.

[36]  Minghui Huang,et al.  System-Decomposition-Based Multilevel Control for Hydraulic Press Machine , 2012, IEEE Transactions on Industrial Electronics.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  J. Chen,et al.  Three-Dimensional Nonlinear Finite Element Analysis of Hot Radial Forging Process for Large Diameter Tubes , 2010 .

[39]  Liu Jun,et al.  Application of BP Neural Network in the Control of Hydraulic Die Forging Hammer , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[40]  Ambuj Tewari,et al.  On the Generalization Ability of Online Strongly Convex Programming Algorithms , 2008, NIPS.

[41]  Y. Singer,et al.  Pegasos: Primal Estimated sub-GrAdient SOlver for SVM , 2011, ICML.

[42]  K. Hans Raj,et al.  Modelling of hot closed die forging of an automotive piston with ANN for intelligent manufacturing , 2004 .

[43]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[44]  Carlos Canudas de Wit,et al.  A new model for control of systems with friction , 1995, IEEE Trans. Autom. Control..

[45]  Carlos Canudas de Wit,et al.  A survey of models, analysis tools and compensation methods for the control of machines with friction , 1994, Autom..

[46]  Jorge Ferreira,et al.  Testing and Evaluation of Control Strategies for a Prototype Hydraulic Press , 2003 .

[47]  J. Guthrie b. Brown,et al.  Mechanical and Electrical Engineering , 1965, Nature.