A multi-objective evolutionary approach for fuzzy regression analysis

Abstract Fuzzy regression analysis was extensively used in previous studies to model the relationships between dependent and independent variables in a fuzzy environment. Various approaches have been proposed to perform fuzzy regression analysis with most of the approaches adopting a single objective function in the generation of fuzzy regression models. Some previous studies attempted to generate fuzzy regression models using a multi-objective optimization approach in order to improve the prediction accuracy of the generated fuzzy regression models. However, in the studies, the subjective judgments of parameter settings are required for solving multi-objective optimization problems and a complete representation of Parato optimal solutions cannot be generated in a single run. To address the limitations, a multi-objective evolutionary approach to fuzzy regression analysis is proposed in this paper. In the proposed approach, a multi-objective optimization problem is formulated which involves three objectives; minimizing the fuzziness of fuzzy outputs, minimizing the effect of outliers and minimizing the mean absolute percentage error of modeling. A non-dominated sorting genetic algorithm-α is introduced to solve the problem and generate a set of Pareto optimal solutions. Finally, a technique for order of preference by similarity to ideal solution is applied to determine a final optimal solution by which a fuzzy regression model can be generated. A case study is conducted to illustrate the proposed approach. Sixteen validation tests are conducted to evaluate the effectiveness of the proposed approach. The results of the validation tests show that the proposed approach outperforms Tanaka's fuzzy regression, Peters’ fuzzy regression, compromise programming based multi-objective fuzzy regression, fuzzy least-squares regression and probabilistic fuzzy regression approaches in terms of training errors and prediction accuracy.

[1]  Ram R. Bishu,et al.  Evaluation of fuzzy linear regression models by comparing membership functions , 1998, Fuzzy Sets Syst..

[2]  Ruey-Chyn Tsaur,et al.  Bicriteria variable selection in a fuzzy regression equation , 2000 .

[3]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[4]  Jie Lu,et al.  Formulation of fuzzy linear programming problems as four-objective constrained optimization problems , 2003, Appl. Math. Comput..

[5]  S. M. Taheri,et al.  FUZZY LINEAR REGRESSION BASED ON LEAST ABSOLUTES DEVIATIONS , 2012 .

[6]  Lucien Duckstein,et al.  Multi-objective fuzzy regression: a general framework , 2000, Comput. Oper. Res..

[7]  Michela Antonelli,et al.  A distributed approach to multi-objective evolutionary generation of fuzzy rule-based classifiers from big data , 2017, Inf. Sci..

[8]  Hisao Ishibuchi,et al.  Incorporation of user preference into multi-objective genetic fuzzy rule selection for pattern classification problems , 2009, Artificial Life and Robotics.

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  C. K. Kwong,et al.  Modeling manufacturing processes using fuzzy regression with the detection of outliers , 2008 .

[11]  Beatrice Lazzerini,et al.  On reducing computational overhead in multi-objective genetic Takagi-Sugeno fuzzy systems , 2011, Appl. Soft Comput..

[12]  Inci Batmaz,et al.  Classification models based on Tanaka's fuzzy linear regression approach: The case of customer satisfaction modeling , 2010, J. Intell. Fuzzy Syst..

[13]  Jin Hee Yoon,et al.  The statistical inferences of fuzzy regression based on bootstrap techniques , 2015, Soft Comput..

[14]  Takashi Maeda Fuzzy linear programming problems as bi-criteria optimization problems , 2001, Appl. Math. Comput..

[15]  Pierpaolo D'Urso,et al.  A least-squares approach to fuzzy linear regression analysis , 2000 .

[16]  Liang-Hsuan Chen,et al.  Fuzzy Regression Models Using the Least-Squares Method Based on the Concept of Distance , 2009, IEEE Transactions on Fuzzy Systems.

[17]  Marco Astolfi,et al.  Thermodynamic and technoeconomic optimization of Organic Rankine Cycle systems , 2017 .

[18]  Lucien Duckstein,et al.  Multiobjective fuzzy regression with central tendency and possibilistic properties , 2002, Fuzzy Sets Syst..

[19]  Miin-Shen Yang,et al.  Fuzzy least-squares linear regression analysis for fuzzy input-output data , 2002, Fuzzy Sets Syst..

[20]  Yuanyuan Liu,et al.  Optimizing h value for fuzzy linear regression with asymmetric triangular fuzzy coefficients , 2016, Eng. Appl. Artif. Intell..

[21]  Richard Y. K. Fung,et al.  Fuzzy regression-based mathematical programming model for quality function deployment , 2004 .

[22]  Ebrahim Nasrabadi,et al.  Fuzzy linear regression analysis: a multi-objective programming approach , 2005, Appl. Math. Comput..

[23]  María Teresa Lamata,et al.  On rank reversal and TOPSIS method , 2012, Math. Comput. Model..

[24]  Kit Yan Chan,et al.  A generalised fuzzy least-squares regression approach to modelling relationships in QFD , 2010 .

[25]  Zengqiang Chen,et al.  Chaos-Based Fuzzy Regression Approach to Modeling Customer Satisfaction for Product Design , 2013, IEEE Transactions on Fuzzy Systems.

[26]  Georg Peters Fuzzy linear regression with fuzzy intervals , 1994 .

[27]  Yun-Hsi O. Chang Hybrid fuzzy least-squares regression analysis and its reliability measures , 2001, Fuzzy Sets Syst..

[28]  Hsiao-Fan Wang,et al.  Insight of a fuzzy regression model , 2000, Fuzzy Sets Syst..

[29]  Hamed Rafiei,et al.  Symmetric fuzzy linear regression using multi-objective optimization , 2012 .

[30]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[31]  Zhenjun Ma,et al.  A multi-objective design optimization strategy for vertical ground heat exchangers , 2015 .

[32]  C. K. Kwong,et al.  Probabilistic fuzzy regression approach for preference modeling , 2017, Eng. Appl. Artif. Intell..

[33]  Wenyi Zeng,et al.  Fuzzy least absolute linear regression , 2017, Appl. Soft Comput..

[34]  Masatoshi Sakawa,et al.  Multiobjective fuzzy linear regression analysis for fuzzy input-output data , 1992 .

[35]  Miin-Shen Yang,et al.  Fuzzy least-squares algorithms for interactive fuzzy linear regression models , 2003, Fuzzy Sets Syst..

[36]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[37]  Yizeng Chen,et al.  A non-linear possibilistic regression approach to model functional relationships in product planning , 2006 .

[38]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[39]  C. R. Bector,et al.  A simple method for computation of fuzzy linear regression , 2005, Eur. J. Oper. Res..

[40]  Y. Chen,et al.  The Hybrid Fuzzy Least-Squares Regression Approach to Modeling Manufacturing Processes , 2008, IEEE Transactions on Fuzzy Systems.

[41]  H. Tanka Fuzzy data analysis by possibilistic linear models , 1987 .

[42]  Juan Martínez-Moreno,et al.  Estimation of a Fuzzy Regression Model Using Fuzzy Distances , 2016, IEEE Transactions on Fuzzy Systems.

[43]  Carlos A. Coello Coello,et al.  Solving Hard Multiobjective Optimization Problems Using epsilon-Constraint with Cultured Differential Evolution , 2006, PPSN.

[44]  Won Kyung Kim,et al.  The behavioral TOPSIS , 2017, Expert Syst. Appl..

[45]  Kit Yan Chan,et al.  A forward selection based fuzzy regression for new product development that correlates engineering characteristics with consumer preferences , 2016, J. Intell. Fuzzy Syst..