Solving the ocean color inverse problem by using evolutionary multi-objective optimization of neuro-fuzzy systems

The ocean color inverse problem consists of determining the concentrations of optically active constituents, such as chlorophyll, suspended particulate matter and colored dissolved organic matter, from remotely sensed multispectral measurements of the reflected sunlight back-scattered by the water body. In this paper, we approach this regression problem by using an evolutionary multi-objective algorithm, namely the (2+2) Modified Pareto Archived Evolutionary Strategy ((2+2)M-PAES), to optimize Takagi-Sugeno type (TS-type) fuzzy rule-based systems (FRBSs). Accuracy and complexity are the two competitive objectives to be simultaneously optimized. TS-type FRBSs are implemented as an artificial neural network; by training the neural network, the parameters of the fuzzy model are adjusted. In this way, the evolutionary optimization coarsely identifies the structure of the TS-type FRBSs, while the corresponding neural networks finely tune their parameters. As a result, a set of TS-type FRBSs with different trade-offs between accuracy and complexity is provided at the end of the optimization process. We show the effectiveness of our approach by comparing our results with those obtained on the ocean color inverse problem by other techniques recently proposed in the literature.

[1]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[2]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  Shang-Ming Zhou,et al.  Improving the interpretability of Takagi-Sugeno fuzzy model by using linguistic modifiers and a multiple objective learning scheme , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[5]  Habtom W. Ressom,et al.  Inversion of ocean color observations using particle swarm optimization , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[7]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[8]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[9]  Cyril Fonlupt,et al.  Solving the ocean color problem using a genetic programming approach , 2001, Appl. Soft Comput..

[10]  Kazutoshi Sakakibara,et al.  Multi-objective approaches in a single-objective optimization environment , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[12]  L. Prieur,et al.  A three-component model of ocean colour and its application to remote sensing of phytoplankton pigments in coastal waters , 1989 .

[13]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[14]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[15]  G. Corsini,et al.  Approaching the ocean color problem using fuzzy rules , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[17]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[18]  L. Prieur,et al.  Analysis of variations in ocean color1 , 1977 .

[19]  Antonio F. Gómez-Skarmeta,et al.  Accurate, Transparent, and Compact Fuzzy Models for Function Approximation and Dynamic Modeling through Multi-objective Evolutionary Optimization , 2001, EMO.

[20]  DebKalyanmoy.  Multi-objective genetic algorithms , 1999 .

[21]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Hisao Ishibuchi,et al.  GA-based approaches to linguistic modeling of nonlinear functions , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[23]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[24]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[25]  G. Corsini,et al.  Radial Basis Function and Multilayer Perceptron neural networks for sea water optically active parameter estimation in case II waters: A comparison , 2003 .

[26]  Sindy Sterckx,et al.  Retrieval of oceanic constituents from ocean color using simulated annealing , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[27]  Tor Arne Johansen,et al.  Multiobjective identification of Takagi-Sugeno fuzzy models , 2003, IEEE Trans. Fuzzy Syst..

[28]  P. Villar,et al.  A multiobjective genetic algorithm for feature selection and granularity learning in fuzzy-rule based classification systems , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[29]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[30]  B. Lazzerini,et al.  A Comparison of Multi-Ojective Evolutionary Algorithms in Fuzzy Rule-Based Systems Generation , 2006, NAFIPS 2006 - 2006 Annual Meeting of the North American Fuzzy Information Processing Society.

[31]  Kim-Fung Man,et al.  Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction , 2005, Fuzzy Sets Syst..

[32]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[33]  Plamen P. Angelov,et al.  Automatic generation of fuzzy rule-based models from data by genetic algorithms , 2003, Inf. Sci..

[34]  Andrew Hunter,et al.  Selecting features in neurofuzzy modelling by multiobjective genetic algorithms , 1999 .

[35]  Héctor Pomares,et al.  Multi-objective evolution of fuzzy systems , 2006, Soft Comput..

[36]  Hisao Ishibuchi,et al.  Modification of Evolutionary Multiobjective Optimization Algorithms for Multiobjective Design of Fuzzy Rule-Based Classification Systems , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[37]  Marco Diani,et al.  Retrieval of sea water optically active parameters from hyperspectral data by means of generalized radial basis function neural networks , 2001, IEEE Trans. Geosci. Remote. Sens..

[38]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[39]  Kim-Fung Man,et al.  Agent-based evolutionary approach for interpretable rule-based knowledge extraction , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  Sylvie Thiria,et al.  Applying artificial neural network methodology to ocean color remote sensing , 1999 .

[41]  H. Ishibuchi,et al.  Genetic-algorithm-based approach to linguistic approximation of nonlinear functions with many input variables , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[42]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[43]  Soo Chin Liew,et al.  Modeling the reflectance spectra of tropical coastal waters , 2002, Optics + Photonics.

[44]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[45]  R. Babuska,et al.  Fuzzy modeling with multi-objective neuro-evolutionary algorithms , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[46]  Janet W. Campbell,et al.  The lognormal distribution as a model for bio‐optical variability in the sea , 1995 .

[47]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..