Multi-objective optimization method for learning thresholds in a decision-theoretic rough set model

For decision-theoretic rough sets, a key issue is determining the thresholds for the probabilistic rough set model by setting appropriate cost functions. However, it is not easy to obtain correct cost functions because of a lack of prior knowledge and few previous studies have addressed the determination of learning thresholds and cost functions from datasets. In the present study, a multi-objective optimization model is proposed for threshold learning. In our model, we integrate an objective function that minimizes the decision cost with another that decreases the size of the boundary region. The ranges of the thresholds and two types of F_measure are used as constraints. In addition, a multi-objective genetic algorithm is employed to obtain the Pareto optimal set. We used 12 UCI datasets to validate the performance of our method, where the experimental results demonstrated the trade-off between the two objectives as well as showing that the thresholds obtained by our method were more intuitive than those obtained using other methods. The classification abilities of the solutions were improved by the F_measure constraints. We propose a multi-objective optimization method for learning thresholds.Decreasing the size of the boundary region is represented simply.The penalties in single objective model could be neglected.Solutions with better classification ability can be improve by F_measures.Users may select the final solution based on their own preferences.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Yiyu Yao,et al.  Probabilistic rough set approximations , 2008, Int. J. Approx. Reason..

[3]  Decui Liang,et al.  A Novel Risk Decision Making Based on Decision-Theoretic Rough Sets Under Hesitant Fuzzy Information , 2015, IEEE Transactions on Fuzzy Systems.

[4]  Jingtao Yao,et al.  Learning Optimal Parameters in Decision-Theoretic Rough Sets , 2009, RSKT.

[5]  Zuren Feng,et al.  An efficient ant colony optimization approach to attribute reduction in rough set theory , 2008, Pattern Recognit. Lett..

[6]  Yiyu Yao,et al.  A Three-Way Decision Approach to Email Spam Filtering , 2010, Canadian Conference on AI.

[7]  Yiyu Yao,et al.  Naive Bayesian Rough Sets , 2010, RSKT.

[8]  Yiyu Yao,et al.  An Information-Theoretic Interpretation of Thresholds in Probabilistic Rough Sets , 2012, RSKT.

[9]  Cheng-Yan Kao,et al.  Applying the genetic approach to simulated annealing in solving some NP-hard problems , 1993, IEEE Trans. Syst. Man Cybern..

[10]  Nouman Azam,et al.  Multiple Criteria Decision Analysis with Game-Theoretic Rough Sets , 2012, RSKT.

[11]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[12]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[13]  Bing Zhou,et al.  Multi-class decision-theoretic rough sets , 2014, Int. J. Approx. Reason..

[14]  Kalyanmoy Deb,et al.  Improved Pruning of Non-Dominated Solutions Based on Crowding Distance for Bi-Objective Optimization Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  S. K. Michael Wong,et al.  Rough Sets: Probabilistic versus Deterministic Approach , 1988, Int. J. Man Mach. Stud..

[16]  Yiyu Yao,et al.  Relative reducts in consistent and inconsistent decision tables of the Pawlak rough set model , 2009, Inf. Sci..

[17]  Weihua Xu,et al.  Double-quantitative decision-theoretic rough set , 2015, Inf. Sci..

[18]  Decui Liang,et al.  Incorporating logistic regression to decision-theoretic rough sets for classifications , 2014, Int. J. Approx. Reason..

[19]  Jingtao Yao,et al.  Game-Theoretic Rough Sets , 2011, Fundam. Informaticae.

[20]  Yiyu Yao,et al.  Decision-Theoretic Rough Set Models , 2007, RSKT.

[21]  Guoyin Wang,et al.  An automatic method to determine the number of clusters using decision-theoretic rough set , 2014, Int. J. Approx. Reason..

[22]  Nouman Azam,et al.  Analyzing uncertainties of probabilistic rough set regions with game-theoretic rough sets , 2014, Int. J. Approx. Reason..

[23]  Vijay V. Raghavan,et al.  Data Mining: Trends in Research and Development , 1997 .

[24]  Dun Liu,et al.  Attribute Reduction in Decision-Theoretic Rough Set Model: A Further Investigation , 2011, RSKT.

[25]  Huaxiong Li,et al.  Risk Decision Making Based on Decision-theoretic Rough Set: A Three-way View Decision Model , 2011 .

[26]  Tianrui Li,et al.  THREE-WAY GOVERNMENT DECISION ANALYSIS WITH DECISION-THEORETIC ROUGH SETS , 2012 .

[27]  Min Chen,et al.  Rough Cluster Quality Index Based on Decision Theory , 2009, IEEE Transactions on Knowledge and Data Engineering.

[28]  Yasuo Kudo,et al.  A sequential pattern mining algorithm using rough set theory , 2011, Int. J. Approx. Reason..

[29]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[30]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[31]  Wojciech Ziarko,et al.  Variable Precision Rough Sets with Asymmetric Bounds , 1993, RSKD.

[32]  Yiyu Yao,et al.  A comparison of positive, boundary, and possible rules using the MLEM2 rule induction algorithm , 2010, 2010 10th International Conference on Hybrid Intelligent Systems.

[33]  Mauricio G. C. Resende,et al.  A genetic algorithm for the resource constrained multi-project scheduling problem , 2008, Eur. J. Oper. Res..

[34]  Nan Zhang,et al.  Hierarchical rough decision theoretic framework for text classification , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[35]  Jingtao Yao,et al.  Modelling Multi-agent Three-way Decisions with Decision-theoretic Rough Sets , 2012, Fundam. Informaticae.

[36]  Yiyu Yao,et al.  An Outline of a Theory of Three-Way Decisions , 2012, RSCTC.

[37]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[38]  Zhenmin Tang,et al.  On an optimization representation of decision-theoretic rough set model , 2014, Int. J. Approx. Reason..