Multiclass Benchmarking Framework for Automated Acute Leukaemia Detection and Classification Based on BWM and Group-VIKOR

This paper aims to assist the administration departments of medical organisations in making the right decision on selecting a suitable multiclass classification model for acute leukaemia. In this paper, we proposed a framework that will aid these departments in evaluating, benchmarking and ranking available multiclass classification models for the selection of the best one. Medical organisations have continuously faced evaluation and benchmarking challenges in such endeavour, especially when no single model is superior. Moreover, the improper selection of multiclass classification for acute leukaemia model may be costly for medical organisations. For example, when a patient dies, one such organisation will be legally or financially sued for incidents in which the model fails to fulfil its desired outcome. With regard to evaluation and benchmarking, multiclass classification models are challenging processes due to multiple evaluation and conflicting criteria. This study structured a decision matrix (DM) based on the crossover of 2 groups of multi-evaluation criteria and 22 multiclass classification models. The matrix was then evaluated with datasets comprising 72 samples of acute leukaemia, which include 5327 gens. Subsequently, multi-criteria decision-making (MCDM) techniques are used in the benchmarking and ranking of multiclass classification models. The MCDM used techniques that include the integrated BWM and VIKOR. BWM has been applied for the weight calculations of evaluation criteria, whereas VIKOR has been used to benchmark and rank classification models. VIKOR has also been employed in two decision-making contexts: individual and group decision making and internal and external group aggregation. Results showed the following: (1) the integration of BWM and VIKOR is effective at solving the benchmarking/selection problems of multiclass classification models. (2) The ranks of classification models obtained from internal and external VIKOR group decision making were almost the same, and the best multiclass classification model based on the two was ‘Bayes. Naive Byes Updateable’ and the worst one was ‘Trees.LMT’. (3) Among the scores of groups in the objective validation, significant differences were identified, which indicated that the ranking results of internal and external VIKOR group decision making were valid.

[1]  B. B. Zaidan,et al.  A review of the automated detection and classification of acute leukaemia: Coherent taxonomy, datasets, validation and performance measurements, motivation, open challenges and recommendations , 2018, Comput. Methods Programs Biomed..

[2]  Stanley Zionts,et al.  MCDM---If Not a Roman Numeral, Then What? , 1979 .

[3]  R. Baltussen,et al.  Priority setting of health interventions: the need for multi-criteria decision analysis , 2006, Cost effectiveness and resource allocation : C/E.

[4]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[5]  B. B. Zaidan,et al.  Based Medical Systems for Patient’s Authentication: Towards a New Verification Secure Framework Using CIA Standard , 2019, Journal of Medical Systems.

[6]  Jorng-Tzong Horng,et al.  An expert system to classify microarray gene expression data using gene selection by decision tree , 2009, Expert Syst. Appl..

[7]  Gwo-Hshiung Tzeng,et al.  A new hybrid MCDM model combining DANP with VIKOR to improve e-store business , 2013, Knowl. Based Syst..

[8]  E. Valuations A REVIEW ON EVALUATION METRICS FOR DATA CLASSIFICATION EVALUATIONS , 2015 .

[9]  Santanu Kumar Rath,et al.  Classification of microarray using MapReduce based proximal support vector machine classifier , 2015, Knowl. Based Syst..

[10]  Gwo-Hshiung Tzeng,et al.  Extended VIKOR method in comparison with outranking methods , 2007, Eur. J. Oper. Res..

[11]  B. Chandra,et al.  Robust approach for estimating probabilities in Naïve-Bayes Classifier for gene expression data , 2011, Expert Syst. Appl..

[12]  Theodor J. Stewart,et al.  Multiple Criteria Decision Analysis , 2001 .

[13]  B. B. Zaidan,et al.  MOGSABAT: a metaheuristic hybrid algorithm for solving multi-objective optimisation problems , 2018, Neural Computing and Applications.

[14]  Zhang-peng Tian,et al.  An integrated approach for failure mode and effects analysis based on fuzzy best-worst, relative entropy, and VIKOR methods , 2018, Appl. Soft Comput..

[15]  S. A. Kareem,et al.  A Robust Feature Extraction and Selection Method for the Recognition of Lymphocytes versus Acute Lymphoblastic Leukemia , 2012, 2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT).

[16]  A. Hasan,et al.  High dimensional microarray data classification using correlation based feature selection , 2012, 2012 International Conference on Biomedical Engineering (ICoBE).

[17]  Ajith Abraham,et al.  Hybrid fuzzy-linear programming approach for multi-criteria decision making problems , 2003, Neural Parallel Sci. Comput..

[18]  Sanjay Kumar Malik,et al.  Major MCDM Techniques and their application-A Review , 2014 .

[19]  Himanshu Gupta,et al.  Evaluating service quality of airline industry using hybrid best worst method and VIKOR , 2017 .

[20]  Elizabeth Chang,et al.  ZBWM: The Z-number extension of Best Worst Method and its application for supplier development , 2018, Expert Syst. Appl..

[21]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  A. ZaidanA.,et al.  Based Real Time Remote Health Monitoring Systems , 2018 .

[23]  B. B. Zaidan,et al.  Systematic Review of an Automated Multiclass Detection and Classification System for Acute Leukaemia in Terms of Evaluation and Benchmarking, Open Challenges, Issues and Methodological Aspects , 2018, Journal of Medical Systems.

[24]  Seyed Amin Seyed Haeri,et al.  Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique , 2017 .

[25]  Nor Badrul Anuar,et al.  The landscape of research on smartphone medical apps: Coherent taxonomy, motivations, open challenges and recommendations , 2015, Comput. Methods Programs Biomed..

[26]  Lalit Mohan Saini,et al.  Detection of Acute Lymphoblastic Leukemia using watershed transformation technique , 2015, 2015 International Conference on Signal Processing, Computing and Control (ISPCC).

[27]  B. B. Zaidan,et al.  Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS , 2015, J. Biomed. Informatics.

[28]  Alex F. Mills,et al.  A simple yet effective decision support policy for mass-casualty triage , 2016, Eur. J. Oper. Res..

[29]  B. B. Zaidan,et al.  Design and Develop a Video Conferencing Framework for Real-Time Telemedicine Applications Using Secure Group-Based Communication Architecture , 2014, Journal of Medical Systems.

[30]  B. B. Zaidan,et al.  Challenges, Alternatives, and Paths to Sustainability: Better Public Health Promotion Using Social Networking Pages as Key Tools , 2015, Journal of Medical Systems.

[31]  Walid Serrai,et al.  Towards an efficient and a more accurate web service selection using MCDM methods , 2017, J. Comput. Sci..

[32]  K. Secnik,et al.  The association between diabetes related medical costs and glycemic control: A retrospective analysis , 2006, Cost effectiveness and resource allocation : C/E.

[33]  A. A. Zaidan,et al.  A methodology for football players selection problem based on multi-measurements criteria analysis , 2017 .

[34]  Lalit Mohan Saini,et al.  Robust technique for the detection of Acute Lymphoblastic Leukemia , 2015, 2015 IEEE Power, Communication and Information Technology Conference (PCITC).

[35]  Siu Cheung Hui,et al.  Exploring ant-based algorithms for gene expression data analysis , 2009, Artif. Intell. Medicine.

[36]  B. B. Zaidan,et al.  Real-Time Remote Health Monitoring Systems Using Body Sensor Information and Finger Vein Biometric Verification: A Multi-Layer Systematic Review , 2018, Journal of Medical Systems.

[37]  Al-HaiqiAhmed,et al.  Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS , 2015 .

[38]  B. B. Zaidan,et al.  Based on Real Time Remote Health Monitoring Systems: A New Approach for Prioritization “Large Scales Data” Patients with Chronic Heart Diseases Using Body Sensors and Communication Technology , 2018, Journal of Medical Systems.

[39]  Geoffrey A. Solano,et al.  Cluster center genes as candidate biomarkers for the classification of Leukemia , 2014, IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications.

[40]  B. B. Zaidan,et al.  Smart Home-based IoT for Real-time and Secure Remote Health Monitoring of Triage and Priority System using Body Sensors: Multi-driven Systematic Review , 2019, Journal of Medical Systems.

[41]  B. B. Zaidan,et al.  Fault-Tolerant mHealth Framework in the Context of IoT-Based Real-Time Wearable Health Data Sensors , 2019, IEEE Access.

[42]  A. A. Zaidan,et al.  A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: coherent taxonomy, open issues and recommendation pathway solution , 2018, Health and Technology.

[43]  T. Miranda Lakshmi,et al.  A Survey on Multi Criteria Decision Making Methods and Its Applications , 2013 .

[44]  B. B. Zaidan,et al.  Towards on Develop a Framework for the Evaluation and Benchmarking of Skin Detectors Based on Artificial Intelligent Models Using Multi-Criteria Decision-Making Techniques , 2017, Int. J. Pattern Recognit. Artif. Intell..

[45]  Simone A. Ludwig,et al.  Analyzing gene expression data: Fuzzy decision tree algorithm applied to the classification of cancer data , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[46]  Christian Münzenmayer,et al.  Automated classification of bone marrow cells in microscopic images for diagnosis of leukemia: a comparison of two classification schemes with respect to the segmentation quality , 2015, Medical Imaging.

[47]  Qing Yang,et al.  Evaluation and Classification of Overseas Talents in China Based on the BWM for Intuitionistic Relations , 2016, Symmetry.

[48]  Miss Laiha Mat Kiah,et al.  Suitability of using SOAP protocol to secure electronic medical record databases transmission , 2010 .

[49]  B. B. Zaidan,et al.  Real-time-based E-health systems: design and implementation of a lightweight key management protocol for securing sensitive information of patients , 2018, Health and Technology.

[50]  Jian Yang,et al.  Sparse maximum margin discriminant analysis for feature extraction and gene selection on gene expression data , 2013, Comput. Biol. Medicine.

[51]  J. Rezaei Best-worst multi-criteria decision-making method , 2015 .

[52]  B. B. Zaidan,et al.  Software and Hardware FPGA-Based Digital Watermarking and Steganography Approaches: Toward New Methodology for Evaluation and Benchmarking Using Multi-Criteria Decision-Making Techniques , 2017, J. Circuits Syst. Comput..

[53]  Sos S. Agaian,et al.  Automated Screening System for Acute Myelogenous Leukemia Detection in Blood Microscopic Images , 2014, IEEE Systems Journal.

[54]  Georges Adunlin,et al.  Application of multicriteria decision analysis in health care: a systematic review and bibliometric analysis , 2015, Health expectations : an international journal of public participation in health care and health policy.

[55]  Paolo Rota,et al.  On automated Flow Cytometric analysis for MRD estimation of Acute Lymphoblastic Leukaemia: A comparison among different approaches , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[56]  X. Troussard,et al.  Performance evaluation and relevance of the CellaVision™ DM96 system in routine analysis and in patients with malignant hematological diseases , 2007, International journal of laboratory hematology.

[57]  A. A. Zaidan,et al.  A new digital watermarking evaluation and benchmarking methodology using an external group of evaluators and multi‐criteria analysis based on ‘large‐scale data’ , 2017, Softw. Pract. Exp..

[58]  M. Saritha,et al.  Detection of blood cancer in microscopic images of human blood samples: A review , 2016, 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT).

[59]  B. B. Zaidan,et al.  MIRASS: Medical Informatics Research Activity Support System Using Information Mashup Network , 2014, Journal of Medical Systems.

[60]  Rajendra M. Sonar,et al.  Analytic Hierarchy Process (AHP), Weighted Scoring Method (WSM), and Hybrid Knowledge Based System (HKBS) for Software Selection: A Comparative Study , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.

[61]  Hesham Mohamed El-Deeb,et al.  Suite of decision tree-based classification algorithms on cancer gene expression data , 2011 .

[62]  A. A. Zaidan,et al.  A New Approach based on Multi-Dimensional Evaluation and Benchmarking for Data Hiding Techniques , 2017 .

[63]  B. B. Zaidan,et al.  Sensor-Based mHealth Authentication for Real-Time Remote Healthcare Monitoring System: A Multilayer Systematic Review , 2019, Journal of Medical Systems.

[64]  B. B. Zaidan,et al.  Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers , 2017, Telecommunication Systems.

[65]  B. B. Zaidan,et al.  Based Real Time Remote Health Monitoring Systems: A Review on Patients Prioritization and Related "Big Data" Using Body Sensors information and Communication Technology , 2018, Journal of Medical Systems.

[66]  Aduwati Sali,et al.  Multi-complex attributes analysis for optimum GPS baseband receiver tracking channels selection , 2017, 2017 4th International Conference on Control, Decision and Information Technologies (CoDIT).

[67]  B. B. Zaidan,et al.  A security framework for mHealth apps on Android platform , 2018, Comput. Secur..

[68]  Hau-San Wong,et al.  A neural network-based biomarker association information extraction approach for cancer classification , 2009, J. Biomed. Informatics.

[69]  Sounak Chakraborty,et al.  Computational Statistics and Data Analysis Simultaneous Cancer Classification and Gene Selection with Bayesian Nearest Neighbor Method: an Integrated Approach , 2022 .

[70]  Banshidhar Majhi,et al.  Gray level co-occurrence matrix and random forest based acute lymphoblastic leukemia detection , 2017, Biomed. Signal Process. Control..

[71]  Zhenyu Wang,et al.  A Comprehensive Fuzzy-Based Framework for Cancer Microarray Data Gene Expression Analysis , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[72]  Li Zhang,et al.  Intelligent leukaemia diagnosis with bare-bones PSO based feature optimization , 2017, Appl. Soft Comput..

[73]  B. B. Zaidan,et al.  Survey on fuzzy TOPSIS state-of-the-art between 2007 and 2017 , 2019, Comput. Oper. Res..

[74]  Timothy C. Coburn,et al.  GIS and Multicriteria Decision Analysis , 2000 .

[75]  T. Aruldoss Albert Victoire,et al.  Design of fuzzy expert system for microarray data classification using a novel Genetic Swarm Algorithm , 2012, Expert Syst. Appl..

[76]  Ivan Petrovic,et al.  Modification of the Best-Worst and MABAC methods: A novel approach based on interval-valued fuzzy-rough numbers , 2018, Expert Syst. Appl..

[77]  Bin Hu,et al.  Feature selection of high-dimensional biomedical data using improved SFLA for disease diagnosis , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[78]  Mohd Bakri Ishak,et al.  Optimal selection of Iron and Steel wastewater treatment technology using integrated multi-criteria decision-making techniques and fuzzy logic , 2017 .

[79]  B. B. Zaidan,et al.  Real-Time Medical Systems Based on Human Biometric Steganography: a Systematic Review , 2018, Journal of Medical Systems.

[80]  M. N. Sulaiman,et al.  A Review On Evaluation Metrics For Data Classification Evaluations , 2015 .

[81]  Mengjie Zhang,et al.  Hybridisation of Genetic Programming and Nearest Neighbour for classification , 2013, 2013 IEEE Congress on Evolutionary Computation.

[82]  B. B. Zaidan,et al.  Novel Methodology for Triage and Prioritizing Using "Big Data" Patients with Chronic Heart Diseases Through Telemedicine Environmental , 2017, Int. J. Inf. Technol. Decis. Mak..

[83]  Camille Salinesi,et al.  MCDM Techniques Selection Approaches: State of the Art , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[84]  K. L. Bansal,et al.  Comparative Study of Data Mining Tools , 2014 .

[85]  P. H. Huang,et al.  A non-linear non-weight method for multi-criteria decision making , 2017, Ann. Oper. Res..

[86]  A. A. Zaidan,et al.  Mobile-Based Patient Monitoring Systems: A Prioritisation Framework Using Multi-Criteria Decision-Making Techniques , 2019, Journal of Medical Systems.

[87]  B. B. Zaidan,et al.  Systematic Review of Real-time Remote Health Monitoring System in Triage and Priority-Based Sensor Technology: Taxonomy, Open Challenges, Motivation and Recommendations , 2018, Journal of Medical Systems.

[88]  B. B. Zaidan,et al.  Multi-Criteria Evaluation and Benchmarking for Active Queue Management Methods: Open Issues, Challenges and Recommended Pathway Solutions , 2019, Int. J. Inf. Technol. Decis. Mak..

[89]  Gül E. Okudan,et al.  Fuzzy AHP and utility theory based patient sorting in emergency departments , 2010 .

[90]  Vincenzo Piuri,et al.  All-IDB: The acute lymphoblastic leukemia image database for image processing , 2011, 2011 18th IEEE International Conference on Image Processing.

[91]  Rong-Ming Chen,et al.  Blood Cell Image Classification Based on Hierarchical SVM , 2011, 2011 IEEE International Symposium on Multimedia.

[92]  Dipti Patra,et al.  Image analysis of blood microscopic images for acute leukemia detection , 2010, 2010 International Conference on Industrial Electronics, Control and Robotics.

[93]  Eva-Maria Nordström,et al.  Decision support for participatory forest planning using AHP and TOPSIS. , 2016 .

[94]  B. B. Zaidan,et al.  Based blockchain-PSO-AES techniques in finger vein biometrics: A novel verification secure framework for patient authentication , 2019, Comput. Stand. Interfaces.

[95]  B. B. Zaidan,et al.  Electronic medical record systems: decision support examination framework for individual, security and privacy concerns using multi-perspective analysis , 2018, Health and Technology.

[96]  B. B. Zaidan,et al.  Meeting the Security Requirements of Electronic Medical Records in the ERA of High-Speed Computing , 2014, Journal of Medical Systems.

[97]  Luis M. de Campos,et al.  Bayesian networks classifiers for gene-expression data , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[98]  Mostefa Mesbah,et al.  EEG rhythm/channel selection for fuzzy rule-based alertness state characterization , 2016, Neural Computing and Applications.

[99]  İhsan Kaya,et al.  Use of MCDM techniques for energy policy and decision‐making problems: A review , 2018 .

[100]  Maarten J. IJzerman,et al.  Multiple Criteria Decision Analysis for Health Care Decision Making--An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. , 2016, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[101]  Yusen Zhang,et al.  Two feature selections for analysis of microarray data , 2010, 2010 IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA).

[102]  Yanchun Liang,et al.  A hybrid algorithm of minimum spanning tree and nearest neighbor for classifying human cancers , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[103]  Lóránt Tavasszy,et al.  Evaluation of the external forces affecting the sustainability of oil and gas supply chain using Best Worst Method , 2017 .

[104]  Jingzheng Ren,et al.  Selection of sustainable prime mover for combined cooling, heat, and power technologies under uncertainties: An interval multicriteria decision‐making approach , 2018 .

[105]  Sen Guo,et al.  Fuzzy best-worst multi-criteria decision-making method and its applications , 2017, Knowl. Based Syst..

[106]  Nasrollah Moghaddam Charkari,et al.  A recommender system for detection of leukemia based on cooperative game , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[107]  B. B. Zaidan,et al.  Multi-agent learning neural network and Bayesian model for real-time IoT skin detectors: a new evaluation and benchmarking methodology , 2019, Neural Computing and Applications.

[108]  F. M. Jumaah,et al.  Decision-making solution based multi-measurement design parameter for optimization of GPS receiver tracking channels in static and dynamic real-time positioning multipath environment , 2018 .

[109]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[110]  Nor Badrul Anuar,et al.  Cloud Service Selection Using Multicriteria Decision Analysis , 2014, TheScientificWorldJournal.

[111]  Mohammed N. Al-Kabi,et al.  A Comparison Study between Data Mining Tools over some Classification Methods , 2011 .

[112]  B. B. Zaidan,et al.  An Enhanced Security Solution for Electronic Medical Records Based on AES Hybrid Technique with SOAP/XML and SHA-1 , 2013, Journal of Medical Systems.

[113]  D. Goutam,et al.  Classification of acute myelogenous leukemia in blood microscopic images using supervised classifier , 2015, 2015 IEEE International Conference on Engineering and Technology (ICETECH).

[114]  B. B. Zaidan,et al.  Open source EMR software: Profiling, insights and hands-on analysis , 2014, Comput. Methods Programs Biomed..

[115]  TzengGwo-Hshiung,et al.  A new hybrid MCDM model combining DANP with VIKOR to improve e-store business , 2013 .

[116]  Hugo Jair Escalante,et al.  Acute leukemia classification by ensemble particle swarm model selection , 2012, Artif. Intell. Medicine.

[117]  EscalanteHugo Jair,et al.  Acute leukemia classification by ensemble particle swarm model selection , 2012 .

[118]  B. B. Zaidan,et al.  Multi-criteria analysis for OS-EMR software selection problem: A comparative study , 2015, Decis. Support Syst..

[119]  Gwo-Hshiung Tzeng,et al.  Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS , 2004, Eur. J. Oper. Res..

[120]  J. Mesirov,et al.  Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. , 1999, Science.

[121]  A. A. Zaidan,et al.  Comparative study on the evaluation and benchmarking information hiding approaches based multi-measurement analysis using TOPSIS method with different normalisation, separation and context techniques , 2018 .

[122]  B. B. Zaidan,et al.  A Security Framework for Nationwide Health Information Exchange based on Telehealth Strategy , 2015, Journal of Medical Systems.

[123]  Osman Kalender,et al.  Automatic segmentation, counting, size determination and classification of white blood cells , 2014 .

[124]  Yong Deng,et al.  A novel feature selection method based on CFS in cancer recognition , 2012, 2012 IEEE 6th International Conference on Systems Biology (ISB).

[125]  B. B. Zaidan,et al.  Real-Time Fault-Tolerant mHealth System: Comprehensive Review of Healthcare Services, Opens Issues, Challenges and Methodological Aspects , 2018, Journal of Medical Systems.

[126]  Miss Laiha Mat Kiah,et al.  Comprehensive review and analysis of anti-malware apps for smartphones , 2019, Telecommunication Systems.

[127]  Mohd Alauddin Mohd Ali,et al.  Comparison of adaptive neuro-fuzzy inference system and artificial neutral networks model to categorize patients in the emergency department , 2013, SpringerPlus.

[128]  B. B. Zaidan,et al.  Conceptual framework for the security of mobile health applications on Android platform , 2018, Telematics Informatics.

[129]  Sabrina Rashid,et al.  An adaptive feature reduction algorithm for cancer classification using wavelet decomposition of serum proteomic and DNA microarray data , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW).

[130]  Preety Singh,et al.  Local Binary Pattern for automatic detection of Acute Lymphoblastic Leukemia , 2014, 2014 Twentieth National Conference on Communications (NCC).

[131]  Miss Laiha Mat Kiah Impact of data privacy and confidentiality on developing telemedicine applications: A review participates opinion and expert concerns , 2011 .

[132]  Yuehui Chen,et al.  Multiclass Classification of Microarray Data Samples with Flexible Neural Tree , 2012, 2012 Spring Congress on Engineering and Technology.

[133]  H. S. Bhadauria,et al.  Computer Aided Diagnostic System for Detection of Leukemia Using Microscopic Images , 2015 .

[134]  Sreejit Chakravarty,et al.  Microarray medical data classification using kernel ridge regression and modified cat swarm optimization based gene selection system , 2016, Swarm Evol. Comput..

[135]  Sujata Dash,et al.  Hill-climber based fuzzy-rough feature extraction with an application to cancer classification , 2013, 13th International Conference on Hybrid Intelligent Systems (HIS 2013).

[136]  Agus Harjoko,et al.  Automated detection and classification techniques of Acute leukemia using image processing: A review , 2016, 2016 2nd International Conference on Science and Technology-Computer (ICST).

[137]  Adel Hatami-Marbini,et al.  A group AHP-TOPSIS framework for human spaceflight mission planning at NASA , 2011, Expert Syst. Appl..

[138]  K. I. Mohammed,et al.  Based Multiple Heterogeneous Wearable Sensors: A Smart Real-Time Health Monitoring Structured for Hospitals Distributor , 2019, IEEE Access.

[139]  Himanshu Gupta,et al.  Supplier selection among SMEs on the basis of their green innovation ability using BWM and fuzzy TOPSIS , 2017 .

[140]  Beatriz A. Garro,et al.  Designing artificial neural networks using differential evolution for classifying DNA microarrays , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[141]  Dalila B.M.M. Fontes,et al.  Multicriteria Decision Making: A Case Study in the Automobile Industry , 2013 .

[142]  A. A. Zaidan,et al.  An evaluation and selection problems of OSS-LMS packages , 2016, SpringerPlus.

[143]  Gamal Attiya,et al.  Gene expression profiles based Human cancer diseases classification , 2015, 2015 11th International Computer Engineering Conference (ICENCO).

[144]  A. A. Zaidan,et al.  Mobile Patient Monitoring Systems from a Benchmarking Aspect: Challenges, Open Issues and Recommended Solutions , 2019, Journal of Medical Systems.

[145]  A. A. Zaidan,et al.  Comprehensive insights into evaluation and benchmarking of real-time skin detectors: Review, open issues & challenges, and recommended solutions , 2018 .

[146]  Walid Serrai,et al.  An efficient approach for Web service selection , 2016, 2016 IEEE Symposium on Computers and Communication (ISCC).

[147]  B. B. Zaidan,et al.  Suitability of adopting S/MIME and OpenPGP email messages protocol to secure electronic medical records , 2013, Second International Conference on Future Generation Communication Technologies (FGCT 2013).

[148]  Henrik Boström,et al.  Improving Fusion of Dimensionality Reduction Methods for Nearest Neighbor Classification , 2009, 2009 International Conference on Machine Learning and Applications.

[149]  Saeid Nahavandi,et al.  Modified AHP for Gene Selection and Cancer Classification Using Type-2 Fuzzy Logic , 2016, IEEE Transactions on Fuzzy Systems.

[150]  Li Zhang,et al.  Multiple SVM-RFE for multi-class gene selection on DNA Microarray data , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[151]  J. Rezaei Best-worst multi-criteria decision-making method: Some properties and a linear model , 2016 .

[152]  B. B. Zaidan,et al.  A distributed framework for health information exchange using smartphone technologies , 2017, J. Biomed. Informatics.

[153]  B. B. Zaidan,et al.  Real-Time Remote Health-Monitoring Systems in a Medical Centre: A Review of the Provision of Healthcare Services-Based Body Sensor Information, Open Challenges and Methodological Aspects , 2018, Journal of Medical Systems.