SLA based healthcare big data analysis and computing in cloud network

Abstract Large volume of multi-structured and low-latency patient data are generated in healthcare services, which is achallenging task to process and analyze within the Service Level Agreement (SLA). In this paper, a Parallel Semi-Naive Bayes (PSNB) based probabilistic method is used to process the healthcare big data in cloud for future health condition prediction. In order to improve the accuracy of PSNB method, a Modified Conjunctive Attribute (MCA) algorithm is proposed for reducing the dimension. Emergency condition of the patient is considered by setting a global priority among the patients and an Optimal Data Distribution (ODD) algorithm is proposed to position both batch and streaming patient data into the Spark nodes. Further, a Dynamic Job Scheduling (DJS) algorithm is designed to schedule the jobs efficiently to the most suitable nodes for processing the data taking SLA into account. Our proposed PSNB algorithm provides better accuracy of 87 . 8 % for both batch and streaming data, which is 12 . 8 % higher than the original Naive–Bayes (NB) algorithm and can conveniently be employed in various patient monitoring applications.

[1]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[2]  Rajkumar Buyya,et al.  Big Data computing and clouds: Trends and future directions , 2013, J. Parallel Distributed Comput..

[3]  Cong Xu,et al.  Exploiting Analytics Shipping with Virtualized MapReduce on HPC Backend Storage Servers , 2016, IEEE Transactions on Parallel and Distributed Systems.

[4]  Vana Kalogeraki,et al.  Real-Time Scheduling of Skewed MapReduce Jobs in Heterogeneous Environments , 2014, ICAC.

[5]  Keqin Li,et al.  A task-level adaptive MapReduce framework for real-time streaming data in healthcare applications , 2015, Future Gener. Comput. Syst..

[6]  Ruo-Ping Han,et al.  Disease prediction with different types of neural network classifiers , 2016, Telematics Informatics.

[7]  C. Krishna Mohan,et al.  DiP-SVM : Distribution Preserving Kernel Support Vector Machine for Big Data , 2017, IEEE Transactions on Big Data.

[8]  Scott Shenker,et al.  Delay scheduling: a simple technique for achieving locality and fairness in cluster scheduling , 2010, EuroSys '10.

[9]  Kenli Li,et al.  An intermediate data placement algorithm for load balancing in Spark computing environment , 2018, Future Gener. Comput. Syst..

[10]  Sergio Ramírez-Gallego,et al.  Distributed Entropy Minimization Discretizer for Big Data Analysis under Apache Spark , 2015, 2015 IEEE Trustcom/BigDataSE/ISPA.

[11]  Jeremy Kepner,et al.  Scalable System Scheduling for HPC and Big Data , 2017, J. Parallel Distributed Comput..

[12]  Huankai Chen,et al.  Spark on entropy: A reliable & efficient scheduler for low-latency parallel jobs in heterogeneous cloud , 2015, 2015 IEEE 40th Local Computer Networks Conference Workshops (LCN Workshops).

[13]  Qian Chen,et al.  Millipedes: Distributed and Set-Based Sub-Task Scheduler of Computing Engines Running on Yarn Cluster , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[14]  JeongKyu Lee,et al.  H2Hadoop: Improving Hadoop Performance Using the Metadata of Related Jobs , 2018, IEEE Transactions on Cloud Computing.

[15]  Naixue Xiong,et al.  A Pretreatment Workflow Scheduling Approach for Big Data Applications in Multicloud Environments , 2016, IEEE Transactions on Network and Service Management.

[16]  Pramod K. Varshney,et al.  Dimensionality Reduction for Registration of High-Dimensional Data Sets , 2013, IEEE Transactions on Image Processing.

[17]  Ya-Shu Chen,et al.  Data-locality-aware mapreduce real-time scheduling framework , 2016, J. Syst. Softw..

[18]  Carmen C. Y. Poon,et al.  Big Data for Health , 2015, IEEE Journal of Biomedical and Health Informatics.

[19]  Aruna Tiwari,et al.  Fuzzy Based Scalable Clustering Algorithms for Handling Big Data Using Apache Spark , 2016, IEEE Transactions on Big Data.

[20]  E. A. Mary Anita,et al.  Interactive Big Data Management in Healthcare Using Spark , 2016 .

[21]  Bo Tang,et al.  A Bayesian Classification Approach Using Class-Specific Features for Text Categorization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[22]  Matei A. Zaharia,et al.  An Architecture for and Fast and General Data Processing on Large Clusters , 2016 .

[23]  A. Biondi,et al.  Tumor size as a prognostic factor in patients with stage IIa colon cancer. , 2018, American journal of surgery.

[24]  Prasan Kumar Sahoo,et al.  Big data analytic architecture for intruder detection in heterogeneous wireless sensor networks , 2016, J. Netw. Comput. Appl..

[25]  Sandeep K. Sood,et al.  An Energy-Efficient Architecture for the Internet of Things (IoT) , 2017, IEEE Systems Journal.

[26]  Randy H. Katz,et al.  Improving MapReduce Performance in Heterogeneous Environments , 2008, OSDI.

[27]  Kenli Li,et al.  A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment , 2017, IEEE Transactions on Parallel and Distributed Systems.

[28]  Prasan Kumar Sahoo,et al.  Analyzing Healthcare Big Data With Prediction for Future Health Condition , 2016, IEEE Access.

[29]  Fatma A. Omara,et al.  Prediction mechanisms for monitoring state of cloud resources using Markov chain model , 2016, J. Parallel Distributed Comput..

[30]  Seungmin Kang,et al.  Dynamic scheduling strategy with efficient node availability prediction for handling divisible loads in multi-cloud systems , 2018, J. Parallel Distributed Comput..

[31]  Geoffrey I. Webb,et al.  A comparative study of Semi-naive Bayes methods in classification learning , 2005 .

[32]  Mohammed Ismail,et al.  Low-Power ECG-Based Processor for Predicting Ventricular Arrhythmia , 2016, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[33]  Guy Pujolle,et al.  Greenslater: On Satisfying Green SLAs in Distributed Clouds , 2015, IEEE Transactions on Network and Service Management.

[34]  Jian Tang,et al.  Performance Modeling and Predictive Scheduling for Distributed Stream Data Processing , 2016, IEEE Transactions on Big Data.

[35]  George Karypis,et al.  Using conjunction of attribute values for classification , 2002, CIKM '02.

[36]  D. Janaki Ram,et al.  Extending MapReduce across Clouds with BStream , 2014, IEEE Transactions on Cloud Computing.

[37]  Norbert Ritter,et al.  Large-Scale Data Pollution with Apache Spark , 2020, IEEE Transactions on Big Data.