ExaRD: introducing a framework for empowerment of resource discovery to support distributed exascale computing systems with high consistency

In this paper, we introduced the framework to empowerment resource discovery units for supporting distributed exascale computing systems with high consistency. In addition to the execution of activities to find resources by ExaRD, this framework is able to manage and control the dynamic and interactive events in distributed exascale computing systems. For these reasons, the dynamic and interactive nature in distributed exascale computing systems is analyzed, based on which the impacts of the occurrence of the dynamic and interactive nature in computational processes on the functionality of ExaRD are examined. By analyzing the impacts of the dynamic and interactive concept on the functionality of ExaRD, decisions can be made for constituent elements of the ExaRD framework and its functionality. Using a two-dimensional framework of ExaRD to manage and control dynamic and interactive events in distributed exascale computing systems causes ExaRD to be able to be executed in traditional computing systems. This two-dimensional framework is also able to create responding structures outside of the computing system to respond to the necessities of the computational processes. The ExaRD framework redefines the functionalities function and generator space of RD. Our examination in terms of management framework indicated that this framework is able to manage and control dynamic and interactive events by 50 percent.

[1]  Victor V. Toporkov,et al.  Preference-based Economic Scheduling in Grid Virtual Organizations , 2016, ICCS.

[2]  J. Javier Gutiérrez,et al.  Response-Time Analysis in Hierarchically-Scheduled Time-Partitioned Distributed Systems , 2017, IEEE Transactions on Parallel and Distributed Systems.

[3]  Soumya Banerjee,et al.  A Multi-Agent System Approach to Load-Balancing and Resource Allocation for Distributed Computing , 2015, ArXiv.

[4]  José Barbosa,et al.  Dynamic self-organization in holonic multi-agent manufacturing systems: The ADACOR evolution , 2015, Comput. Ind..

[5]  Ehsan Mousavi Khaneghah,et al.  Challenges of Process Migration to Support Distributed Exascale Computing Environment , 2018, ICSCA.

[6]  Igor Bychkov,et al.  Multiagent approach to controlling distributed computing in a cluster Grid system , 2014 .

[7]  Abdelkader Hameurlain,et al.  Resource discovery in grid systems: a survey , 2010, Int. J. Metadata Semant. Ontologies.

[8]  Ruay-Shiung Chang,et al.  A resource discovery tree using bitmap for grids , 2010, Future Gener. Comput. Syst..

[9]  Andrey Krekhov,et al.  Towards in situ visualization of extreme-scale, agent-based, worldwide disease-spreading simulations , 2015, SIGGRAPH Asia Visualization in High Performance Computing.

[10]  John Shalf,et al.  The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment , 2001, Int. J. High Perform. Comput. Appl..

[11]  Atul Mishra,et al.  A Comparative Study of Load Balancing Algorithms in Cloud Computing Environment , 2014, ArXiv.

[12]  Mohsen Sharifi,et al.  A mathematical model for empowerment of Beowulf clusters for exascale computing , 2013, 2013 International Conference on High Performance Computing & Simulation (HPCS).

[13]  Sherali Zeadally,et al.  A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems , 2016, Computing.

[14]  Mohammadi Ali Asghar,et al.  Cloud Computing Vs. Grid computing , 2013 .

[15]  Sanjay Shakkottai,et al.  FlashLinQ: A synchronous distributed scheduler for peer-to-peer ad hoc networks , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  H. K. Verma,et al.  A Comparative study of optimization techniques for optimal reconfiguration of distribution network , 2017 .

[17]  Nicholas E. Horelik,et al.  Domain decomposition for Monte Carlo particle transport simulations of nuclear reactors , 2015 .

[18]  Adriana Iamnitchi,et al.  A Survey of Socially Aware Peer-to-Peer Systems , 2016, ACM Comput. Surv..

[19]  Temitope Mapayi,et al.  Multi Ant LA: An adaptive multi agent resource discovery for peer to peer grid systems , 2015, 2015 Science and Information Conference (SAI).

[20]  Sumit Kumar,et al.  A theoretical and detail approach on grid computing a review on grid computing applications , 2017, 2017 8th Annual Industrial Automation and Electromechanical Engineering Conference (IEMECON).

[21]  David R. Karger,et al.  INS/Twine: A Scalable Peer-to-Peer Architecture for Intentional Resource Discovery , 2002, Pervasive.

[22]  Jin Xu,et al.  Chemical Reaction Optimization for Task Scheduling in Grid Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[23]  Aurelien Bouteiller,et al.  PMIx: process management for exascale environments , 2017, EuroMPI/USA.

[24]  Elisa Bertino,et al.  Distributed Intelligence: Trends in the Management of Complex Systems , 2017, SACMAT.

[25]  Inderveer Chana,et al.  QRSF: QoS-aware resource scheduling framework in cloud computing , 2014, The Journal of Supercomputing.

[26]  Brian J. N. Wylie,et al.  Extreme-scaling applications en route to exascale , 2016, EASC.

[27]  Ehsan Mousavi Khaneghah,et al.  The Influence of Exascale on Resource Discovery and Defining an Indicator , 2018 .

[28]  Seyyed Mohsen Hashemi,et al.  Cloud Computing Vs . Grid Computing , 2012 .

[29]  Lucio Grandinetti,et al.  Adaptive Load Balancing Dashboard in Dynamic Distributed Systems , 2017, Supercomput. Front. Innov..

[30]  Elkin Garcia,et al.  TIDeFlow: The Time Iterated Dependency Flow Execution Model , 2011, 2011 First Workshop on Data-Flow Execution Models for Extreme Scale Computing.

[31]  Victor V. Toporkov,et al.  Scheduling Optimization in Grid with VO Stakeholders' Preferences , 2016, IDC.

[32]  Mohsen Sharifi,et al.  Process Management Reviewed , 2011 .

[33]  Rui L. Aguiar,et al.  ElCore: Dynamic elastic resource management and discovery for future large-scale manycore enabled distributed systems , 2016, Microprocess. Microsystems.

[34]  B. Bazli,et al.  Secure, efficient and privacy-aware framework for unstructured peer-to-peer networks , 2016 .

[35]  S.L. Mirtaheri,et al.  A Case for Kernel Level Implementation of Inter Process Communication Mechanisms , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[36]  Behrouz Minaei-Bidgoli,et al.  Four-dimensional model for describing the status of peers in peer-to-peer distributed systems , 2013 .

[37]  Rajiv Ranjan,et al.  Peer-to-Peer Cloud Provisioning: Service Discovery and Load-Balancing , 2009, Cloud Computing.

[38]  M. Hemamalini,et al.  Review on Grid Task Scheduling in Distributed Heterogeneous Environment , 2012 .

[39]  Mohsen Sharifi,et al.  Improving Learning-Based Request Forwarding in Resource Discovery through Load-Awareness , 2011, Globe.

[40]  Laurent Lefèvre,et al.  Introduction to special issue on sustainable computing for ultrascale computing , 2018, Sustain. Comput. Informatics Syst..

[41]  Dong-Oh Kim,et al.  Adaptive metadata rebalance in exascale file system , 2017, The Journal of Supercomputing.

[42]  Gary Shueng Han Chan,et al.  Unstructured Peer-to-Peer Network Architectures , 2010 .

[43]  Albert Y. Zomaya,et al.  Survey on Grid Resource Allocation Mechanisms , 2014, Journal of Grid Computing.

[44]  Xiaomin Zhu,et al.  Optimization in distributed information systems , 2018, J. Comput. Sci..

[45]  Seyedeh Leili Mirtaheri,et al.  Formulating the real cost of DSM-inherent dependent parameters in HPC clusters , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[46]  John Shalf,et al.  Exascale Computing Technology Challenges , 2010, VECPAR.

[47]  H. V. Raghu,et al.  Self-adaptive power management framework for high performance computing , 2017, 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[48]  Abdul Samad Ismail,et al.  OPTIMIZED QUERY FORWARDING FOR RESOURCE DISCOVERY IN UNSTRUCTURED PEER-TO-PEER GRIDS , 2012, Cybern. Syst..

[49]  Ahmad Habibizad Navin,et al.  Resource discovery mechanisms in grid systems: A survey , 2014, J. Netw. Comput. Appl..

[50]  M. Sharifi,et al.  VCE: A New Personated Virtual Cluster Engine for Cluster Computing , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[51]  Abdelkader Hameurlain,et al.  Grid Resource Discovery Based on Centralized and Hierarchical Architectures , 2010 .

[52]  Luis M. Camarinha-Matos,et al.  Collaborative smart grids – A survey on trends , 2016 .

[53]  Shan Lu,et al.  ScaleCheck: A Single-Machine Approach for Discovering Scalability Bugs in Large Distributed Systems , 2019, FAST.

[54]  Xiao Chen,et al.  Distributed System Design , 2000, Scalable Comput. Pract. Exp..

[55]  Ehsan Mousavi Khaneghah,et al.  CHALLENGES OF RESOURCE DISCOVERY TO SUPPORT DISTRIBUTED EXASCALE COMPUTING ENVIRONMENT , 2018 .

[56]  Ehsan Mousavi Khaneghah,et al.  A mathematical multi-dimensional mechanism to improve process migration efficiency in peer-to-peer computing environments , 2018 .

[57]  Prashant Kumar,et al.  Optimal Design Configuration Using HOMER , 2016 .

[58]  Mohsen Sharifi,et al.  AMRC: an algebraic model for reconfiguration of high performance cluster computing systems at runtime , 2013, The Journal of Supercomputing.

[59]  Yang Wang,et al.  Evaluating Scalability Bottlenecks by Workload Extrapolation , 2018, 2018 IEEE 26th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS).

[60]  Mohsen Sharifi,et al.  A Dynamic Popularity-Aware Load Balancing Algorithm for Structured P2P Systems , 2012, NPC.