Parallel computing in heterogeneous machines based on the CPU donation approach

Several years ago, Moore law became irrelevant, and increasing the computing power in a single machine became more and more complicated and not practically efficient. Nowadays, the research is focusing more on parallel computing in all of its types and forms. In this paper, we propose a new architecture of computing based on the HDCS (distributed heterogeneous computing system) or the worker approach, where the computing is done in several machines of different natures connected to the same network and which can be even extended to cover the Internet as well. These machines are supposed to be used for other purposes and they are exploited to do some computing only when they are idle. This approach might be used for computing types, where the handled task can be divided into several independent tasks. This approach offers lots of benefits, and it can almost be 100% free. In our proposed research work, we performed practical tests to exercise this computing method which was applied specifically to the preprocessing stage that helps to resolve any classification problem. The proposed algorithm was able to run on five separate machines, which are a raspberry PI embedded system, two phones and two laptops. The final decision was taken by one of the five machines and the obtained empirical results were motivating and very satisfactory. In addition, we demonstrated the ability of this scheme to be extended to any number of machines, so that we can build a very powerful machine for free, in the case of CPU donation.

[1]  Tarun Biswas,et al.  Multi-level queue for task scheduling in heterogeneous distributed computing system , 2017, 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS).

[2]  Alexandre Yakovlev,et al.  Speedup and Parallelization Models for Energy-Efficient Many-Core Systems Using Performance Counters , 2017, 2017 International Conference on High Performance Computing & Simulation (HPCS).

[3]  Jega Anish Dev,et al.  Usage of botnets for high speed MD5 hash cracking , 2013, Third International Conference on Innovative Computing Technology (INTECH 2013).

[4]  David J. John,et al.  Parallel and Distributed Computing across the Computer Science Curriculum , 2014, 2014 IEEE International Parallel & Distributed Processing Symposium Workshops.

[5]  Siddharth Bhave,et al.  Embedded Middleware for Distributed Raspberry Pi Device to Enable Big Data Applications , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[6]  Thierry Rakotoarivelo,et al.  HPC Applications Deployment on Distributed Heterogeneous Computing Platforms via OMF, OML and P2PDC , 2014, 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[7]  Liu Yang,et al.  Schedule Dynamic Multiple Parallel Jobs with Precedence-Constrained Tasks on Heterogeneous Distributed Computing Systems , 2015, 2015 14th International Symposium on Parallel and Distributed Computing.

[8]  Mohammad Ali Maddah-Ali,et al.  Fundamental tradeoff between computation and communication in distributed computing , 2016, ISIT.

[9]  Yue Zhao,et al.  A Distributed Graph-Parallel Computing System with Lightweight Communication Overhead , 2016, IEEE Transactions on Big Data.