High Performance Computing

As heterogeneous systems become more ubiquitous, computer architects will need to develop new CPU scheduling approaches capable of exploiting the diversity of computational resources. Advances in deep learning have unlocked an exceptional opportunity of using these techniques for estimating system performance. However, as of yet no significant leaps have been taken in applying deep learning for scheduling on heterogeneous systems. In this paper we describe a scheduling model that decouples thread selection and mapping routines. We use a conventional scheduler to select threads for execution and propose a deep learning mapper to map the threads onto a heterogeneous hardware. The validation of our preliminary study shows how a simple deep learning based mapper can effectively improve system performance for state-of-the-art schedulers by 8%–30% for CPU and memory intensive applications.

[1]  Weisong Shi,et al.  Edge Computing: Vision and Challenges , 2016, IEEE Internet of Things Journal.

[2]  Javier Navaridas,et al.  Effects of Job and Task Placement on Parallel Scientific Applications Performance , 2009, 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[3]  Martin Dräxler,et al.  MaxiNet: Distributed emulation of software-defined networks , 2014, 2014 IFIP Networking Conference.

[4]  Lin Ma,et al.  HomeCloud: An edge cloud framework and testbed for new application delivery , 2016, 2016 23rd International Conference on Telecommunications (ICT).

[5]  Marta Mattoso,et al.  Exploring provenance in high performance scientific computing , 2011, HPCDB '11.

[6]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[7]  Sam Ruby,et al.  RESTful Web Services , 2007 .

[8]  A. Townsend Peterson,et al.  Ecological Niche Modeling Using the Kepler Workflow System , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[9]  Christina Freytag,et al.  Using Mpi Portable Parallel Programming With The Message Passing Interface , 2016 .

[10]  Robert B. Ross,et al.  Using MPI-2: Advanced Features of the Message Passing Interface , 2003, CLUSTER.

[11]  Guillaume Mercier,et al.  Towards an Efficient Process Placement Policy for MPI Applications in Multicore Environments , 2009, PVM/MPI.

[12]  Arnaud Legrand,et al.  Simulating MPI Applications: The SMPI Approach , 2017, IEEE Transactions on Parallel and Distributed Systems.

[13]  Henri Casanova,et al.  Versatile, scalable, and accurate simulation of distributed applications and platforms , 2014, J. Parallel Distributed Comput..

[14]  Winfried Lamersdorf,et al.  CloudAware: A Context-Adaptive Middleware for Mobile Edge and Cloud Computing Applications , 2016, 2016 IEEE 1st International Workshops on Foundations and Applications of Self* Systems (FAS*W).

[15]  Pasquale Pagano,et al.  Supporting Biodiversity Studies by the EUBrazilOpenBio Hybrid Data Infrastructure , 2013 .

[16]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[17]  Nirwan Ansari,et al.  EdgeIoT: Mobile Edge Computing for the Internet of Things , 2016, IEEE Communications Magazine.

[18]  Vitaly Klyuev,et al.  Concurrency in Go and Java: Performance analysis , 2014, 2014 4th IEEE International Conference on Information Science and Technology.

[19]  John Kubiatowicz,et al.  Trash Day: Coordinating Garbage Collection in Distributed Systems , 2015, HotOS.

[20]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[21]  Hyeonwoo Kim,et al.  Correlation analysis of MQTT loss and delay according to QoS level , 2013, The International Conference on Information Networking 2013 (ICOIN).

[22]  David H. Bailey,et al.  The Nas Parallel Benchmarks , 1991, Int. J. High Perform. Comput. Appl..

[23]  Peng Liu,et al.  ParaDrop: Enabling Lightweight Multi-tenancy at the Network’s Extreme Edge , 2016, 2016 IEEE/ACM Symposium on Edge Computing (SEC).

[24]  Marta Mattoso,et al.  Integrating Scientific Workflows with Scientific Gateways: A Bioinformatics Experiment in the Brazilian National High-Performance Computing Network , 2020 .

[25]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[26]  Daniel S. Katz,et al.  Swift: A language for distributed parallel scripting , 2011, Parallel Comput..

[27]  Philippe Olivier Alexandre Navaux,et al.  High Performance Computing in the cloud: Deployment, performance and cost efficiency , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[28]  Pasquale Pagano,et al.  Species distribution modeling in the cloud , 2016, Concurr. Comput. Pract. Exp..

[29]  Reynold Xin,et al.  SparkR: Scaling R Programs with Spark , 2016, SIGMOD Conference.

[30]  Luiz M. R. Gadelha,et al.  HPSW-Prof : A Provenance-Based Framework for Profiling High Performance Scientific Workflows , 2016 .

[31]  Xiaoping Ma,et al.  Performance evaluation of MQTT and CoAP via a common middleware , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[32]  B. Brandfass,et al.  Rank reordering for MPI communication optimization , 2013 .

[33]  Alexey L. Lastovetsky,et al.  Two Algorithms of Irregular Scatter/Gather Operations for Heterogeneous Platforms , 2010, EuroMPI.

[34]  Reynold Xin,et al.  Scaling Spark in the Real World: Performance and Usability , 2015, Proc. VLDB Endow..

[35]  David Koop,et al.  VisTrails SAHM: visualization and workflow management for species habitat modeling , 2013 .

[36]  David Koop,et al.  Data Management Challenges in Species Distribution Modeling , 2013, IEEE Data Eng. Bull..

[37]  Pasquale Pagano,et al.  An infrastructure-oriented approach for supporting biodiversity research , 2015, Ecol. Informatics.

[38]  Roberto Peon,et al.  HPACK: Header Compression for HTTP/2 , 2015, RFC.

[39]  Nick McKeown,et al.  A network in a laptop: rapid prototyping for software-defined networks , 2010, Hotnets-IX.

[40]  S. Hemminger Network Emulation with NetEm , 2022 .

[41]  Marios M. Polycarpou,et al.  Short Term Electric Load Forecasting: A Tutorial , 2007, Trends in Neural Computation.