Applying Deep-Learning Techniques to Parallel Processes Scheduling within Heterogeneous Distributed Computational Environments
Data de publicació2018-09
Onrubia Palacios, Jordi Ricard
Universitat de Lleida. Escola Politècnica Superior
MetadadesMostra el registre d'unitat complet
Many companies, organizations and/or universities have accumulated a large number of computing resources grouped in clusters. Cluster Federated Environments arise as a new architecture to take advantage of such resources by joining them and increasing the computing capacity. With this, a new problem
appears, a high number of machines and computing resources implies a huge amount of energy consumption. The scheduling process, responsible for allocating the applications to the system resources, offers the possibility of improve the resource management increasing the system performance and energy efficiency. A considerably amount of research has been done in this field, but given the scheduling problem is classified as an NP problem it is difficult to determine which method is the best one for it. From the point of view of the artificial intelligence, the advances in hardware and the recent increasing research in this field and specifically in algorithms for deep learning, neural networks have become an essential tool for the research in other scopes such as pattern recognition, system identification or medical diagnosis. Even though some of those problems are too complex to get an optimal solution neural networks have demonstrated give a good enough solutions. In this Degrees Final Project (DFP) we will try to find if it is possible to use neural networks to find which is the best heuristic to allocate the applications arriving to the system, obtaining the best results in terms of time and energy consumption. To build the neural network we will make use of an open source library named Tensorflow developed by Google Brain Team and to execute the workloads with a variety of different techniques we will use ClusterGridSim, a Java application that simulates the allocation using the desired technique.
Els fitxers de llicència següents estan associats amb aquest element:
Mostrant elements relacionats per títol, autor i matèria.
Vilaplana Mayoral, Jordi; Mateo, Jordi; Teixidó Torrelles, Ivan; Solsona Tehàs, Francesc; Giné, Francesc; Roig Mateu, Concepció (Springer Verlag, 2015)This paper presents a power-aware scheduling policy algorithm of Virtual Machines into nodes called Green Cloud (GreenC) for Heterogeneous cloud systems. GreenC takes into account optimal assignments according to physical ...
Gabaldon Ponsa, Eloi; Guirado Fernández, Fernando; Planes Cid, Jordi (Springer, 2015)Scheduling and resource allocation to optimize performance criteria in multi-cluster heterogeneous environments is known as an NP-hard problem, not only for the resource heterogeneity, but also for the possibility of ...
Giné, Francesc; Solsona Tehàs, Francesc; Hanzich, Mauricio; Hernández Budé, Porfidio; Luque, Emilio (Springer Verlag, 2007)Implicit coscheduling techniques applied to non-dedicated homogeneous Networks Of Workstations (NOWs) have shown they can perform well when many local users compete with a single parallel job. Implicit coscheduling deals ...