State-based predictions with self-correction on Enterprise Desktop Grid environments
MetadataShow full item record
The abundant computing resources in current organizations provide new opportunities for executing parallel scientific applications and using resources. The Enterprise Desktop Grid Computing (EDGC) paradigm addresses the potential for harvesting the idle computing resources of an organization’s desktop PCs
to support the execution of the company’s large-scale applications. In these environments, the accuracy of response-time predictions is essential for effective metascheduling that maximizes resource usage without harming the performance of the parallel and local applications. However, this accuracy is a major challenge due to the heterogeneity and non-dedicated nature of EDGC resources. In this paper, two new prediction techniques are presented based on the state of resources. A thorough analysis by linear regression demonstrated that the proposed techniques capture the real behavior of the parallel applications better than other common techniques in the literature. Moreover, it is possible to reduce deviations with a proper modeling of prediction errors, and thus, a Self-adjustable Correction method (SAC) for detecting and correcting the prediction deviations was proposed with the ability to adapt to the changes in load conditions. An extensive evaluation in a real environment was conducted to validate the SAC method. The results show that the use of SAC increases the accuracy of response-time predictions by 35%. The cost of predictions with self-correction and its accuracy in a real environment was analyzed using a combination of the proposed techniques. The results demonstrate that the cost of predictions is negligible and the combined use of the prediction techniques is preferable.
Is part ofJournal of Parallel and Distributed Computing, 2013, vol. 73, núm. 6, p. 777-789
Showing items related by title, author, creator and subject.
Torchinsky, Matias; Hanzich, Mauricio; Hernández Budé, Porfidio; Luque, Emilio; Giné, Francesc; Solsona Tehàs, Francesc; Lérida Monsó, Josep Lluís (Iberoamerican Science & Technology Education Consortium, 2007)In this work, we present an integral scheduling system for non-dedicated clusters, termed CISNE-P, which ensures the performance required by the local applications, while simultaneously allocating cluster resources to ...
Hanzich, Mauricio; Hernández Budé, Porfidio; Giné, Francesc; Solsona Tehàs, Francesc; Lérida Monsó, Josep Lluís (Springer Verlag, 2011)This paper proposes a prediction engine designed for non-dedicated clusters, which is able to estimate the turnaround time for parallel applications, even in the presence of serial workload of the workstation owner. The ...
Lérida Monsó, Josep Lluís; Solsona Tehàs, Francesc; Giné, Francesc; García, J. R.; Hanzich, Mauricio; Hernández Budé, Porfidio (Springer Verlag, 2008)In this paper, we present a scheduling scheme to estimate the turnaround time of parallel jobs on a heterogeneous and non-dedicated cluster or NoW(Network of Workstations). This scheme is based on an ...