Execution time estimation for workflow scheduling

Authors
Publication date 2014
Book title Proceedings of WORKS 2014
Book subtitle the 9th Workshop on Workflows in Support of Large-Scale Science : November 16, 2014 : held in conjunction with SC14: The International Conference for High Performance Computing, Networking, Storage and Analysis : New Orleans, Louisiana, November 16-21, 2014
ISBN
  • 9781479971619
ISBN (electronic)
  • 9781479970674
Event 9th Workshop on Workflows in Support of Large-Scale Science
Pages (from-to) 1-10
Number of pages 10
Publisher Piscataway, NJ: IEEE Press
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Estimation of the execution time is an important part of the workflow scheduling problem. The aim of this paper is to highlight common problems in estimating the workflow execution time and propose a solution that takes into account the complexity and the randomness of the workflow components and their runtime. The solution proposed in this paper addresses the problems at different levels from task to workflow, including the error measurement and the theory behind the estimation algorithm. The proposed estimation algorithm can be integrated easily into a wide class of schedulers as a separate module. We use a dual stochastic representation, characteristic / distribution functions, in order to combine tasks' estimates into the overall workflow makespan. Additionally, we propose the workflow reductions - the operations on a workflow graph that do not decrease the accuracy of the estimates, but simplify the graph structure, hence increasing the performance of the algorithm.
Document type Conference contribution
Language English
Related publication Execution time estimation for workflow scheduling
Published at https://doi.org/10.1109/WORKS.2014.11
Other links https://www.proceedings.com/25264.html https://www.scopus.com/pages/publications/84988305202
Permalink to this page
Back