Workflow as a service: an approach to workflow farming

Authors
Publication date 2012
Book title Proceedings of the 21st international symposium on high-performance parallel and distributed computing & co-located workshops: ECMLS'12: June 18-22, 2012, Delft, the Netherlands
ISBN
  • 9781450313391
Event HPDC'12: international ACM symposium on high-performance parallel and distributed computing: 21 (Delft) : 2012.06.18-22
Pages (from-to) 23-31
Publisher New York: ACM
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Task farming is often used to enable parameter sweep for exploration of large sets of initial conditions for large scale complex simulations. Available solutions enable to perform parameter sweep by creating multiple grid job submissions with different parameters. This paper presents an approach to farm grid workflows with a web service based workflow management system, called WS-VLAM, which provides ways to create, control and monitor workflows applications and their components. An approach to balance the workload between the workflow instances and to collect provenance data at both system and workflow levels is also discussed. Finally, an experimental evaluation of the presented solution is performed with a biomedical application for which 3000 simulations were required to perform a Monte-Carlo study.
Document type Conference contribution
Language English
Published at https://doi.org/10.1145/2483954.2483960
Permalink to this page
Back