MapReduce Operations with WS-VLAM Workflow Management System

Open Access
Authors
Publication date 2013
Journal Procedia Computer Science
Event 2013 International Conference on Computational Science
Volume | Issue number 18
Pages (from-to) 2599-2602
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Workflow management systems are widely used to solve scientific problems as they enable orchestration of remote and lo- cal services such as database queries, job submission and running an application. To extend the role that workflow systems play in data-intensive science, we propose a solution that integrates WMS and MapReduce model. In this paper, we discuss possible solution of combining MapReduce and workflow applications, we describe the implementation of chosen solution based on metaprogramming approach in Ruby programming language and evaluate it with an example of word count application.
Document type Article
Note Proceedings title: International Conference on Computational Science, ICCS 2013: Barcelona, Spain, June 5- June 7, 2013 Publisher: Elsevier Place of publication: Amsterdam Editors: V. Alexandrov, M. Lees, V. Krzhizhanovskaya, J. Dongarra, P.M.A. Sloot
Language English
Published at https://doi.org/10.1016/j.procs.2013.05.449
Downloads
397921 (Final published version)
Permalink to this page
Back