Contextual linking between workflow provenance and system performance logs
| Authors |
|
|---|---|
| Publication date | 2019 |
| Book title | IEEE 15th International Conference on eScience |
| Book subtitle | proceedings : 24-27 September 2019, San Diego, California |
| ISBN |
|
| ISBN (electronic) |
|
| Event | 15th IEEE International Conference on eScience, eScience 2019 |
| Pages (from-to) | 634-635 |
| Number of pages | 2 |
| Publisher | Los Alamitos, California: IEEE Computer Society |
| Organisations |
|
| Abstract |
When executing scientific workflows, anomalies of the workflow behavior are often caused by different issues such as resource failures at the underlying infrastructure. The provenance information collected by workflow management systems only captures the transformation of data at the workflow level. Analyzing provenance information and apposite system metrics requires expertise and manual effort. Moreover, it is often timeconsuming to aggregate this information and correlate events occurring at different levels of the infrastructure. In this paper, we propose an architecture to automate the integration among workflow provenance information and performance information from the infrastructure level. Our architecture enables workflow developers or domain scientists to effectively browse workflow execution information together with the system metrics, and analyze contextual information for possible anomalies. |
| Document type | Conference contribution |
| Language | English |
| Published at | https://doi.org/10.1109/eScience.2019.00093 |
| Published at | https://zenodo.org/record/3462820 |
| Other links | http://www.proceedings.com/53619.html https://www.scopus.com/pages/publications/85083195949 |
| Downloads |
2019.conference.escience-poster-1.provenance.camera
(Accepted author manuscript)
|
| Permalink to this page | |
