- Generating scientific documentation for computational experiments using provenance
- 5th International Provenance and Annotation Workshop
- Book/source title
- Provenance and Annotation of Data and Processes
- Book/source subtitle
- 5th International Provenance and Annotation Workshop, IPAW 2014, Cologne, Germany, June 9-13, 2014 : revised selected papers
- Pages (from-to)
- Cham: Springer
- ISBN (electronic)
- Lecture Notes in Computer Science: 0302-9743
- Volume (Serie)
- Document type
- Conference contribution
- Faculty of Science (FNWI)
- Informatics Institute (IVI)
lectronic notebooks are a common mechanism for scientists to document and investigate their work. With the advent of tools such as IPython Notebooks and Knitr, these notebooks allow code and data to be mixed together and published online. However, these approaches assume that all work is done in the same notebook environment. In this work, we look at generating notebook documentation from multi-environment workflows by using provenance represented in the W3C PROV model.
Specifically, using PROV generated from the Ducktape workflow system, we are able to generate IPython notebooks that include results tables, provenance visualizations as well as references to the software and datasets used. The notebooks are interactive and editable, so that the user can explore and analyze the results of the experiment without re-running the workflow.
We identify specific extensions to PROV necessary for facilitating documentation generation. To evaluate, we recreate the documentation website for a paper which won the Open Science Award at the ECML/PKDD 2013 machine learning conference. We show that the documentation produced automatically by our system provides more detail and greater experimental insight than the original hand-crafted documentation. Our approach bridges the gap between user friendly notebook documentation and provenance generated by distributed heterogeneous components.
- go to publisher's site
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.