A Strategy for Provenance Gathering in Distributed Scientific Workflows

Marinho, Anderson; Werner, Cláudia Maria Lima; Cruz, Sérgio Manuel Serra da; Mattoso, Marta; Braganholo, Vanessa; Murta, Leonardo

doi:10.1109/services-i.2009.53

Cited by 9 publications

(9 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Gomes [20] works with storage retrieval, and is also based on SWtMS. Marinho et al [21] and Coutinho et al [22] focus on the capture of provenance data in distributed environments. Our model was designed for storing and managing provenance data independent of any SWtMS (ad-hoc projects, for example).…”

Section: Related Workmentioning

confidence: 99%

Managing data provenance in genome project workflows

Paula

Holanda

Walter

et al. 2012

2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops

View full text Add to dashboard Cite

In this article, we propose the application of the PROV-DM model to manage data provenance for workflows designed to support genome projects. This provenance model aims at storing details of each execution of the workflow, which include raw and produced data, computational tools and versions, parameters, and so on. This way, biologists can review details of a particular workflow execution, compare information generated among different executions, and plan new ones more efficiently. In addition, we have created a provenance simulator to facilitate the inclusion of a provenance data model in genome projects. In order to validate our proposal, we discuss a case study of an RNA-Seq project that aims to identify, measure and compare RNA expression levels across liver and kidney RNA samples produced by highthroughput automatic sequencers.

show abstract

Section: Related Workmentioning

confidence: 99%

Managing data provenance in genome project workflows

Paula

Holanda

Walter

et al. 2012

2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops

View full text Add to dashboard Cite

show abstract

“…Regarding the activity adaptation problem, the adaptation is conducted indirectly by modifying the workflow specification and inserting new workflow activities to collect the provenance information [12]. According to the workflow activity specification (e.g., output and input ports and how they are connected to other activities), Provenance Gathering Activities (PGA) are created to intercept data consumed or produced by each activity port.…”

Section: Provenance Adaptermentioning

confidence: 99%

“…For this reason, the main goal of this paper is to introduce a novel approach for dealing with integrated provenance management in distributed and heterogeneous environments. In a previous work [12], we proposed a strategy for gathering provenance information in such environment. This strategy is independent of workflow system technology and addresses some of the previously discussed problems.…”

Section: Introductionmentioning

confidence: 99%

ProvManager: a provenance management system for scientific workflows

Marinho

Murta

Werner

et al. 2011

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

Running scientific workflows in distributed and heterogeneous environments has been a motivating approach for provenance management, which is loosely coupled to the workflow execution engine. This kind of approach is interesting because it allows both storage and access to provenance data in a homogeneous way, even in an environment where different workflow management systems work together. However, current approaches overload scientists with many ad hoc tasks, such as script adaptations and implementations of extra functionalities to provide provenance independence. This paper proposes ProvManager, a provenance management approach that eases the gathering, storage, and analysis of provenance information in a distributed and heterogeneous environment scenario, without putting the burden of adaptations on the scientist. ProvManager leverages the provenance management at the experiment level by integrating different workflow executions from multiple workflow management systems.

show abstract

“…(a) is divided into two subgraphs stored in two different provenance stores of the two domains representing participating organizations or security domains [36]. While some researchers have studied the problem of provenance capture for distributed scientific workflows [37], provenance management for collaborative scientific workflows, in which human collaboration and interaction are essential, has not been explored.…”

Section: Provenance Modelsmentioning

confidence: 99%

Collaborative scientific workflows supporting collaborative science

Zhang

2011

IJBPIM

View full text Add to dashboard Cite

Collaboration has become a dominant feature of modern science. Many scientific problems are beyond the realm of individual discipline or scientist to solve and hence require collaborative efforts. Meanwhile, today's science becomes increasingly more dataintensive, resulting in a rapid transition from computational science to e-Science (or digital science). Recently, scientific workflows have emerged for scientists to integrate distributed computations, datasets, and analysis tools to enable and accelerate scientific discovery. The convergence of the above two trends naturally leads to the concept of collaborative scientific workflows. This paper presents a disciplinary definition of this term, discusses the opportunities, requirements, and challenges of collaborative scientific workflows for the enablement of scientific collaboration, and concludes with our ongoing work in this direction.

show abstract

A Strategy for Provenance Gathering in Distributed Scientific Workflows

Cited by 9 publications

References 8 publications

Managing data provenance in genome project workflows

Managing data provenance in genome project workflows

ProvManager: a provenance management system for scientific workflows

Collaborative scientific workflows supporting collaborative science

Contact Info

Product

Resources

About