A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows

Wang, Liqiang; Lu, Shiyong; Fei, Xubo; Ram, Jeffrey L.

doi:10.1007/978-3-540-72588-6_42

Cited by 2 publications

(1 citation statement)

References 11 publications

(20 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This paper extends our previous work [45] by supporting hierarchical workflows and rounds, and providing descriptions of our provenance ontology, inference rules for various provenance graph derivation, and visualization of provenance.…”

Section: Related Workmentioning

confidence: 91%

Atomicity and provenance support for pipelined scientific workflows

Wang

Fei

et al. 2009

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

Section: Related Workmentioning

confidence: 91%

Atomicity and provenance support for pipelined scientific workflows

Wang

Fei

et al. 2009

Future Generation Computer Systems

Self Cite

View full text Add to dashboard Cite

The Foundations for Provenance on the Web

Moreau¹

2010

View full text Add to dashboard Cite

Provenance, i.e., the origin or source of something, is becoming an important concern, since it offers the means to verify data products, to infer their quality, to analyse the processes that led to them, and to decide whether they can be trusted. For instance, provenance enables the reproducibility of scientific results; provenance is necessary to track attribution and credit in curated databases; and, it is essential for reasoners to make trust judgements about the information they use over the Semantic Web. As the Web allows information sharing, discovery, aggregation, filtering and flow in an unprecedented manner, it also becomes very difficult to identify, reliably, the original source that produced an information item on the Web. Since the emerging use of provenance in niche applications is undoubtedly demonstrating the benefits of provenance, we contend that provenance can and should reliably be tracked and exploited on the Web, and we survey the necessary foundations to achieve such a vision. Using multiple data sources, we have compiled the largest bibliographical database on provenance so far. This large corpus allows us to analyse emerging trends in the research community. Specifically, using the CiteSpace tool, we identify clusters of papers that constitute research fronts, from which we derive characteristics that we use to structure our foundational framework for provenance on the Web. We note that such an endeavour requires a multidisciplinary approach, since it requires contributions from many computer science sub-disciplines, but also other non-technical fields given the human challenge that is anticipated. To develop our vision, it is necessary to provide a definition of provenance that applies to the Web context. Our conceptual definition of provenance is expressed in terms of processes, and is shown to generalise various definitions of provenance commonly encountered. Furthermore, by bringing realistic distributed systems assumptions, we refine our definition as a query over assertions made by processes. Given that the majority of work on provenance has been undertaken by the database, workflow and e-science communities, we review some of their work, contrasting approaches, and focusing on important topics we believe to be crucial for bringing provenance to the Web, such as abstraction, collections, storage, queries, workflow evolution, semantics and activities involving human interactions. However, provenance approaches developed in the context of databases and workflows essentially deal with closed systems. By that, we mean that workflow or database management systems are in full control of the data they manage, and track their provenance within their own scope, but not beyond. In the context of the Web, a broader approach is required by which chunks of provenance representation can be brought together to describe the provenance of information flowing across multiple systems. This is the specific purpose of the Open Provenance Vision, which is an approach that consists of controlled vocabula...

show abstract

A Dataflow-Oriented Atomicity and Provenance System for Pipelined Scientific Workflows

Cited by 2 publications

References 11 publications

Atomicity and provenance support for pipelined scientific workflows

Atomicity and provenance support for pipelined scientific workflows

The Foundations for Provenance on the Web

Contact Info

Product

Resources

About