Language-integrated provenance

Abstract

When referring to this work, full bibliographic details including the author, title, awarding institution and date of the thesis must be given.My thanks, first and foremost, to my advisor James Cheney for his generous guidance, encouragement, and unyielding support. I have left every single one of our meetings happier and more confident than I entered it, even and especially when things had gone poorly. I would also like to thank Peter Buneman, Ian Stark, James McKinna, and Jan Stolarek for their interest and feedback. I would like to thank Torsten Grust and Sam Lindley for agreeing to be my examiners and their feedback, and Stephen Gilmore for chairing my viva.Thanks to my awesome office mates Karoliina, Fabian, Ricardo, and Rudi; to the Friday lunch crowd Brian,

PUG: A Framework and Practical Implementation for Why & Why-Not Provenance (extended version)

“…We mainly evaluate three aspects; 1) we compare our approach for computing explanations (Expl) with the approach introduced for provenance games [24]. We call the provenance game approach Direct Method (DM), because it directly constructs the full provenance graph; 2) we compare our approach for Lineage (Expl Which(X) ) to the language-integrated approach developed for the Links programming language [9]; 3) we evaluate the performance impact of rewriting queries to produce fac- CUSTOMER(G, H, I, N, J, K, L, M ) Fig. 14: DBLP and TPC-H queries for experiments torized provenance (Sec.…”

“…Contributions. This paper extends our previous work [25] in the following ways: we extend our model to support less informative, but more concise, provenance types; we extend our provenance model to support reverse reasoning [13] where the truth of some facts in the database is left undetermined; we demonstrate that our provenance graphs (explanations) are equivalent to provenance games [24] and how semiring provenance and its FO extension as presented in [37] can be extracted from our provenance model; we demonstrate how to rewrite an input program to generate a desirable (concise) factorization of provenance and evaluate the performance impact of this technique; finally, we present an experimental comparison with the language-integrated provenance techniques implemented in Links [9]. The remainder of this paper is organized as follows.…”

Scientific workflows: Past, present and future

“…Improved architectures will mitigate these effects, as described in one paper in this issue [18]. Improvements in theory underpinning workflow languages and systems, such as the work of Wadler 12 and Cheney [31], will become more essential as complexity and scale grow. It is to be hoped that relevant architectural and theoretical research will proceed in tandem.…”

Query Lifting

“…Most recently, language-integrated query has been extended further to support efficient execution of queries that construct nested results [25,8,21,53], by translating such queries to a bounded number of flat queries. This technique, currently implemented in Links and DSH, has several benefits: for example to implement provenance-tracking efficiently in queries [17,47]. Fowler et al [19] showed that in some cases, Links's support for nested query results decreased both the number of queries issued and the total query evaluation time by an order of magnitude or more compared to a Java database application.…”