Previously, we developed our StreamComponents framework which uses distributed components and web services to facilitate control, reconfiguration and deployment of streams on both local clusters, and remote cloud infrastructure. Our stream evaluation semantics are fundamentally demand driven, a conservative view that ensures no unnecessary computation, supports flexible structures such as cyclic networks and infinite streams, and facilitates resource management.In this paper, we focus on the evaluation semantics of our stream model, and explore circumstances under which more eager evaluation is desirable, whilst retaining the fundamental semantics. We introduce the Indirected Asynchronous Method pattern (IAM), which makes novel use of futures and autocontinuations, to facilitate fully asynchronous demand propagation leading to more eager evaluation of the streams. We present an evaluation of the model on both cluster and cloud infrastructure showing that very useful amounts of pipelining parallelism can be achieved.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.