To trust findings in computational science, scientists need workflows that trace the data provenance and support results explainability. As workflows become more complex, tracing data provenance and explaining results become harder to achieve. In this paper, we propose a computational environment that automatically creates a workflow execution's record trail and invisibly attaches it to the workflow's output, enabling data traceability and results explainability. Our solution transforms existing container technology, includes tools for automatically annotating provenance metadata, and allows effective movement of data and metadata across the workflow execution. We demonstrate the capabilities of our environment with the study of SOMOSPIE, an earth science workflow. Through a suite of machine learning modeling techniques, this workflow predicts soil moisture values from the 27 km resolution satellite data down to higher resolutions necessary for policy making and precision agriculture. By running the workflow in our environment, we can identify the causes of different accuracy measurements for predicted soil moisture values in different resolutions of the input data and link different results to different machine learning methods used during the soil moisture downscaling, all without requiring scientists to know aspects of workflow design and implementation.
Soil moisture is an important parameter that regulates multiple ecosystem processes and provides important information for environmental management and policy decision-making. Spaceborne sensors provide soil moisture information over large areas, but information is commonly available at coarse resolution with spatial and temporal gaps. Here, we present a modular spatial inference framework to downscale satellite-derived soil moisture using terrain parameters and test the performance of two modeling methods (Kernel-Weighted K-Nearest Neighbor <KKNN> and Random Forest <RF>). We generate monthly and weekly gap-free spatial predictions on soil moisture at 1 km using data from the European Space Agency Climate Change Initiative (ESA-CCI; version 6.1) over two regions in the conterminous United States. RF was the method that performed better in cross-validation when comparing with the reference ESA-CCI data, but KKNN showed a slightly higher agreement with ground-truth information as part of independent validation. We postulate that more heterogeneous landscapes (i.e., high topographic variation) may be more challenging for downscaling and predicting soil moisture; therefore, moisture networks should increase monitoring efforts across these complex landscapes. Future opportunities for development of modular cyberinfrastructure tools for downscaling satellite-derived soil moisture are discussed.
Computational resources are increasingly provisioned to users through cloud-like interfaces. Both academic and commercial cloud offerings exist, but no single standardized interface for common actions such as configuration, launching, and termination of virtual resources exists. This imposes huge technical burden on domain scientist that attempt to take advantage of these resources; even expert users spend considerable time to port their applications from one cloud platform to another.With this work, we make available to the community a unified API toolkit as well as five in-depth reports on challenges we encountered working with different academic and commercial cloud providers. Our toolkit implements automations for common tasks such as simultaneous launching and termination of large numbers of virtual machines (VM) across the cloud. We demonstrate that our toolkit brings down the time users need to spend launching and terminating these resources to mere minutes, thus enabling ad-hoc multi-cloud clusters.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.