A Data Broker for Distributed Computing Environments

Drummond, L. A.; Demmel, James; Mechoso, Carlos R.; Robinson, Harlo L.; Sklower, Keith; Spahr, Joseph A.

doi:10.1007/3-540-45545-0_13

Cited by 15 publications

(5 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other examples of climate model couplers are FMS (http://www.gfdl.noaa.gov/fms), the custom coupler in FOAM (Jacob et al, 2001), PALM (http://www.cerfacs.fr/globc/PALM_WEB) and FLUME (http://research.metoffice.gov.uk/research/ interproj/flume/). Other examples of coupling libraries are MCT (Larson et al, 2005), ESMF (Hill et al, 2004), and the Distributed Data Broker (Drummond et al, 2001).…”

Section: Introduction 11 Backgroundmentioning

confidence: 99%

A new flexible coupler for earth system modeling developed for CCSM4 and CESM1

Craig

Vertenstein

Jacob

2011

The International Journal of High Performance Computing Applica

227

161

View full text Add to dashboard Cite

The Community Climate System Model (CCSM) has been developed over the last decade, and it is used to understand past, present, and future climates. The latest versions of the model, CCSM4 and CESM1, contain totally new coupling capabilities in the CPL7 coupler that permit additional flexibility and extensibility to address the challenges involved in earth system modeling. The CPL7 coupling architecture takes a completely new approach with respect to the high-level design of the system. CCSM4 now contains a top-level driver that calls model component initialize, run, and finalize methods through specified interfaces. The top-level driver allows the model components to be placed on relatively arbitrary hardware processor layouts and run sequentially, concurrently, or mixed. Improvements have been made to the memory and performance scaling of the coupler to support much higher resolution configurations. CCSM4 scales better to higher processor counts, and has the ability to handle global resolutions up to one-tenth of a degree.

show abstract

Section: Introduction 11 Backgroundmentioning

confidence: 99%

A new flexible coupler for earth system modeling developed for CCSM4 and CESM1

Craig

Vertenstein

Jacob

2011

The International Journal of High Performance Computing Applica

227

161

View full text Add to dashboard Cite

show abstract

“…The Distributed Data Broker (DDB) project [8] also targets the problem of code coupling, but has a different approach than ours. DDB uses a central resource, i.e., a broker, to gather global information about the data distribution of the coupled applications, and to compute required communication schedules between the applications.…”

Section: Related Workmentioning

confidence: 99%

Plasma fusion code coupling using scalable I/O services and scientific workflows

Podhorszki

Klasky

Liu

et al. 2009

Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science

View full text Add to dashboard Cite

In order to understand the complex physics of mother nature, physicist often use many approximations to understand one area of physics and then write a simulation to reduce these equations to ones that can be solved on a computer. Different approximations lead to different equations that model different physics, which can often lead to a completely different simulation code. As computers become more powerful, scientists can either write one simulation that models all of the physics or they produce several codes each for different portions of the physics and then 'couple' these codes together. In this paper, we concentrate on the latter, where we look at our code coupling approach for modeling a full device fusion reactor. There are many approaches to code coupling. Our first approach was using Kepler workflows to loosely couple three codes via files (memory-to-disk-to-memory coupling). This paper describes our new approach moving towards using memory-to-memory data exchange to allow for a tighter coupling. Our approach focuses on a method which brings together scientific workflows along with staging I/O methods for code coupling. Staging methods use additional compute nodes to perform additional tasks such as data analysis, visualization, and NxM transfers for code coupling. In order to transparently allow application scientist to switch from memory to memory coupling to memory to disk to memory coupling, we have been developing a framework that can switch between these two I/O methods and then automate other workflow tasks. Our hybrid approach allows application scientist to easily switch between in-memory coupling and file-based coupling on-the-fly, which aids debugging these complex configurations.

show abstract

“…1995), the LANL POP Ocean General Circulation Model (OGCM) (Smith, Dukowicz, and Malone 1992), and the UC Berkeley/UCLA Distributed Data Broker (DDB) (Drummond et al 2001).…”

Section: The Ucla Coupled Climate Model and The Distributed Data Brokermentioning

confidence: 99%

A Component Architecture for High-Performance Scientific Computing

Allan

Armstrong²,

Bernholdt

et al. 2006

The International Journal of High Performance Computing Applica

177

View full text Add to dashboard Cite

The Common Component Architecture (CCA) provides a means for software developers to manage the complexity of large-scale scientific simulations and to move toward a plug-and-play environment for high-performance computing. In the scientific computing context, component models also promote collaboration using independently developed software, thereby allowing particular individuals or groups to focus on the aspects of greatest interest to them. The CCA supports parallel and distributed computing as well as local high-performance connections between components in a language-independent manner. The design places minimal requirements on components and thus facilitates the integration of existing code into the CCA environment. The CCA model imposes minimal overhead to minimize the impact on application performance. The focus on high performance distinguishes the CCA from most other component models. The CCA is being applied within an increasing range of disciplines, including combustion research, global climate simulation, and computational chemistry.

show abstract

A Data Broker for Distributed Computing Environments

Cited by 15 publications

References 3 publications

A new flexible coupler for earth system modeling developed for CCSM4 and CESM1

A new flexible coupler for earth system modeling developed for CCSM4 and CESM1

Plasma fusion code coupling using scalable I/O services and scientific workflows

A Component Architecture for High-Performance Scientific Computing

Contact Info

Product

Resources

About