The NorduGrid Architecture and Middleware for Scientific Applications

Smirnova, O.; Eerola, P.; Ekelöf, T.; Ellert, M.; Hansen, J. R.; Константинов, Александр; Kónya, B.; Nielsen, Johan; Ould-Saada, F.; Wäänänen, A.

doi:10.1007/3-540-44860-8_27

Cited by 20 publications

(15 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…SweGrid job submissions are currently performed using the Globus Toolkit or the NorduGrid job submission tools, interfacing cluster-level schedulers at the local sites. 14,15 Compute time on the SweGrid resources are allocated to research projects by the Swedish National Allocations Committee (SNAC), akin to the NRAC (National Resource Allocations Committee) in the US. Projects within the Swedish science community and with the appropriate needs and promising research may apply for SNAC allocations.…”

Section: Swegridmentioning

confidence: 99%

A Service-Oriented Approach to Enforce Grid Resource Allocations

Sandholm

Gardfjäll

Elmroth

et al. 2006

Int. J. Coop. Info. Syst.

View full text Add to dashboard Cite

We present the SweGrid Accounting System (SGAS) -a decentralized and standardsbased system for Grid resource allocation enforcement that has been developed with an emphasis on a uniform data model and easy integration into existing scheduling and workload management software.The system has been tested at the six high-performance computing centers comprising the SweGrid computational resource, and addresses the need for soft, real-time quota enforcement across the SweGrid clusters.The SGAS framework is based on state-of-the-art Web and Grid services technologies. The openness and ubiquity of Web services combined with the fine-grained resource control and cross-organizational security models of Grid services proved to be a perfect match for the SweGrid needs. Extensibility and customizability of policy implementations for the three different parties that the system serves (the user, the resource manager, and the allocation authority) are key design goals. Another goal is end-toend security and single sign-on, to allow resources to reserve allocations and charge for resource usage on behalf of the user.We conclude this paper by illustrating the policy customization capabilities of SGAS in a simulated setting, where job streams are shaped using different modes of allocation policy enforcement. Finally, we discuss some of the early experiences from the production system.

show abstract

Section: Swegridmentioning

confidence: 99%

A Service-Oriented Approach to Enforce Grid Resource Allocations

Sandholm

Gardfjäll

Elmroth

et al. 2006

Int. J. Coop. Info. Syst.

View full text Add to dashboard Cite

show abstract

“…POQSEC runs on top of existing Grid infrastructures, in particular the Swegrid computational infrastructure [37] and the NorduGrid resource management system [31] [41]. This puts certain restrictions on availability of computational resources and possibility to obtain them compared to systems such as distributed query processors Polar* [42] and LeSelect [5] that assume full control over all resources including computational resources, network management, etc.…”

Section: Related Workmentioning

confidence: 99%

“…We are developing a new kind of data manager and query processor, Parallel Object Query System for Expensive Computations (POQSEC) that utilizes the operational Grid infrastructure NorduGrid [41] and leverages the Globus I/O library [17] from the Globus Toolkit [14] for processing declarative queries that access data from storage elements and wrapped external systems on the Grid. POQSEC has support for customizable data representations, allows user-defined long-running distributed computations in queries, and can access conventional relational databases.…”

Section: Introductionmentioning

confidence: 99%

Managing Long Running Queries in Grid Environment

Fomkin

Risch

2004

On the Move to Meaningful Internet Systems 2004: OTM 2004 Workshops

View full text Add to dashboard Cite

Abstract. Exceptionally large amounts of both distributed data and computational resources are becoming available through the Grid. This will enable efficient exchange and processing of very large amounts of data combined with CPU intensive computations, as required by many scientific applications. We propose a customizable Grid-based query processor built on top of an established Grid infrastructure, NorduGrid. It allows users to submit queries wrapping user-defined long running operations that filter and transform distributed customized data. Limitations imposed by the used Grid infrastructure influence the architecture. For example, resource requirements have to be specified before Grid jobs are started and delays may occur based on the availability of required resources for a job. We are developing a fully functional prototype to investigate the viability of the approach and its applicability. Our first application area is Particle Physics where scientists analyze huge amount of data produced by a collider or simulators to identify particles.

show abstract

“…They usually rely on one of these middleware solutions [99,100,25,77] and use their functions to discover resources and submit user jobs. We can distinguish between service-based and non-service-based ones.…”

Section: Grid Middlewarementioning

confidence: 99%

“…There are several non-XML language descriptions, but the latest developments follow the XML syntax. It would be reasonable for the brokers to accept and use XML job descriptions, even if they access middleware solutions supporting different languages [99,92,25,77]. In this case they would need to translate the request, but this approach leads to better interoperability.…”

Section: Job Handlingmentioning

confidence: 99%

Meta-brokering solution for establishing Grid Interoperability

Kertész

View full text Add to dashboard Cite

The NorduGrid Architecture and Middleware for Scientific Applications

Cited by 20 publications

References 1 publication

A Service-Oriented Approach to Enforce Grid Resource Allocations

A Service-Oriented Approach to Enforce Grid Resource Allocations

Managing Long Running Queries in Grid Environment

Meta-brokering solution for establishing Grid Interoperability

Contact Info

Product

Resources

About