Orchestrating Complex Application Architectures in Heterogeneous Clouds

Caballer, Miguel; Zala, Sahdev; García, Álvaro López; Moltó, Germán; Fernández, Pablo Orviz; Velten, Mathieu

doi:10.1007/s10723-017-9418-y

Cited by 36 publications

(25 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It also provides them with an access token which is then used to authorize services to act on the users' behalf. The PaaS Orchestrator and IM [11] are responsible to take care of the users' requests (in form of a TOSCA [12] template) and to prepare a cluster for containers orchestration over the IaaS. DODAS relies on Mesos for resource management and Marathon [13] for the container orchestration.…”

Section: Dodas Architectural Pillarsmentioning

confidence: 99%

Exploiting private and commercial clouds to generate on-demand CMS computing facilities with DODAS

et al. 2019

View full text Add to dashboard Cite

Minimising time and cost is key to exploit private or commercial clouds. This can be achieved by increasing setup and operational efficiencies. The success and sustainability are thus obtained reducing the learning curve, as well as the operational cost of managing community-specific services running on distributed environments. The greater beneficiaries of this approach are communities willing to exploit opportunistic cloud resources. DODAS builds on several EOSC-hub services developed by the INDIGO-DataCloud project and allows to instantiate on-demand container-based clusters. These execute software applications to benefit of potentially “any cloud provider”, generating sites on demand with almost zero effort. DODAS provides ready-to-use solutions to implement a “Batch System as a Service” as well as a BigData platform for a “Machine Learning as a Service”, offering a high level of customization to integrate specific scenarios. A description of the DODAS architecture will be given, including the CMS integration strategy adopted to connect it with the experiment’s HTCondor Global Pool. Performance and scalability results of DODAS-generated tiers processing real CMS analysis jobs will be presented. The Instituto de Física de Cantabria and Imperial College London use cases will be sketched. Finally a high level strategy overview for optimizing data ingestion in DODAS will be described.

show abstract

Section: Dodas Architectural Pillarsmentioning

confidence: 99%

Exploiting private and commercial clouds to generate on-demand CMS computing facilities with DODAS

et al. 2019

View full text Add to dashboard Cite

show abstract

“…In this regard we have not only supported those standards at the corresponding architectural levels [19,20], but also we made important contributions to both the standards specifications and implementations. INDIGO has contributed to the networking parts of the OCCI standard, as well as to the improvement of the TOSCA support in the upstream OpenStack components: the Heat Translator and TOSCA parser [21]. Our solution makes the execution of dynamic workflows [22][23][24] possible, in a more consistent way across hybrid Clouds [25].…”

Section: Context and State Of The Artmentioning

confidence: 99%

“…Among the features demanded by the use cases there are High-performance data access, migration and replica management. Supporting such features requires at the user level a flexible security framework based on tokens and Access Control Lists INDIGO has invested a substantial effort in the development of Onedata, 21 which is a global data management system aiming to provide easy access to distributed storage resources. The main goal is supporting a wide range of use cases from personal data management to data-intensive scientific computations.…”

Section: Data Management Servicesmentioning

confidence: 99%

INDIGO-DataCloud: a Platform to Facilitate Seamless Access to E-Infrastructures

et al. 2018

View full text Add to dashboard Cite

This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications.

show abstract

“…Under this umbrella, the prototype approach proposed in [25] realizes TOSCA based on standards-based manner. Caballer et al [26] propose an orchestration model that can be used with open-source software like OpenStack or hybrid infrastructures and leverages TOSCA as a standard modelling language. Zimmermann et al [27] propose a tool to automate the provisioning and do the integration of an Analytic tool to process production steps, overall of the manufacturing processes in industrial Environments using TOSCA.…”

Section: Other Related Initiatives and Workmentioning

confidence: 99%

Orchestration Architecture for Automatic Deployment of 5G Services from Bare Metal in Mobile Edge Computing Infrastructure

Chirivella‐Perez¹,

Calero²,

Wang³

et al. 2018

Wireless Communications and Mobile Computing

View full text Add to dashboard Cite

The progress in realizing the Fifth Generation (5G) mobile networks has been accelerated recently towards deploying 5G prototypes with increasing scale. One of the Key Performance Indicators (KPIs) in 5G deployments is the service deployment time, which should be substantially reduced from the current 90 hours to the target 90 minutes on average as defined by the 5G Public-Private Partnership (5G-PPP). To achieve this challenging KPI, highly automated and coordinated operations are required for the 5G network management. This paper addresses this challenge by designing and prototyping a novel 5G service deployment orchestration architecture that is capable of automating and coordinating a series of complicated operations across physical infrastructure, virtual infrastructure, and service layers over a distributed mobile edge computing paradigm, in an integrated manner. Empirical results demonstrate the superior performance achieved, which meets the 5G-PPP KPI even in the most challenging scenario where 5G services are installed from bare metal.

show abstract

Orchestrating Complex Application Architectures in Heterogeneous Clouds

Cited by 36 publications

References 32 publications

Exploiting private and commercial clouds to generate on-demand CMS computing facilities with DODAS

Exploiting private and commercial clouds to generate on-demand CMS computing facilities with DODAS

INDIGO-DataCloud: a Platform to Facilitate Seamless Access to E-Infrastructures

Orchestration Architecture for Automatic Deployment of 5G Services from Bare Metal in Mobile Edge Computing Infrastructure

Contact Info

Product

Resources

About