System Restore in a Multi-cloud Data Pipeline Platform

Wang, Long; Ramasamy, HariGovind V.; Salapura, Valentina; Arnold, Robin; Wang, Xu; Bakthavachalam, Senthil; Coulthard, Phil; Suprenant, Lee; Timm, John T. E.; Ricard, Denis; Harper, Richard; Gupta, Ahut

doi:10.1109/dsn-industry.2019.00012

Cited by 3 publications

(1 citation statement)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This may occur due to the lack of platform-specific expertise and data mishandling in the public cloud. Another research challenge in handling the data in a multi-cloud data pipeline platform is the recovery of the data from its failure, as this involves different storage units from different cloud providers, as discussed in [17]. Another reason that makes this research challenge more complex is due to the diverse backup and recovery services provided by multiple cloud platforms and the lack of co-operations between those services.…”

Section: Data Pipeline-based Cloud Applicationsmentioning

confidence: 99%

TOSCAdata: Modelling data pipeline applications in TOSCA

Dehury,

Jakovits,

Srirama

et al. 2021

Preprint

View full text Add to dashboard Cite

The serverless platform allows a customer to effectively use cloud resources and pay for the exact amount of used resources. A number of dedicated open source and commercial cloud data management tools are available to handle the massive amount of data. Such modern cloud data management tools are not enough matured to integrate the generic cloud application with the serverless platform due to the lack of mature and stable standards. One of the most popular and mature standards, TOSCA (Topology and Orchestration Specification for Cloud Applications), mainly focuses on application and service portability and automated management of the generic cloud application components. This paper proposes the extension of the TOSCA standard, TOSCAdata, that focuses on the modeling of data pipeline-based cloud applications. Keeping the requirements of modern data pipeline cloud applications, TOSCAdata provides a number of TOSCA models that are independently deployable, schedulable, scalable, and re-usable, while effectively handling the flow and transformation of data in a pipeline manner. We also demonstrate the applicability of proposed TOSCAdata models by taking a web-based cloud application in the context of tourism promotion as a use case scenario.

show abstract

Section: Data Pipeline-based Cloud Applicationsmentioning

confidence: 99%