Sacbe: A building block approach for constructing efficient and flexible end-to-end cloud storage

Gonzalez-Compeán, J. L.; Sosa-Sosa, Víctor J.; Díaz-Pérez, Arturo; Carretero, Jesús; Yanez-Sierra, Jedidiah

doi:10.1016/j.jss.2017.10.004

Cited by 18 publications

(14 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The main advantages of our proposal with respect to the related work are: i) It allows the creation of policies for providing cloud storage solution with data availability that improves storage utilization and performance of the information sharing for CDS services based on virtual machines and containers; ii) Most of the related work have been tested in simulated scenarios, while our methodology was tested in a prototype of a semantic CDS service for an organizational scenario; iii) To the best of our knowledge, this work would be the first approach that provides an integrated load balancing, availability and reliability scheme based on the classification of users and content (topics) activity, which dynamically adapt the replication factor and distribution of contents in a semantic CDS service to improve the trade-off between I/O performance and cloud storage consumption; and iv) A complementary simulator and emulator based on our methodology is available to evaluate state-of-the-art availability policies and load balancing methods at different scales. Some aspects that were not considered in our proposal and are available in the related work are: i) The use of synchronization techniques on the end-user side that can potentially improve user experience [32], [34]; and ii) The use of Erasure Coding (EC) techniques to provide data confidentiality and improve storage consumption [19], [20], [35].…”

Section: Related Workmentioning

confidence: 99%

“…As a proof of concept, we deployed a Semantic Content Delivery and Sharing (S-CDS) service, an evolution of a content distribution and file sharing platform named SkyCDS [4], [35], which was implemented on a private cloud. We added our model to the Pub/Sub system of SkyCDS to classify users and content topics.…”

Section: Integration Of the Classification Model In A Semantic Cds Servicementioning

confidence: 99%

See 1 more Smart Citation

Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services

Sosa-Sosa¹,

Barron

Gonzalez-Compeán

et al. 2022

IEEE Trans. Cloud Comput.

Self Cite

View full text Add to dashboard Cite

Content delivery and sharing (CDS) is a popular and cost effective cloud-based service for organizations to deliver/share contents to/with end-users, partners and insider users. This type of service improves the data availability and I/O performance by producing and distributing replicas of shared contents. However, such a technique increases overhead on the storage/network resources. This paper introduces a threefold methodology to improve the trade-off between I/O performance and capacity utilization of cloud storage for CDS services. This methodology includes: i) Definition of a classification model for identifying types of users and contents by analyzing their consumption/ demand and sharing patterns, ii) Usage of the classification model for defining content availability and load balancing schemes, and iii) Integration of a dynamic availability scheme into a cloud-based CDS system. Our method was implemented on both a simulator and a real-world CDS service, supporting information sharing operations performed in a cloud storage. An experimental evaluation, conducted in a private cloud through simulation and emulation of workloads, showed the feasibility of this methodology in terms of storage capacity utilization, whereas the real-world implementation revealed the efficiency of applying a classification model to information sharing patterns in terms of I/O performance.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Integration Of the Classification Model In A Semantic Cds Servicementioning

confidence: 99%

Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services

Sosa-Sosa¹,

Barron

Gonzalez-Compeán

et al. 2022

IEEE Trans. Cloud Comput.

Self Cite

View full text Add to dashboard Cite

show abstract

“…In [10] [11] [12], there is a set of solutions for building efficient and flexible end-to-end cloud storage. Information integrity is preserved based on the IDA implementation embedded in parallel processing patterns.…”

Section: Related Workmentioning

confidence: 99%

“…(3,2) C 19 :(8,5) C 37 :(11,2) C 55 :(12,11) C 73 :(14,8) C 2 :(4,2) C 20 :(8,6) C 38 :(11,3) C 56 :(13,2) C 74 :(14,9) C 3 :(4,3)C21 :(8,7) C 39 :(11,4) C 57 :(13,3) C 75 :(14,10) C 4 :(5,2) C 22 :(9,2) C 40 :(11,5) C 58 :(13,4) C 76 :(14,11) C 5 :(5,3) C 23 :(9,3) C 41 :(11,6) C 59 :(13,5) C 77 :(14,12) C 6 :(5,4) C 24 :(9,4) C 42 :(11,7) C 60 :(13,6) C 78 :(14,13) C 7 :(6,2) C 25 :(9,5) C 43 :(11,8) C 61 :(13,7) C 79 :(15,2) C 8 :(6,3) C 26 :(9,6) C 44 :(11,9) C 62 :(13,8) C 80 :(15,3) C 9 :(6,4) C 27 :(9,7) C 45 :(11,10) C 63 :(13,9) C 81 :(15,4) C 10 :(6,5) C 28 :(9,8) C 46 :(12,2) C 64 :(13,10) C 82 :(15,5) C 11 :(7,2) C 29 :(10,2) C 47 :(12,3) C 65 :(13,11) C 83 :(15,6) C 12 :(7,3) C 30 :(10,3) C 48 :(12,4) C 66 :(13,12) C 84 :(15,7) C 13 :(7,4) C 31 :(10,4) C 49 :(12,5) C 67 :(14,2) C 85 :(15,8) C 14 :(7,5) C 32 :(10,5) C 50 :(12,6) C 68 :(14,3) C 86 :(15,9) C 15 :(7,6) C 33 :(10,6) C 51 :(12,7) C 69 :(14,4) C 87 :(15,10) C 16 :(8,2) C 34 :(10,7) C 52 :(12,8) C 70 :(14,5) C 88 :(15,11) C 17 :(8,3) C 35 :(10,8) C 53 :(12,9) C 71 :(14,6) C 89 :(15,12) C 18 :(8,4) C 36 :(10,9) C 54 :(12,10) C 72 :(14,7) C 90 :(15…”

mentioning

confidence: 99%

On the Complexity and Performance of the Information Dispersal Algorithm

et al. 2020

View full text Add to dashboard Cite

The Information Dispersal Algorithm (IDA) has become a key component in several faulttolerant massive storage systems. From a theoretical point of view, it is a linear transformation over a finite field on the vectors that make up a given file. Direct transformation adds redundancy, splitting the initial file into a new set of files called dispersals. The inverse transformation recovers the original file from a subset of dispersals. This piece of research demonstrates the impact of input and output (I/O) operations on direct and inverse transformations. Different alternatives to control the exchange of elements between RAM and disk were evaluated, which is the key operation to build a vector in memory and store its entries in a file. First, the impact of the working finite field was tested; second, the impact of the use of a buffer for exchange between the RAM and the hard disk, and finally, several instances of the algorithm with which to evaluate the impact of parallelism were simultaneously deployed. The results demonstrate that the combination of these factors may have an important effect on the speed of both direct and inverse procedures.

show abstract

“…In this scheme, each container also includes its dependencies and even a reduced operating system to ensure a regular operation over different types of platforms; as a result, the geoportal can be replicated to build clusters to improve the experience of end-users [8]. Moreover, the service container can be reused to change the geoportal by another application (e.g.…”

Section: An Interoperable Cloud-based Geoportal: Design Principlesmentioning

confidence: 99%

An Interoperable Cloud Based Geoportal for Discovery and Managment of Earth Observation Products

Sánchez‐Gallegos¹,

J.L²,

Sosa-Sosa³

et al. 2018

Computer Science &Amp; Information Technology

View full text Add to dashboard Cite

This paper presents the design and development of an interoperable geoportal service for discovery and management of earth observation products (EOPs). In this service, the geoportal components are encapsulated into virtual containers that are launched into the cloud by using a microservice scheme to solve issues such as interoperability (with other systems) and implementation (over different platforms). A search microservice that analyses the preferences of end-users (settings of spatiotemporal and polygon shapes) and builds clusters of users sharing preferences was included into the geoportal for recommending/delivering, in advance, products matching with end-user preferences. The geoportal service also enables end-users to organize EOPs on-the-fly by using spatiotemporal parameters. A prototype of this service was implemented in a private cloud and connected to a satellite imagery repository of an antenna (ERIS) managed by Mexican Space Agency in a proof of concept. Learned lessons and performance assessments are described through an experimental evaluation with real users' participation. AUTHORSDante D. Sánchez-Gallegos is a master student at

show abstract

Sacbe: A building block approach for constructing efficient and flexible end-to-end cloud storage

Cited by 18 publications

References 9 publications

Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services

Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services

On the Complexity and Performance of the Information Dispersal Algorithm

An Interoperable Cloud Based Geoportal for Discovery and Managment of Earth Observation Products

Contact Info

Product

Resources

About