A Workload-Driven Approach for View Selection in Large Dimensional Datasets

Ordonez-Ante, Leandro; Seghbroeck, Gregory Van; Wauters, Tim; Volckaert, Bruno; Turck, Filip De

doi:10.1007/s10922-020-09526-z

Cited by 6 publications

(4 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The decreased response cost contributes to an improvement in the system's overall performance. The calculation takes place in the following condition (13), (10) This represents the cost of the query response when materialised views are used, and this represents the total cost of the response. Condition 14 depicts the results of the fitness assessment based on these cost estimations.…”

Section: Response Costmentioning

confidence: 99%

See 1 more Smart Citation

A Novel Hybrid Optimization With Ensemble Constraint Handling Approach for the Optimal Materialized Views

Vullam,

Murali Krishna,

Davuluri

et al. 2023

IJRITCC

View full text Add to dashboard Cite

The datawarehouse is extremely challenging to work with, as doing so necessitates a significant investment of both time and space. As a result, it is essential to enable rapid data processing in order to cut down on the amount of time needed to respond to queries that are sent to the warehouse. To effectively solve this problem, one of the significant approaches that should be taken is to take the view of materialization. It is extremely unlikely that all of the views that can be derived from the data will ever be materialized. As a result, view subsets need to be selected intelligently in order to enable rapid data processing for queries coming from a variety of locations. The Materialized view selection problem is addressed by the model that has been proposed. The model is based on the ensemble constraint handling techniques (ECHT). In order to optimize the problem, we must take into account the constraints, which include the self-adaptive penalty, the Epsilon ()-parameter, and the stochastic ranking. For the purpose of making a quicker and more accurate selection of queries from the data warehouse, the proposed model includes the implementation of an innovative algorithm known as the constrained hybrid Ebola with COATI optimization (CHECO) algorithm. For the purpose of computing the best possible fitness, the goals of "processing cost of the query," "response cost," and "maintenance cost" are each defined. The top views are selected by the CHECO algorithm based on whether or not the defined fitness requirements are met. In the final step of the process, the proposed model is compared to the models already in use in order to validate the performance improvement in terms of a variety of performance metrics.

show abstract

Section: Response Costmentioning

confidence: 99%

“…The primary factors contributing to a lengthy response time are the complex nature of analytical query processing and large amounts of data. The processing time of analytical queries is something that the MV process is working to cut down on [13].…”

Section: Introductionmentioning

confidence: 99%

A Novel Hybrid Optimization With Ensemble Constraint Handling Approach for the Optimal Materialized Views

Vullam,

Murali Krishna,

Davuluri

et al. 2023

IJRITCC

View full text Add to dashboard Cite

show abstract

“…In [1], authors proposed three approaches which are MVFirst, INDFirst and Joint enumeration. But the major drawback of this approach is the sequential and isolating use of these techniques, which does not make it possible to benefit from the advantage of the interactivity between these optimization structures.…”

Section: Optimization Techniquesmentioning

confidence: 99%

Queries Processing in Wireless Sensor Network

Abbassi¹,

Ezzedine²

2021

Wireless Sensor Networks - Design, Deployment and Applications

View full text Add to dashboard Cite

For the super-excellence applications used to control the water level in rivers, temperature handles a very large volume of information and does not stop constantly changing. These spatio-temporal data collected by a network of sensors form a set of thematic, integrated, non-volatile and historical data organized to help decision-making. Usually this process is performed with temporal, spatial and spatiotemporal queries. This in turn increases the execution time of the query load. In the literatures, several techniques have been identified such as materialized views (MV), indexes, fragmentation, scheduling, and buffer management. These techniques do not consider the update of the request load and the modification at the database level. In this chapter, we propose an optimal dynamic selection solution based on indexes and VMs. the solution is optimal when it meets the entire workload with a reasonable response time. The proposed approach supports modification at the database level and at the workload level to ensure the validity of the optimal solution for this the knapsack algorithm was used.

show abstract

“…The continuous views generated through EXPLORA are by definition redundant data structures for read optimization [55] and, as such, entail a storage overhead. In this sense, Figure 13a illustrates the proportion of the number of records (i.e., data summaries) registered in the views w.r.t.…”

Section: Continuous Views Storage Footprintmentioning

confidence: 99%

Explora: Interactive Querying of Multidimensional Data in the Context of Smart Cities

Ordonez-Ante

Seghbroeck

Wauters

et al. 2020

Sensors

Self Cite

View full text Add to dashboard Cite

Citizen engagement is one of the key factors for smart city initiatives to remain sustainable over time. This in turn entails providing citizens and other relevant stakeholders with the latest data and tools that enable them to derive insights that add value to their day-to-day life. The massive volume of data being constantly produced in these smart city environments makes satisfying this requirement particularly challenging. This paper introduces Explora, a generic framework for serving interactive low-latency requests, typical of visual exploratory applications on spatiotemporal data, which leverages the stream processing for deriving—on ingestion time—synopsis data structures that concisely capture the spatial and temporal trends and dynamics of the sensed variables and serve as compacted data sets to provide fast (approximate) answers to visual queries on smart city data. The experimental evaluation conducted on proof-of-concept implementations of Explora, based on traditional database and distributed data processing setups, accounts for a decrease of up to 2 orders of magnitude in query latency compared to queries running on the base raw data at the expense of less than 10% query accuracy and 30% data footprint. The implementation of the framework on real smart city data along with the obtained experimental results prove the feasibility of the proposed approach.

show abstract

A Workload-Driven Approach for View Selection in Large Dimensional Datasets

Cited by 6 publications

References 30 publications

A Novel Hybrid Optimization With Ensemble Constraint Handling Approach for the Optimal Materialized Views

A Novel Hybrid Optimization With Ensemble Constraint Handling Approach for the Optimal Materialized Views

Queries Processing in Wireless Sensor Network

Explora: Interactive Querying of Multidimensional Data in the Context of Smart Cities

Contact Info

Product

Resources

About