ConfAdvisor: An Automatic Configuration Tuning Framework for NoSQL Database Benchmarking with a Black-box Approach

Chen, Pengfei; Huo, Zhaoheng; Li, Xiaoyun; Dou, Hui; Zhu, Cheng

doi:10.1007/978-3-030-71058-3_7

Cited by 1 publication

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An automatic configuration-tuning framework for NoSQL database benchmarking, ConfAdvisor , treats database performance as a black-box function of its configuration parameters (Chen et al, 2020 ). Various black-box optimization algorithms are used, including Bayesian optimization, and the experiments show a substantial improvement in performance.…”

Section: Related Workmentioning

confidence: 99%

Tuning of Elasticsearch Configuration: Parameter Optimization Through Simultaneous Perturbation Stochastic Approximation

2022

View full text Add to dashboard Cite

Elasticsearch is currently the most popular search engine for full-text database management systems. By default, its configuration does not change while it receives data. However, when Elasticsearch stores a large amount of data over time, the default configuration becomes an obstacle to improving performance. In addition, the servers that host Elasticsearch may have limited resources, such as internal memory and CPU. A general solution to these problems is to dynamically tune the configuration parameters of Elasticsearch in order to improve its performance. The sheer number of parameters involved in this configuration makes it a complex task. In this work, we apply the Simultaneous Perturbation Stochastic Approximation method for optimizing Elasticsearch with multiple unknown parameters. Using this algorithm, our implementation optimizes the Elasticsearch configuration parameters by observing the performance and automatically changing the configuration to improve performance. The proposed solution makes it possible to change the configuration parameters of Elasticsearch automatically without having to restart the currently running instance of Elasticsearch. The results show a higher than 40% improvement in the combined data insertion capacity and the system's response time.

show abstract

Section: Related Workmentioning

confidence: 99%