Initial Sample Selection in Bayesian Optimization for Combinatorial Optimization of Chemical Compounds

Abstract

An efficient search for optimal solutions in Bayesian optimization (BO) entails providing appropriate initial samples when building a Gaussian process regression model. For general experimental designs without compounds or molecular descriptors in explanatory variable x, selecting initial samples with a larger D-optimality allows little correlation between x in the selected samples, which leads to effective regression model building. However, in the case of experimental designs with compounds, a high correlation always exists between molecular descriptors calculated from chemical structures, and compounds with similar structures form clusters in the chemical space. Therefore, selecting the initial samples uniformly from each cluster is desirable for obtaining initial samples with maximum information on experimental conditions. As D-optimality does not work well with highly correlated molecular descriptors and does not consider information on clusters in sample selection, we propose an initial sample selection method based on clustering and apply it to the optimization of coupling reaction conditions with BO. We confirm that the proposed method reaches the optimal solution with up to 5% fewer experiments than random sampling or sampling based on D-optimality. This study makes a contribution to the initial sample selection method for BO, and we are convinced that the proposed method improves the search performance of BO in various fields of science and technology if initial samples can be determined using cluster information appropriately formed by utilizing domain knowledge.

Robust Design of a Dimethyl Ether Production Process Using Process Simulation and Robust Bayesian Optimization

“…BO allows us to properly search not only for interpolation of existing data sets but also for extrapolation regions, thus reducing the possibility of falling into local optimal solutions. BO has been applied to process simulation, molecular simulation, − and live experimental optimization. − …”

“…BO has been applied to process simulation, 23 molecular simulation, 24 − 27 and live experimental optimization. 28 − 30 …”