Multidimensional Bayesian Estimation for Deep Brain Stimulation Using the SafeOpt Algorithm

Abstract

Some symptoms treated with Deep Brain Stimulation (DBS) such as gait in Parkinson's disease (PD), are often poorly responsive to DBS. This may be because DBS settings are usually optimized to other symptoms. To test this, we require an efficient, safe optimization algorithm. To develop such a tool, we extend the BayesOpt algorithm whose successful application to DBS settings we previously published [Louie et al 2021 J Neuroeng Rehabil], using, as a test bed, a simulated cost function constructed for biological plausibility, with measurement noise based on experimental data. We found that the SafeOpt algorithm [Sui et al 2015 Proc Machine Learning Res] converged to the optimum as well, and as fast as the BayesOpt algorithm, while avoiding high-cost points much more effectively. In three dimensions, SafeOpt converged in about 30 iterations, which is a feasible number for physical (not simulated) experiments in real patients. Convergence was slower when measurement nose was greater, but this could be overcome by running it for more iterations. The algorithm was relatively robust to misspecification of hyperparameters, and considerably more robust when hyperparameter fitting was incorporated into the algorithm. The algorithm did not perform as well when the quantization of stimulation settings was coarser, suggesting that it will work better with neurostimulators capable of independent current control. Finally, the algorithm was able to cope with a cost function having multiple local minima.

SAFE-OPT: A Bayesian optimization algorithm for learning optimal deep brain stimulation parameters with safety constraints

“…33,34 Two prior studies have explored the incorporation of safety constraints into Bayesian optimization for neural engineering applications, including accounting for patient side-effects during DBS programming for tremor relief 35 and a computational exploration of design parameters that influence safe Bayesian optimization performance in a multidimensional input space. 36 In this study, we demonstrate the successful application of safe Bayesian optimization in a rodent in vivo model, as well as a robust computational design methodology that can be replicated to design SAFE-OPT for best performance in future applications.…”

In silico development and validation of Bayesian methods for optimizing deep brain stimulation to enhance cognitive control

“…In other DBS applications, Bayesian approaches have been suggested and demonstrated to be an useful tool to optimize DBS settings [41][42][43][44][45] in a closed loop neuromodulation [41]. Used Bayesian optimization to determine the best DBS parameters that reduced beta power in a basal ganglia-thalamocortical computational model of Parkinson's disease (PD).…”

“…Based on the participant's expressed preferences for stimulation settings [46], used Bayesian preference learning to find individualized optimal stimulation patterns. Recently, Bayesian algorithms have been demonstrated to be safe and viable options in humans, as in [43,44], with additional constraint to the objective function to be optimized for PD. Generalizing beyond movement disorders, we recently demonstrated Bayesian optimization in neurostimulation for pain [47].…”