Hyperparameter Importance of Quantum Neural Networks Across Small Datasets

Abstract

As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit -a so-called quantum neural network -to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar role to a neural network. However, specifically for applications in machine learning contexts, very little is known about suitable circuit architectures, or model hyperparameters one should use to achieve good learning performance. In this work, we apply the functional ANOVA framework to quantum neural networks to analyze which of the hyperparameters were most influential for their predictive performance. We analyze one of the most typically used quantum neural network architectures. We then apply this to 7 open-source datasets from the OpenML-CC18 classification benchmark whose number of features is small enough to fit on quantum hardware with less than 20 qubits. Three main levels of importance were detected from the ranking of hyperparameters obtained with functional ANOVA. Our experiment both confirmed expected patterns and revealed new insights. For instance, setting well the learning rate is deemed the most critical hyperparameter in terms of marginal contribution on all datasets, whereas the particular choice of entangling gates used is considered the least important except on one dataset. This work introduces new methodologies to study quantum machine learning models and provides new insights toward quantum model selection.

Resource frugal optimizer for quantum machine learning

“…It would also be interesting to introduce different techniques to reduce the number of shots spent such as Bayesian optimization [27]. Finally, other empirical studies related to algorithm selection and configuration [51,55,[61][62][63][64][65] can be applied to Refoqus on different datasets [63,66,67].…”

Hybrid Quantum Image Classification and Federated Learning for Hepatic Steatosis Diagnosis

“…Other applications of HQNNs in healthcare and pharmaceuticals include Refs. [37,[42][43][44][45]. Unfortunately, due to the limited availability of quantum computers and the difficulty of simulating their information processing capabilities using a classical computer, studies of QML in medicine are currently rather small in number.…”

Hybrid Quantum Neural Network for Drug Response Prediction

“…Some of these methods provide a polynomial speedup, critical for large and complex problems where small improvements can make a big difference. Among these advantages, quantum computing specifically demonstrates benefits over classical computing across various domains, including chemistry simulations [19,20] and within the medical and healthcare industry [21][22][23][24][25]. For example, in [26], it was shown that already existing machine learning algorithms, being quantum enhanced, significantly contribute to medical science and healthcare.…”