UnbiasedDTI: Mitigating Real-World Bias of Drug-Target Interaction Prediction by Using Deep Ensemble-Balanced Learning

Abstract

Drug-target interaction (DTI) prediction through in vitro methods is expensive and time-consuming. On the other hand, computational methods can save time and money while enhancing drug discovery efficiency. Most of the computational methods frame DTI prediction as a binary classification task. One important challenge is that the number of negative interactions in all DTI-related datasets is far greater than the number of positive interactions, leading to the class imbalance problem. As a result, a classifier is trained biased towards the majority class (negative class), whereas the minority class (interacting pairs) is of interest. This class imbalance problem is not widely taken into account in DTI prediction studies, and the few previous studies considering balancing in DTI do not focus on the imbalance issue itself. Additionally, they do not benefit from deep learning models and experimental validation. In this study, we propose a computational framework along with experimental validations to predict drug-target interaction using an ensemble of deep learning models to address the class imbalance problem in the DTI domain. The objective of this paper is to mitigate the bias in the prediction of DTI by focusing on the impact of balancing and maintaining other involved parameters at a constant value. Our analysis shows that the proposed model outperforms unbalanced models with the same architecture trained on the BindingDB both computationally and experimentally. These findings demonstrate the significance of balancing, which reduces the bias towards the negative class and leads to better performance. It is important to note that leaning on computational results without experimentally validating them and by relying solely on AUROC and AUPRC metrics is not credible, particularly when the testing set remains unbalanced.

Predicting Endocrine Disruption Using Conformal Prediction – A Prioritization Strategy to Identify Hazardous Chemicals with Confidence

“…Training skewness was a common feature for all data sets, where the active domain represented 0.78 to 24.25% (median 4.23) of the data set ( Table 1 ). Proposed strategies that handle data imbalance focus on minority class increase (e.g., n -fold over-sampling, active learning 38 ), majority class reduction (e.g., under-sampling), synthesis of artificial data (e.g., SMOTE, 26 ROSE 27 ), and/or model structure tailoring (e.g., subsampling and ensemble QSARs 39 ). CP has been also shown to handle data skewness in a number of examples (e.g.…”

Drug-target interaction prediction using high order nonlinear features via neural factorization machines

“…To demonstrate that JRD-NFM achieves excellent performance in drug-target interaction prediction, five methods for chemical structure feature extraction were selected for comparison. With the same dataset, we tested our proposed JRD-NFM prediction method against five other methods: Daylight-Conjoint [10] , ESPF [11] , ERG, Morgan-AAC [12] , and Pubchem. We input the drug and target data into the corresponding drug molecule encoder and target molecule encoder respectively.…”

Comparative Studies on Resampling Techniques in Machine Learning and Deep Learning Models for Drug-Target Interaction Prediction

“…Furthermore, in [ 43 ] the authors proposed a method called UnbiasedDTI to predict DTIs. UnbiasedDTI is a deep ensemble-balanced learning method consisting of three main modules [ 43 ].…”