Predicting sonic and density logs from drilling parameters using temporal convolutional networks

Abstract

Sonic and bulk density logs are crucial inputs for many subsurface tasks including formation identification, completion design, and porosity estimation. Economic and operational concerns restrict the acquisition of these logs, meaning the overburden and sometimes entire wells are completely unlogged. In contrast, parameters that monitor drilling operations, such as weight on bit and torque, are recorded for every borehole. Previous studies have applied supervised machine learning approaches to predict these missing logs from the drilling parameters. While the results are promising, they often do not investigate the importance of different features and the corresponding practical implications. Here, we explored the feasibility of predicting compressional slowness and bulk density logs using various combinations of formation markers, gamma-ray logs, and drilling data recorded at the rig. Our tests utilized a temporal convolutional network to allow the model to learn from sequences of input features. Bayesian-based hyperparameter tuning found the optimum set of parameters for each experiment before producing the final log predictions. Finally, a permutation feature importance analysis revealed which input variables contributed most to the outputs. Although drilling parameters contain some insight into the mechanical rock properties, we found that they cannot produce the high-quality log predictions required for many tasks. Supplementing the drilling parameters with a gamma-ray log and formation data produces good-quality log predictions, with the additional inputs helping to constrain the model outputs.

A Transformer and LSTM-Based Approach for Blind Well Lithology Prediction

“…To enhance the accuracy of model prediction, we used the ResTCN model to fill in the missing data from the raw logging data [20,21]. This improves the model's robustness and overfitting resistance while also alleviating the problem of gradient vanishing.…”

Automating hyperparameter optimization in geophysics with Optuna: A comparative study

“…In comparison, only a limited number of geophysics‐related deep‐learning papers (with limited traction) rely on such automated approaches for HPO. The most notable amongst them are about deep learning models for wavefield propagation modelling (Kaur et al., 2023), seismic inversion (Smith, Nivlet, et al., 2022), log prediction (Smith, Bakulin, et al., 2022) and adaptative subtraction of seismic data (J. Liu et al., 2021). These four papers are notable because they implicitly acknowledge the advantage of using an automated approach to HPO compared to a conventional method.…”