Distanced LSTM: Time-Distanced Gates in Long Short-Term Memory Models for Lung Cancer Detection

Abstract

The field of lung nodule detection and cancer prediction has been rapidly developing with the support of large public data archives. Previous studies have largely focused cross-sectional (single) CT data. Herein, we consider longitudinal data. The Long Short-Term Memory (LSTM) model addresses learning with regularly spaced time points (i.e., equal temporal intervals). However, clinical imaging follows patient needs with often heterogeneous, irregular acquisitions. To model both regular and irregular longitudinal samples, we generalize the LSTM model with the Distanced LSTM (DLSTM) for temporally varied acquisitions. The DLSTM includes a Temporal Emphasis Model (TEM) that enables learning across regularly and irregularly sampled intervals. Briefly, (1) the temporal intervals between longitudinal scans are modeled explicitly, (2) temporally adjustable forget and input gates are introduced for irregular temporal sampling; and (3) the latest longitudinal scan has an additional emphasis term. We evaluate the DLSTM framework in three datasets including simulated data, 1794 National Lung Screening Trial (NLST) scans, and 1420 clinically acquired data with heterogeneous and irregular temporal accession. The experiments on the first two datasets demonstrate that our method achieves competitive performance on both simulated and regularly sampled datasets (e.g. improve LSTM from 0.6785 to 0.7085 on F1 score in NLST). In external validation of clinically and irregularly acquired data, the benchmarks achieved 0.8350 (CNN feature) and 0.8380 (LSTM) on area under the ROC curve (AUC) score, while the proposed DLSTM achieves 0.8905.

A Comprehensive Review of Computer-Aided Diagnosis of Pulmonary Nodules Based on Computed Tomography Scans

“…Generally, thresholding, component analysis, region growing, morphological operations, and filtering [19], [22], [26], [51]- [52], [62], [67]- [68], [96], [109] are often used as rule-based approaches in preprocessing medical images. Thresholding and component analysis are the most effective and quick ways to approximately separate lung volume from distracting components.…”

Multi-Modal Evolutionary Deep Learning Model for Ovarian Cancer Diagnosis

“…A variant of RNN is long-shortterm-memory (LSTM) [18] that captures both long-term and short-term dependencies within sequential data. Gao et al [19] employed distanced LSTM with time-distanced gates for diagnosing lung cancer by using both real computed tomography images and simulated data. The method realized 0.8905 as F-score.…”

CCF-Net: Composite Context Fusion Network with Inter-Slice Correlative Fusion for Multi-Disease Lesion Detection

“…With the rapid development of lesion detection methods, many attempts have been developed to capture context information based on 2D CNNs. In such kind of methods, by firstly modeling the intra-slice texture information with 2D convolutional filters, the inter-slice context information is then extracted by fusing the feature maps from multiple 1 Code will be available at https://github.com/urmagicsmine/CCF-Net. slices with ConvLstm [1] or simple concatenation [2].…”

“…Extensive experiments show that the proposed CCF-Net is able to achieve state-of-the-art detection performance on the multidisease CT lesion detection task and significantly surpass the baseline methods. 1…”