Non-invasive prediction of isocitrate dehydrogenase (IDH) genotype plays an important role in tumor glioma diagnosis and prognosis. Recently, research has shown that radiology images can be a potential tool for genotype prediction, and fusion of multi-modality data by deep learning methods can further provide complementary information to enhance prediction accuracy. However, it still does not have an effective deep learning architecture to predict IDH genotype with three-dimensional (3D) multimodal medical images. In this paper, we proposed a novel multimodal 3D DenseNet (M3D-DenseNet) model to predict IDH genotypes with multimodal magnetic resonance imaging (MRI) data. To evaluate its performance, we conducted experiments on the BRATS-2017 and The Cancer Genome Atlas breast invasive carcinoma (TCGA-BRCA) dataset to get image data as input and gene mutation information as the target, respectively. We achieved 84.6% accuracy (area under the curve (AUC) = 85.7%) on the validation dataset. To evaluate its generalizability, we applied transfer learning techniques to predict World Health Organization (WHO) grade status, which also achieved a high accuracy of 91.4% (AUC = 94.8%) on validation dataset. With the properties of automatic feature extraction, and effective and high generalizability, M3D-DenseNet can serve as a useful method for other multimodal radiogenomics problems and has the potential to be applied in clinical decision making.

Tomato disease control remains a major challenge in the agriculture sector. Early stage recognition of these diseases is critical to reduce pesticide usage and mitigate economic losses. While many research works have been inspired by the success of deep learning in computer vision to improve the performance of recognition systems for crop diseases, few of these studies optimized the deep learning models to generalize their findings to practical use in the field. In this work, we proposed a model for identifying tomato leaf diseases based on both in-house data and public tomato leaf images databases. Three deep learning network architectures (VGG16, Inception_v3, and Resnet50) were trained and tested. We packaged the trained model into an Android application named TomatoGuard to identify nine kinds of tomato leaf diseases and healthy tomato leaf. The results showed that TomatoGuard could be adopted as a model for identifying tomato diseases with a 99% test accuracy, showing significantly better performance compared with APP Plantix, a widely used APP for general purpose plant disease detection.