Artificial Intelligence (AI) and deep learning have altered the digital landscape. Data grows in lockstep with technological advancements. The training procedure for Deep Learning algorithms is becoming increasingly complex as the amount of data available grows. In the deep learning process, having superior technology to speed up the training and testing time is critical. CNN (Convolutional Neural Networks) is a deep learning algorithm for image processing that is widely utilized. In this paper, a novel distributed CNN with LSTM is proposed to optimize accuracy, execution time, and scalability. Different methodologies and tactics for improving CNN training time through distributed models are studied. To comprehend the neural network structure of parallelizing and spreading the execution, each layer of the CNN is investigated and analyzed. Computations on the CPU, GPU, and TPU are also investigated, as well as settings like Google Colab, AWS SageMaker, and others. According to the analysis, the use of an L2 regularization, dropout layer, and a ConvLSTM for autotuning of hyperparameters improves speed in all settings, The final CNN, with these additional layers for performance acceleration, is subsequently deployed in Google Cloud Platform Virtual Machine (VM) instances. This makes it easier to investigate the performance of the proposed distributed deep learning model at scale. Due to the communication between multiple nodes involved in distributing a deep learning model, the model's accuracy usually suffers. But in this proposed work utilizing an autotuning LSTM and Distributed CNN algorithm that distributes optimally and balances accuracy and speed-up is proposed in this proposed work. The proposed models achieved a 2.206 percent boost in speed with respect to data parallel DConvLSTM and a 1.4 percent improvement in model parallel training time of DConvLSTM. The maximum accuracy achieved was 93.3825 and 89.59 percent in data-parallel and model-parallel executions respectively.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.