Recurrent Neural Network based Models for Word Prediction

Abstract

Globally, people are spending a cumulative amount of time on their mobile device, laptop, tab, desktop, etc,. for messaging, sending emails, banking, interaction through social media, and all other activities. It is necessary to cut down the time spend on typing through these devices. It can be achieved when the device can provide the user more options for what the next word might be for the current typed word. It also increases the speed of typing. In this paper, we suggest and presented a comparative study on various models like Recurrent Neural Network, Stacked Recurrent Neural Network, Long Short Term Memory network (LSTM) and Bi-directional LSTM that gives solution for the above said problem. Our primary goal is to suggest the best model among the four models to predict the next word for the given current word in English Language. Our survey says that for predicting next word RNN provide accuracy 60% and loss 40%, Stacked RNN provide accuracy 62% and loss 38%, LSTM provide accuracy 64% and loss 36% and Bidirectional LSTM provide accuracy 72% and loss 28%.

Next Word Prediction for Book Title Search Using Bi-LSTM Algorithm

“…Further research was conducted by Radhika Sharma et al [15] with the Bi-LSTM model for predicting the next word using the Hindi language obtained an accuracy of 79.54%. Research with English data has also been conducted by S. Rajakumar et al [16] and S. Ramya et al [17] using the Bi-LSTM algorithm as the next word prediction model by obtaining an accuracy of 81.07% and 72% respectively.…”