Strong tropical cyclones have made a drastic effect on human life and natural environment. As large amounts of meteorological data and monitoring data continue to accumulate, traditional methods for predicting tropical cyclone tracks face numerous challenges regarding their prediction efficiency and accuracy. Deep learning methods recently have been proven to be able to learn both spatial and temporal features from a large amount of dataset and be extremely efficient and accurate for forecasting data in complex structures. In this paper, we propose a novel data-driven deep learning model to predict tropical cyclone tracks using the spatial locations and multiple meteorological factors. This model comprises a multidimensional feature selection layer, a CNN layer and a GRU layer. The proposed model was trained using a dataset of real-world tropical cyclones from the years 1945 to 2017. Through the comparison experiments, the results verify that the proposed model outperforms the traditional forecasting methods, including a climatologically aware forecasting technique, the Sanders Barotropic technique and a numerical weather prediction (NWP) model. In addition, the proposed model has better accuracy than some deep learning methods, including RNN, GRU, CNN, AE-RNN, CNN-RNN, and CNN-GRU without the proposed feature selection layer. INDEX TERMS Tropical cyclones tracks prediction, deep learning, feature selection, typhoon.