Modeling nonadiabatic dynamics in complex molecular or condensed-phase systems has been challenging especially for the long-time dynamics. In this work, we propose a time series machine learning scheme based on the hybrid convolutional neural network/long short-term memory (CNN-LSTM) framework for predicting the long-time quantum behavior given only the short-time dynamics. This scheme takes advantage of both the powerful local feature extraction ability of CNN and the long-term global sequential pattern recognition ability of LSTM. With feature fusion of individually trained CNN-LSTM models for the quantum population and coherence dynamics, the proposed scheme is shown to have high accuracy and robustness in predicting the linearized semiclassical and symmetrical quasiclassical mapping dynamics of various spin-boson models with learning time up to 0.3 ps. Furthermore, if the hybrid network has learned the dynamics of a system, this knowledge is transferable that could significantly enhance the accuracy in predicting the dynamics of a similar system. The hybrid CNN-LSTM network is thus believed to have high predictive power in forecasting the nonadiabatic dynamics in realistic charge and energy transfer processes in photoinduced energy conversion.