In data science, time series forecasting is the process of utilizing past or present (known) observations of a target variable to make predictions about future (unknown) observations. Due to the usefulness of forecasting applications in numerous real-life problems, various Statistical and Machine Learning forecasting models have been proposed over recent years. The purpose of this chapter is to compare the performance of several contemporary forecasting models that are considered state of the art. These include Autoregressive Integrated Moving Average (ARIMA), Neural Basis Expansion Analysis (NBEATS), Probabilistic Time Series Modeling focusing on deep learning-based models and others. In the first section of this work a brief theoretical background of the methods is provided. Then, the experimental procedure is being described. For the comparison, 40 univariate time series of financial data that cover a 1-year period were used. A python repository of automated time series forecasting models (AtsPy) was exploited to run the experiments. For the final comparison three different metrics (RMSE, MAE and MAPE) were taken into consideration. The results of this extended experimental procedure are presented through various explanatory diagrams of the methods' performance in the final section.