Bayesian Deep Learning and Probabilistic Forecasting of Stock Prices

Abstract

This study investigates the effectiveness of Bayesian probabilistic methods for stock price forecasting on the Johannesburg Stock Exchange by implementing and comparing Gaussian process regression (GPR), Bayesian long short-term memory (Bayesian LSTM), and Bayesian neural networks (BNNs). Using daily open, high, low, close, and volume (OHLCV) data and engineered technical indicators for FirstRand and Discovery from January 2005 to June 2025 (5187 observations), models were trained and evaluated with the mean absolute error (MAE), root mean squared error (RMSE), and mean squared error (MSE). The GPR produced reliable, well-calibrated intervals in relatively stable regimes, but its performance degraded on the more volatile Discovery series. Bayesian LSTM delivered conservative uncertainty estimates with wide predictive intervals but showed the largest point forecast errors. The BNNs achieved the best balance between accuracy and uncertainty quantification, producing the lowest errors for FirstRand and competitive performance for Discovery. Comparative analysis indicates that BNNs are most suitable when point accuracy and calibrated uncertainty are both priorities, GPR is valuable for smaller or more stable data regimes, and Bayesian LSTM is preferable where conservative, risk-conscious intervals are required. This study highlights the practical value of embedding uncertainty into financial forecasts and recommends matching Bayesian model choice to market volatility, data availability, and decision maker risk appetite.