- Turkish Journal of Forecasting
- Vol: 01 Issue: 2
- Bayesian Learning based Gaussian Approximation for Artificial Neural Networks
Bayesian Learning based Gaussian Approximation for Artificial Neural Networks
Authors : Ozan Koacadagli
Pages : 54-65
View : 10 | Download : 5
Publication Date : 2017-12-29
Article Type : Research
Abstract :In the nonlinear systems, the pre-knowledge about the exact functional structure between inputs and outputs is mostly either unavailable or insufficient. In this case, the artificial neural networks (ANNs) are useful tools to estimate this functional structure. However, the traditional ANNs with the sum squared error suffer from the approximation and estimation errors in the high dimensional and excessive nonlinear cases. In this context, Bayesian neural networks (BNNs) provide a natural way to alleviate these issues by means of penalizing the excessive complex models. Thus, this approach allows estimating more reliable and robust models in the regression analysis, time series, pattern recognition problems etc. This paper presents a Bayesian learning approach based on Gaussian approximation which estimates the parameters and hyperparameters in the BNNs efficiently. In the application part, the proposed approach is compared with the traditional ANNs in terms of their estimation and prediction performances over an artificial data set.Keywords : Bayesian Neural Networks, Bayesian Learning, Gaussian Approach, Fixed Hyperparameters, Gradient based Algorithms