Neural Networks Sequential Training Using Variational Gaussian Particle Filter

Halimeh MM, Brendel A, Kellermann W (2019)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2019

Conference Proceedings Title: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Event location: Brighton GB

URI: https://ieeexplore.ieee.org/document/8683886

DOI: 10.1109/icassp.2019.8683886

Abstract

In this paper, we propose a sequential training algorithm for feed-forward neural networks based on particle filtering. The proposed algorithm uses variational learning to tailor a proposal density by minimizing the variational energy. This density is then incorporated into the Gaussian particle filter framework. The proposed algorithm and an extension to it using evolutionary resampling are compared to training a neural network using a random walk-based particle filter, an extended Kalman filter, the use of variational learning only, and the backpropagation algorithm, using a synthetic dataset generated by a time-varying random process and a real dataset, where the proposed approach resulted in a moderately lower training and testing errors and a better convergence behavior, rendering the algorithm attractive for uses such as neural networks pre-training.

Authors with CRIS profile

Mhd Modar Halimeh Professur für Signalverarbeitung Andreas Brendel Professur für Signalverarbeitung Walter Kellermann Professur für Signalverarbeitung

How to cite

APA:

Halimeh, M.M., Brendel, A., & Kellermann, W. (2019). Neural Networks Sequential Training Using Variational Gaussian Particle Filter. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Brighton, GB.

MLA:

Halimeh, Mhd Modar, Andreas Brendel, and Walter Kellermann. "Neural Networks Sequential Training Using Variational Gaussian Particle Filter." Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton 2019.

BibTeX: Download