An Efficient Alternative to Network Pruning Through Ensemble Learning

Pöllot M, Zhang R, Kaup A (2020)

Publication Language: English

Publication Type: Conference contribution, Conference Contribution

Publication year: 2020

Pages Range: 4027-4031

Conference Proceedings Title: Proceedings of the International Conference on Acoustics, Speech and Signal Processing

Event location: Barcelona ES

ISBN: 978-1-5090-6631-5

URI: https://ieeexplore.ieee.org/document/9054583

DOI: 10.1109/ICASSP40776.2020.9054583

Abstract

Convolutional Neural Networks (CNNs) currently represent the best tool for classification of image content. CNNs are trained in order to develop generalized expressions in form of unique features to distinguish different classes. During this process, one or more filter weights might develop the same or similar values. In this case, the redundant filters can be pruned without damaging accuracy.Unlike normal pruning methods, we investigate the possibility of replacing a full-sized convolutional neural network with an ensemble of its narrow versions. Empirically, we show that the combination two narrow networks, which has only half of the original parameter count in total, is able to contest and even outperform the full-sized original network. In other words, a pruning rate of 50% can be achieved without any compromise on accuracy. Furthermore, we introduce a novel approach on ensemble learning called ComboNet, which increases the accuracy of the ensemble even further.

Authors with CRIS profile

Martin Pöllot Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS) Andre Kaup Lehrstuhl für Multimediakommunikation und Signalverarbeitung (LMS)

How to cite

APA:

Pöllot, M., Zhang, R., & Kaup, A. (2020). An Efficient Alternative to Network Pruning Through Ensemble Learning. In IEEE (Eds.), Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 4027-4031). Barcelona, ES.

MLA:

Pöllot, Martin, Rui Zhang, and André Kaup. "An Efficient Alternative to Network Pruning Through Ensemble Learning." Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona Ed. IEEE, 2020. 4027-4031.

BibTeX: Download