Pöllot M, Zhang R, Kaup A (2020)
Publication Language: English
Publication Type: Conference contribution, Conference Contribution
Publication year: 2020
Pages Range: 4027-4031
Conference Proceedings Title: Proceedings of the International Conference on Acoustics, Speech and Signal Processing
ISBN: 978-1-5090-6631-5
URI: https://ieeexplore.ieee.org/document/9054583
DOI: 10.1109/ICASSP40776.2020.9054583
Convolutional Neural Networks (CNNs) currently represent the best tool for classification of image content. CNNs are trained in order to develop generalized expressions in form of unique features to distinguish different classes. During this process, one or more filter weights might develop the same or similar values. In this case, the redundant filters can be pruned without damaging accuracy.Unlike normal pruning methods, we investigate the possibility of replacing a full-sized convolutional neural network with an ensemble of its narrow versions. Empirically, we show that the combination two narrow networks, which has only half of the original parameter count in total, is able to contest and even outperform the full-sized original network. In other words, a pruning rate of 50% can be achieved without any compromise on accuracy. Furthermore, we introduce a novel approach on ensemble learning called ComboNet, which increases the accuracy of the ensemble even further.
APA:
Pöllot, M., Zhang, R., & Kaup, A. (2020). An Efficient Alternative to Network Pruning Through Ensemble Learning. In IEEE (Eds.), Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 4027-4031). Barcelona, ES.
MLA:
Pöllot, Martin, Rui Zhang, and André Kaup. "An Efficient Alternative to Network Pruning Through Ensemble Learning." Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona Ed. IEEE, 2020. 4027-4031.
BibTeX: Download