An optimal-score-based filter pruning for deep convolutional neural networks

Sawant SS, Bauer J, Erick FX, Ingaleshwar S, Holzer N, Ramming A, Lang EW, Goetz T (2022)

Publication Type: Journal article

Publication year: 2022

Journal

Applied Intelligence Springer Verlag (Germany)

DOI: 10.1007/s10489-022-03229-5

Abstract

Convolutional Neural Networks (CNN) have achieved excellent performance in the processing of high-resolution images. Most of these networks contain many deep layers in quest of greater segmentation performance. However, over-sized CNN models result in overwhelming memory usage and large inference costs. Earlier studies have revealed that over-sized deep neural models tend to deal with abundant redundant filters that are very similar and provide tiny or no contribution in accelerating the inference of the model. Therefore, we have proposed a novel optimal-score-based filter pruning (OSFP) approach to prune redundant filters according to their relative similarity in feature space. OSFP not only speeds up learning in the network but also eradicates redundant filters leading to improvement in the segmentation performance. We empirically demonstrate on widely used segmentation network models (TernausNet, classical U-Net and VGG16 U-Net) and benchmark datasets (Inria Aerial Image Labeling Dataset and Aerial Imagery for Roof Segmentation (AIRS)) that computation costs (in terms of Float Point Operations (FLOPs) and parameters) are reduced significantly, while maintaining or even improving accuracy.

Authors with CRIS profile

Andreas Ramming Medizinische Fakultät

Involved external institutions

Fraunhofer-Institut für Integrierte Schaltungen (IIS) DE Germany (DE) Universität Regensburg DE Germany (DE) JSS Academy of Technical Education IN India (IN)

How to cite

APA:

Sawant, S.S., Bauer, J., Erick, F.X., Ingaleshwar, S., Holzer, N., Ramming, A.,... Goetz, T. (2022). An optimal-score-based filter pruning for deep convolutional neural networks. Applied Intelligence. https://dx.doi.org/10.1007/s10489-022-03229-5

MLA:

Sawant, Shrutika S., et al. "An optimal-score-based filter pruning for deep convolutional neural networks." Applied Intelligence (2022).

BibTeX: Download