Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing
Posewsky T, Ziener D (2016)
Publication Type: Conference contribution
Publication year: 2016
Conference Proceedings Title: Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig)
Event location: Cancún
ISBN: 978-1-5090-3707-0
DOI: 10.1109/ReConFig.2016.7857167
Abstract
Deep neural networks are an extremely successful and widely used technique for various pattern recognition and machine learning tasks. Due to power and resource constraints, these computationally intensive networks are difficult to implement in embedded systems. Yet, the number of applications that can benefit from the mentioned possibilities is rapidly rising. In this paper, we propose a novel architecture for processing previously learned and arbitrary deep neural networks on FPGA-based SoCs that is able to overcome these limitations. A key contribution of our approach, which we refer to as batch processing, achieves a mitigation of required weight matrix transfers from external memory by reusing weights across multiple input samples. This technique combined with a sophisticated pipelining and the usage of high performance interfaces accelerates the data processing compared to existing approaches on the same FPGA device by one order of magnitude. Furthermore, we achieve a comparable data throughput as a fully featured x86-based system at only a fraction of its energy consumption.
Authors with CRIS profile
Involved external institutions
Germany (DE)How to cite
APA:
Posewsky, T., & Ziener, D. (2016). Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing. In Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig). Cancún, MX.
MLA:
Posewsky, Thorbjörn, and Daniel Ziener. "Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing." Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig), Cancún 2016.
BibTeX: Download