Conference contribution


Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing


Publication Details
Author(s): Posewsky T, Ziener D
Publication year: 2016
Conference Proceedings Title: Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig)
ISBN: 978-1-5090-3707-0

Event details
Event: International Conference on Reconfigurable Computing and FPGAs (ReConFig)
Event location: Cancún
Start date of the event: 30/11/2016
End date of the event: 02/12/2016

Abstract

Deep neural networks are an extremely successful and widely used technique for various pattern recognition and machine learning tasks. Due to power and resource constraints, these computationally intensive networks are difficult to implement in embedded systems. Yet, the number of applications that can benefit from the mentioned possibilities is rapidly rising. In this paper, we propose a novel architecture for processing previously learned and arbitrary deep neural networks on FPGA-based SoCs that is able to overcome these limitations. A key contribution of our approach, which we refer to as batch processing, achieves a mitigation of required weight matrix transfers from external memory by reusing weights across multiple input samples. This technique combined with a sophisticated pipelining and the usage of high performance interfaces accelerates the data processing compared to existing approaches on the same FPGA device by one order of magnitude. Furthermore, we achieve a comparable data throughput as a fully featured x86-based system at only a fraction of its energy consumption.



How to cite
APA: Posewsky, T., & Ziener, D. (2016). Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing. In Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig).

MLA: Posewsky, Thorbjörn, and Daniel Ziener. "Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing." Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig), Cancún 2016.

BibTeX: Download
Share link
Last updated on 2017-04-26 at 02:55
PDF downloaded successfully