Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing

Conference contribution


Publication Details

Author(s): Posewsky T, Ziener D
Publication year: 2016
Conference Proceedings Title: Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig)
ISBN: 978-1-5090-3707-0


Abstract


Deep neural networks are an extremely successful and widely used technique for various pattern recognition and machine learning tasks. Due to power and resource constraints, these computationally intensive networks are difficult to implement in embedded systems. Yet, the number of applications that can benefit from the mentioned possibilities is rapidly rising. In this paper, we propose a novel architecture for processing previously learned and arbitrary deep neural networks on FPGA-based SoCs that is able to overcome these limitations. A key contribution of our approach, which we refer to as batch processing, achieves a mitigation of required weight matrix transfers from external memory by reusing weights across multiple input samples. This technique combined with a sophisticated pipelining and the usage of high performance interfaces accelerates the data processing compared to existing approaches on the same FPGA device by one order of magnitude. Furthermore, we achieve a comparable data throughput as a fully featured x86-based system at only a fraction of its energy consumption.



FAU Authors / FAU Editors

Ziener, Daniel Dr.-Ing.
Lehrstuhl für Informatik 12 (Hardware-Software-Co-Design)


How to cite

APA:
Posewsky, T., & Ziener, D. (2016). Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing. In Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig). Cancún, MX.

MLA:
Posewsky, Thorbjörn, and Daniel Ziener. "Efficient Deep Neural Network Acceleration through FPGA-based Batch Processing." Proceedings of the International Conference on Reconfigurable Computing and FPGAs (ReConFig), Cancún 2016.

BibTeX: 

Last updated on 2018-19-04 at 03:57