FTRANS: Energy-Efficient Acceleration of Transformers using FPGA

FTRANS: Energy-Efficient Acceleration of Transformers using FPGA

16 July 2020

Ji Li

Caiwen Ding

ArXiv (abs)PDF HTML

Papers citing "FTRANS: Energy-Efficient Acceleration of Transformers using FPGA"

14 / 14 papers shown

Title
Quattro: Transformer-Accelerated Iterative Linear Quadratic Regulator Framework for Fast Trajectory Optimization Yue Wang Hoayu Wang Zhaoxing Li 112 0 0 02 Apr 2025
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 677 24,541 0 26 Jul 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 116 3,156 0 01 Apr 2019
Supervised Domain Enablement Attention for Personalized Domain Classification Joo-Kyung Kim Young-Bum Kim 64 10 0 18 Dec 2018
Simple Attention-Based Representation Learning for Ranking Short Social Media Posts Peng Shi J. Rao Jimmy J. Lin 46 7 0 02 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
C-LSTM: Enabling Efficient LSTM using Structured Compression Techniques on FPGAs Shuo Wang Zhe Li Caiwen Ding Bo Yuan Yanzhi Wang Qinru Qiu Yun Liang 45 193 0 14 Mar 2018
Towards Neural Machine Translation with Latent Tree Attention James Bradbury R. Socher 50 14 0 06 Sep 2017
CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices Caiwen Ding Siyu Liao Yanzhi Wang Zhe Li Ning Liu ... Yipeng Zhang Jian Tang Qinru Qiu Xinyu Lin Bo Yuan GNN 58 260 0 29 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Theoretical Properties for Neural Networks with Weight Matrices of Low Displacement Rank Liang Zhao Siyu Liao Yanzhi Wang Zhe Li Jian Tang Victor Pan Bo Yuan 90 61 0 01 Mar 2017
Structured Attention Networks Yoon Kim Carl Denton Luong Hoang Alexander M. Rush 118 463 0 03 Feb 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 338 2,898 0 26 Sep 2016
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 259 6,786 0 03 Sep 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.