Optimization Algorithm Inspired Deep Neural Network Structure Design

Optimization Algorithm Inspired Deep Neural Network Structure Design

3 October 2018

ArXiv (abs)PDF HTML

Papers citing "Optimization Algorithm Inspired Deep Neural Network Structure Design"

12 / 12 papers shown

Title
Momentum Transformer: Closing the Performance Gap Between Self-attention and Its Linearization T. Nguyen Richard G. Baraniuk Robert M. Kirby Stanley J. Osher Bao Wang 127 9 0 01 Aug 2022
A Note on Machine Learning Approach for Computational Imaging Bin Dong 64 0 0 24 Feb 2022
Online Attentive Kernel-Based Temporal Difference Learning Guang Yang Xingguo Chen Shangdong Yang Huihui Wang Shaokang Dong Yang Gao OffRL 28 3 0 22 Jan 2022
Improving Transformers with Probabilistic Attention Keys Tam Nguyen T. Nguyen Dung D. Le Duy Khuong Nguyen Viet-Anh Tran Richard G. Baraniuk Nhat Ho Stanley J. Osher 129 33 0 16 Oct 2021
Heavy Ball Neural Ordinary Differential Equations Hedi Xia Vai Suliafu H. Ji T. Nguyen Andrea L. Bertozzi Stanley J. Osher Bao Wang 94 61 0 10 Oct 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 88 58 0 15 Feb 2021
ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding Yibo Yang Hongyang Li Shan You Fei Wang Chao Qian Zhouchen Lin 63 60 0 13 Oct 2020
Simple and Deep Graph Convolutional Networks Ming Chen Zhewei Wei Zengfeng Huang Bolin Ding Yaliang Li GNN 162 1,507 0 04 Jul 2020
Constrained Linear Data-feature Mapping for Image Classification Juncai He Yuyan Chen Lian Zhang Jinchao Xu 61 2 0 23 Nov 2019
Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families Yibo Yang Jianlong Wu Hongyang Li Xia Li Tiancheng Shen Zhouchen Lin OOD 73 21 0 23 Nov 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 128 128 0 23 Jun 2019
Differentiable Linearized ADMM Xingyu Xie Jianlong Wu Zhisheng Zhong Guangcan Liu Zhouchen Lin 74 62 0 15 May 2019