Residual Connections Encourage Iterative Inference

Residual Connections Encourage Iterative Inference

13 October 2017

Stanislaw Jastrzebski

Papers citing "Residual Connections Encourage Iterative Inference"

19 / 19 papers shown

Title
Decoding Vision Transformers: the Diffusion Steering Lens Ryota Takatsuki Sonia Joseph Ippei Fujisawa Ryota Kanai DiffM 80 0 0 18 Apr 2025
Shared Global and Local Geometry of Language Model Embeddings Andrew Lee Melanie Weber F. Viégas Martin Wattenberg FedML 94 6 0 27 Mar 2025
The Geometry of Tokens in Internal Representations of Large Language Models Karthik Viswanathan Yuri Gardinazzi Giada Panerai Alberto Cazzaniga Matteo Biagetti AIFin 129 7 0 17 Jan 2025
Residual Stream Analysis with Multi-Layer SAEs Tim Lawson Lucy Farnik Conor Houghton Laurence Aitchison 72 5 0 06 Sep 2024
A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models Daking Rai Yilun Zhou Shi Feng Abulhair Saparov Ziyu Yao 147 32 0 02 Jul 2024
Emergence of a High-Dimensional Abstraction Phase in Language Transformers Emily Cheng Diego Doimo Corentin Kervadec Iuri Macocco Jade Yu Alessandro Laio Marco Baroni 131 14 0 24 May 2024
Learning Deep ResNet Blocks Sequentially using Boosting Theory Furong Huang Jordan T. Ash John Langford Robert Schapire 58 111 0 15 Jun 2017
Highway and Residual Networks learn Unrolled Iterative Estimation Klaus Greff R. Srivastava Jürgen Schmidhuber AI4TS 98 215 0 22 Dec 2016
The Loss Surface of Residual Networks: Ensembles and the Role of Batch Normalization Etai Littwin Lior Wolf UQCV 141 15 0 08 Nov 2016
Residual Networks Behave Like Ensembles of Relatively Shallow Networks Andreas Veit Michael J. Wilber Serge J. Belongie UQCV 63 107 0 20 May 2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex Q. Liao T. Poggio 242 257 0 13 Apr 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 48 410 0 30 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,182 0 16 Mar 2016
Normalization Propagation: A Parametric Technique for Removing Internal Covariate Shift in Deep Networks Devansh Arpit Yingbo Zhou Bhargava U. Kota V. Govindaraju 62 127 0 04 Mar 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 63 133 0 22 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 193,878 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 323 18,613 0 06 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.6K 100,348 0 04 Sep 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.