Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning

17 October 2024

Papers citing "Analyzing Deep Transformer Models for Time Series Forecasting via Manifold Learning"

27 / 27 papers shown

Title
Data Augmentation Policy Search for Long-Term Forecasting Liran Nochumsohn Omri Azencot AI4TS TPM 101 5 0 01 May 2024
Sample and Predict Your Latent: Modality-free Sequential Disentanglement via Contrastive Estimation Ilana D Naiman Nimrod Berman Omri Azencot DRL 68 6 0 25 May 2023
Multifactor Sequential Disentanglement via Structured Koopman Autoencoders Nimrod Berman Ilana D Naiman Omri Azencot CoGe 55 22 0 30 Mar 2023
The geometry of hidden representations of large transformer models L. Valeriani Diego Doimo F. Cuturello Alessandro Laio A. Ansuini Alberto Cazzaniga MILM 45 57 0 01 Feb 2023
FONDUE: an algorithm to find the optimal dimensionality of the latent representations of variational autoencoders Lisa Bonheme M. Grzes DRL 67 6 0 26 Sep 2022
N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting Cristian Challu Kin G. Olivares Boris N. Oreshkin Federico Garza Max Mergenthaler-Canseco A. Dubrawski AI4TS 78 272 0 30 Jan 2022
Scikit-dimension: a Python package for intrinsic dimension estimation Jonathan Bac Evgeny M. Mirkes Alexander N. Gorban I. Tyukin A. Zinovyev 74 82 0 06 Sep 2021
On the geometry of generalization and memorization in deep neural networks Cory Stephenson Suchismita Padhy Abhinav Ganesh Yue Hui Hanlin Tang SueYeon Chung TDI AI4CE 64 73 0 30 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 650 6,059 0 29 Apr 2021
An Operator Theoretic Approach for Analyzing Sequence Neural Networks Ilana D Naiman Omri Azencot 46 11 0 15 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 596 40,961 0 22 Oct 2020
Hierarchical nucleation in deep neural networks Diego Doimo Aldo Glielmo A. Ansuini Alessandro Laio BDL AI4CE 43 31 0 07 Jul 2020
Classification vs regression in overparameterized regimes: Does the loss function matter? Vidya Muthukumar Adhyyan Narang Vignesh Subramanian M. Belkin Daniel J. Hsu A. Sahai 81 151 0 16 May 2020
AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models Eric Wallace Jens Tuyls Junlin Wang Sanjay Subramanian Matt Gardner Sameer Singh MILM 63 138 0 19 Sep 2019
Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel Yao-Hung Hubert Tsai Shaojie Bai M. Yamada Louis-Philippe Morency Ruslan Salakhutdinov 102 258 0 30 Aug 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 211 1,593 0 11 Jun 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 131 1,471 0 15 May 2019
A neural network based on SPD manifold learning for skeleton-based hand gesture recognition X. Nguyen Luc Brun O. Lézoray Sébastien Bougleux 3DH 56 118 0 29 Apr 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 227 1,644 0 28 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,729 0 11 Oct 2018
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 216 653 0 03 Aug 2018
Estimating the intrinsic dimension of datasets by a minimal neighborhood information Elena Facco M. d’Errico Alex Rodriguez Alessandro Laio 42 327 0 19 Mar 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 93 1,139 0 30 Jan 2018
Curvature-aware Manifold Learning Yangyang Li 42 14 0 22 Jun 2017
Visualizing and Understanding Recurrent Networks A. Karpathy Justin Johnson Li Fei-Fei HAI 114 1,101 0 05 Jun 2015
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 533 27,295 0 01 Sep 2014
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 587 15,874 0 12 Nov 2013