Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

4 June 2021

Papers citing "Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning"

42 / 42 papers shown

Title
Retrieval Augmented Time Series Forecasting Sungwon Han Seungeon Lee M. Cha Sercan Ö. Arik Jinsung Yoon AI4TS 33 0 0 07 May 2025
ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding Santosh Rajagopalan Jonathan Vronsky Songbai Yan S. Alireza Golestaneh Shubhra Chandra Min Zhou 66 0 0 26 Apr 2025
EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks Michael Arbel David Salinas Frank Hutter 70 2 0 10 Feb 2025
Open-Book Neural Algorithmic Reasoning Hefei Li Chao Peng Chenyang Xu Zhengfeng Yang LRM 51 0 0 03 Jan 2025
TabM: Advancing Tabular Deep Learning with Parameter-Efficient Ensembling Yury Gorishniy Akim Kotelnikov Artem Babenko LMTD MoE 92 6 0 31 Oct 2024
T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data Hugo Thimonier José Lucas De Melo Costa Fabrice Popineau Arpad Rimmel Bich-Liên Doan 53 1 0 07 Oct 2024
Demystifying amortized causal discovery with transformers Francesco Montagna Max Cairney-Leeming Dhanya Sridhar Francesco Locatello CML 57 1 0 27 May 2024
Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning Hector Kohler Quentin Delfosse R. Akrour Kristian Kersting Philippe Preux 62 14 0 23 May 2024
Evolution Transformer: In-Context Evolutionary Optimization Robert Tjarko Lange Yingtao Tian Yujin Tang 18 10 0 05 Mar 2024
Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Xi Fang Weijie Xu Fiona Anting Tan Jiani Zhang Ziqing Hu Yanjun Qi Scott Nickleach Diego Socolinsky Srinivasan H. Sengamedu Christos Faloutsos LMTD ALM 37 66 0 27 Feb 2024
HyperFast: Instant Classification for Tabular Data David Bonet D. M. Montserrat Xavier Giró-i-Nieto A. Ioannidis 46 15 0 22 Feb 2024
On the Importance of Step-wise Embeddings for Heterogeneous Clinical Time-Series Rita Kuznetsova Alizée Pace Manuel Burger Hugo Yèche Gunnar Rätsch AI4TS 36 5 0 15 Nov 2023
Meta-learning of semi-supervised learning from tasks with heterogeneous attribute spaces Tomoharu Iwata Atsutoshi Kumagai 24 2 0 09 Nov 2023
In-Context Learning for Few-Shot Molecular Property Prediction Christopher Fifty J. Leskovec Sebastian Thrun 36 5 0 13 Oct 2023
Interpretable Decision Tree Search as a Markov Decision Process Hector Kohler R. Akrour Philippe Preux 19 2 0 22 Sep 2023
In-Context Learning Learns Label Relationships but Is Not Conventional Learning Jannik Kossen Y. Gal Tom Rainforth 37 27 0 23 Jul 2023
Virtual Human Generative Model: Masked Modeling Approach for Learning Human Characteristics Kenta Oono Nontawat Charoenphakdee K. Bito Zhengyan Gao Yoshiaki Ota ... Kohei Hayashi Yuki Saito Koki Tsuda Hiroshi Maruyama K. Hayashi 30 1 0 19 Jun 2023
$Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph$ Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph Camilo Ruiz Hongyu Ren Kexin Huang J. Leskovec 25 2 0 07 Jun 2023
Self-Reinforcement Attention Mechanism For Tabular Learning Kodjo Mawuena Amekoe M. Dilmi Hanene Azzag M. Lebbah Zaineb Chelly Dagdia Gregoire Jaffre 40 0 0 19 May 2023
Machine Learning and VIIRS Satellite Retrievals for Skillful Fuel Moisture Content Monitoring in Wildfire Management John S. Schreck William Petzke P. Jiménez Thomas Brummet J. Knievel E. James B. Kosović D. Gagne 18 8 0 17 May 2023
LEURN: Learning Explainable Univariate Rules with Neural Networks Çağlar Aytekin FAtt 29 0 0 27 Mar 2023
One Transformer for All Time Series: Representing and Training with Time-Dependent Heterogeneous Tabular Data Simone Luetto Fabrizio Garuti E. Sangineto L. Forni Rita Cucchiara LMTD AI4TS 84 10 0 13 Feb 2023
Learning How to Infer Partial MDPs for In-Context Adaptation and Exploration Chentian Jiang Nan Rosemary Ke Hado van Hasselt 16 3 0 08 Feb 2023
An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models Yufeng Zhang Boyi Liu Qi Cai Lingxiao Wang Zhaoran Wang 50 11 0 30 Dec 2022
Deep Causal Learning: Representation, Discovery and Inference Zizhen Deng Xiaolong Zheng Hu Tian D. Zeng CML BDL 36 11 0 07 Nov 2022
Language Models are Realistic Tabular Data Generators V. Borisov Kathrin Seßler Tobias Leemann Martin Pawelczyk Gjergji Kasneci LMTD 27 223 0 12 Oct 2022
Why do tree-based models still outperform deep learning on tabular data? Léo Grinsztajn Edouard Oyallon Gaël Varoquaux LMTD 29 356 0 18 Jul 2022
Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling Tung Nguyen Aditya Grover BDL UQCV 19 99 0 09 Jul 2022
Revisiting Pretraining Objectives for Tabular Deep Learning Ivan Rubachev Artem Alekberov Yu. V. Gorishniy Artem Babenko LMTD 21 41 0 07 Jul 2022
Transfer Learning with Deep Tabular Models Roman Levin Valeriia Cherepanova Avi Schwarzschild Arpit Bansal C. Bayan Bruss Tom Goldstein A. Wilson Micah Goldblum OOD FedML LMTD 75 58 0 30 Jun 2022
An Empirical Study of Retrieval-enhanced Graph Neural Networks Dingmin Wang Shengchao Liu Hanchen Wang Bernardo Cuenca Grau Linfeng Song Jian Tang Song Le Qi Liu 18 0 0 01 Jun 2022
Amortized Inference for Causal Structure Learning Lars Lorch Scott Sussex Jonas Rothfuss Andreas Krause Bernhard Schölkopf CML 31 60 0 25 May 2022
Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations Jaehun Jung Lianhui Qin Sean Welleck Faeze Brahman Chandra Bhagavatula Ronan Le Bras Yejin Choi ReLM LRM 223 190 0 24 May 2022
BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning Zhi Hou Baosheng Yu Chaoyue Wang Yibing Zhan Dacheng Tao ViT 29 11 0 04 Apr 2022
On Embeddings for Numerical Features in Tabular Deep Learning Yura Gorishniy Ivan Rubachev Artem Babenko LMTD 13 156 0 10 Mar 2022
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 192 385 0 06 Nov 2021
Deep Neural Networks and Tabular Data: A Survey V. Borisov Tobias Leemann Kathrin Seßler Johannes Haug Martin Pawelczyk Gjergji Kasneci LMTD 27 647 0 05 Oct 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 181 687 0 22 Apr 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,815 0 14 Dec 2020
Bayesian Model-Agnostic Meta-Learning Taesup Kim Jaesik Yoon Ousmane Amadou Dia Sungwoong Kim Yoshua Bengio Sungjin Ahn UQCV BDL 202 498 0 11 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 338 11,684 0 09 Mar 2017
MissForest - nonparametric missing value imputation for mixed-type data D. Stekhoven Peter Buhlmann 174 4,222 0 04 May 2011