Model alignment using inter-modal bridges

18 May 2025

Papers citing "Model alignment using inter-modal bridges"

47 / 47 papers shown

Title
The Platonic Representation Hypothesis Minyoung Huh Brian Cheung Tongzhou Wang Phillip Isola 115 138 0 13 May 2024
GeRA: Label-Efficient Geometrically Regularized Alignment Dustin Klebe Tal Shnitzer Mikhail Yurochkin Leonid Karlinsky Justin Solomon 58 2 0 01 Oct 2023
A Spectral Theory of Neural Prediction and Alignment Abdulkadir Canatar J. Feather Albert J. Wakhloo SueYeon Chung OOD 70 15 0 22 Sep 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.5K 14,699 0 15 Mar 2023
Improving and generalizing flow-based generative models with minibatch optimal transport Alexander Tong Kilian Fatras Nikolay Malkin G. Huguet Yanlei Zhang Jarrid Rector-Brooks Guy Wolf Yoshua Bengio OOD DiffM OT 114 304 0 01 Feb 2023
Scalable Diffusion Models with Transformers William S. Peebles Saining Xie GNN 118 2,418 0 19 Dec 2022
Unbalanced Optimal Transport, from Theory to Numerics Thibault Séjourné Gabriel Peyré Franccois-Xavier Vialard OT 89 49 0 16 Nov 2022
Geodesic Sinkhorn for Fast and Accurate Optimal Transport on Manifolds G. Huguet Alexander Tong María Ramos Zapatero Christopher J. Tape Guy Wolf Smita Krishnaswamy OT 56 7 0 02 Nov 2022
Flow Matching for Generative Modeling Y. Lipman Ricky T. Q. Chen Heli Ben-Hamu Maximilian Nickel Matt Le OOD 209 1,373 0 06 Oct 2022
Linearly Mapping from Image to Text Space Jack Merullo Louis Castricato Carsten Eickhoff Ellie Pavlick VLM 204 115 0 30 Sep 2022
Optimal Transport Tools (OTT): A JAX Toolbox for all things Wasserstein Marco Cuturi Laetitia Meng-Papaxanthos Yingtao Tian Charlotte Bunne Geoff Davis O. Teboul OT 199 105 0 28 Jan 2022
Representation Alignment in Neural Networks Ehsan Imani Wei Hu Martha White 48 4 0 15 Dec 2021
LiT: Zero-Shot Transfer with Locked-image text Tuning Xiaohua Zhai Tianlin Li Basil Mustafa Andreas Steiner Daniel Keysers Alexander Kolesnikov Lucas Beyer VLM 108 560 0 15 Nov 2021
Similarity and Matching of Neural Network Representations Adrián Csiszárik Péter Korösi-Szabó Á. Matszangosz Gergely Papp D. Varga 44 70 0 27 Oct 2021
Linear-Time Gromov Wasserstein Distances using Low Rank Couplings and Costs M. Scetbon Gabriel Peyré Marco Cuturi OT 65 61 0 02 Jun 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 263 7,933 0 11 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 967 29,810 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 456 3,893 0 11 Feb 2021
Minibatch optimal transport distances; analysis and applications Kilian Fatras Younes Zine Szymon Majewski Rémi Flamary Rémi Gribonval Nicolas Courty OT 110 59 0 05 Jan 2021
A contribution to Optimal Transport on incomparable spaces Titouan Vayer OT 57 20 0 09 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
The Unbalanced Gromov Wasserstein Distance: Conic Formulation and Relaxation Thibault Séjourné François-Xavier Vialard Gabriel Peyré OT 76 71 0 09 Sep 2020
Are we done with ImageNet? Lucas Beyer Olivier J. Hénaff Alexander Kolesnikov Xiaohua Zhai Aaron van den Oord VLM 131 405 0 12 Jun 2020
Visual Transformers: Token-based Image Representation and Processing for Computer Vision Bichen Wu Chenfeng Xu Xiaoliang Dai Alvin Wan Peizhao Zhang Zhicheng Yan Masayoshi Tomizuka Joseph E. Gonzalez Kurt Keutzer Peter Vajda ViT 101 562 0 05 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 859 42,379 0 28 May 2020
mvlearn: Multiview Machine Learning in Python Ronan Perry Gavin Mischler Richard Guo T. Lee Alexander Chang ... Hugo Richard Iain Carmichael Pierre Ablin Alexandre Gramfort Joshua T. Vogelstein 87 24 0 25 May 2020
From ImageNet to Image Classification: Contextualizing Progress on Benchmarks Dimitris Tsipras Shibani Santurkar Logan Engstrom Andrew Ilyas Aleksander Madry 75 135 0 22 May 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers Wenhui Wang Furu Wei Li Dong Hangbo Bao Nan Yang Ming Zhou VLM 158 1,280 0 25 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 491 10,591 0 17 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 532 42,591 0 03 Dec 2019
Ground Metric Learning on Graphs Matthieu Heitz Nicolas Bonneel D. Coeurjolly Marco Cuturi Gabriel Peyré OT 59 21 0 08 Nov 2019
Learning with minibatch Wasserstein : asymptotic and gradient properties Kilian Fatras Younes Zine Rémi Flamary Rémi Gribonval Nicolas Courty OT 67 96 0 09 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,301 0 27 Aug 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 144 18,179 0 28 May 2019
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,356 0 10 Jul 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 429 5,156 0 19 Jun 2018
Optimal Transport for structured data with application on graphs Titouan Vayer Laetitia Chapel Rémi Flamary R. Tavenard Nicolas Courty OT 68 274 0 23 May 2018
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction Leland McInnes John Healy James Melville 195 9,473 0 09 Feb 2018
FiLM: Visual Reasoning with a General Conditioning Layer Ethan Perez Florian Strub H. D. Vries Vincent Dumoulin Aaron Courville FAtt AIMat OffRL AI4CE 361 2,233 0 22 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 730 132,363 0 12 Jun 2017
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Learning with a Wasserstein Loss Charlie Frogner Chiyuan Zhang H. Mobahi Mauricio Araya-Polo T. Poggio 74 602 0 17 Jun 2015
Understanding image representations by measuring their equivariance and equivalence Karel Lenc Andrea Vedaldi SSL FAtt 114 537 0 21 Nov 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,508 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,595 0 01 Sep 2014
Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi OT 218 4,288 0 04 Jun 2013
Geodesics in Heat Keenan Crane C. Weischedel M. Wardetzky 127 498 0 24 Apr 2012