Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrieval

20 April 2022

ArXiv (abs)PDF HTML Github (32★)

Papers citing "Transformer Decoders with MultiModal Regularization for Cross-Modal Food Retrieval"

50 / 51 papers shown

Title
FLAVA: A Foundational Language And Vision Alignment Model Amanpreet Singh Ronghang Hu Vedanuj Goswami Guillaume Couairon Wojciech Galuba Marcus Rohrbach Douwe Kiela CLIP VLM 110 719 0 08 Dec 2021
Florence: A New Foundation Model for Computer Vision Lu Yuan Dongdong Chen Yi-Ling Chen Noel Codella Xiyang Dai ... Zhen Xiao Jianwei Yang Michael Zeng Luowei Zhou Pengchuan Zhang VLM 141 908 0 22 Nov 2021
Learning Text-Image Joint Embedding for Efficient Cross-Modal Retrieval with Deep Feature Engineering Zhongwei Xie Ling Liu Yanzhao Wu Luo Zhong Lin Li 35 25 0 22 Oct 2021
Learning Structural Representations for Recipe Generation and Food Retrieval Hao Wang Guosheng Lin Guosheng Lin Chunyan Miao 66 31 0 04 Oct 2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov Yuan Cao VLM MLLM 136 799 0 24 Aug 2021
Learning Joint Embedding with Modality Alignments for Cross-Modal Retrieval of Recipes and Food Images Zhongwei Xie Ling Liu Lin Li Luo Zhong 32 10 0 09 Aug 2021
Learning TFIDF Enhanced Joint Embedding for Recipe-Image Cross-Modal Retrieval Service Zhongwei Xie Ling Liu Yanzhao Wu Lin Li Luo Zhong 36 25 0 02 Aug 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq Joty Caiming Xiong Guosheng Lin FaML 221 1,975 0 16 Jul 2021
How Much Can CLIP Benefit Vision-and-Language Tasks? Sheng Shen Liunian Harold Li Hao Tan Joey Tianyi Zhou Anna Rohrbach Kai-Wei Chang Z. Yao Kurt Keutzer CLIP VLM MLLM 259 410 0 13 Jul 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 292 2,845 0 15 Jun 2021
Solving Inefficiency of Self-supervised Representation Learning Guangrun Wang Keze Wang Guangcong Wang Philip Torr Liang Lin SSL 72 58 0 18 Apr 2021
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers Antoine Miech Jean-Baptiste Alayrac Ivan Laptev Josef Sivic Andrew Zisserman ViT 71 139 0 30 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 467 21,603 0 25 Mar 2021
Revamping Cross-Modal Recipe Retrieval with Hierarchical Transformers and Self-supervised Learning Amaia Salvador Erhan Gundogdu Loris Bazzani M. Donoser ViT 65 57 0 24 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.0K 29,926 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 463 3,901 0 11 Feb 2021
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Wonjae Kim Bokyung Son Ildoo Kim VLM CLIP 139 1,761 0 05 Feb 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 389 6,805 0 23 Dec 2020
Cross-Modal Retrieval and Synthesis (X-MRS): Closing the Modality Gap in Shared Representation Learning Ricardo Guerrero Hai Xuan Pham Vladimir Pavlovic 35 24 0 02 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,076 0 20 Nov 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 274 4,101 0 17 Jun 2020
VirTex: Learning Visual Representations from Textual Annotations Karan Desai Justin Johnson SSL VLM 165 436 0 11 Jun 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks Xiujun Li Xi Yin Chunyuan Li Pengchuan Zhang Xiaowei Hu ... Houdong Hu Li Dong Furu Wei Yejin Choi Jianfeng Gao VLM 142 1,947 0 13 Apr 2020
MCEN: Bridging Cross-Modal Gap between Cooking Recipes and Dish Images with Latent Variable Model Han Fu R. Wu Chenghao Liu Jianling Sun 54 50 0 02 Apr 2020
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers Zhicheng Huang Zhaoyang Zeng Bei Liu Dongmei Fu Jianlong Fu ViT 166 440 0 02 Apr 2020
Cross-Modal Food Retrieval: Learning a Joint Embedding of Food Images and Recipes with Semantic Consistency and Attention Mechanism Hao Wang Doyen Sahoo Chenghao Liu Ke Shu Palakorn Achananuparp Ee-Peng Lim Guosheng Lin 110 48 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 390 18,897 0 13 Feb 2020
Cross-Batch Memory for Embedding Learning Xun Wang H. Zhang Weilin Huang Matthew R. Scott 134 247 0 14 Dec 2019
Dividing and Conquering Cross-Modal Recipe Retrieval: from Nearest Neighbours Baselines to SoTA Mikhail Fain Niall Twomey Andrey Ponikar Ryan Fox Danushka Bollegala 42 19 0 28 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 216 12,136 0 13 Nov 2019
A weakly supervised adaptive triplet loss for deep metric learning Xiaonan Zhao Huan Qi R. Luo Larry S. Davis DML 69 24 0 27 Sep 2019
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 357 945 0 24 Sep 2019
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Hao Hao Tan Joey Tianyi Zhou VLM MLLM 252 2,493 0 20 Aug 2019
VisualBERT: A Simple and Performant Baseline for Vision and Language Liunian Harold Li Mark Yatskar Da Yin Cho-Jui Hsieh Kai-Wei Chang VLM 153 1,965 0 09 Aug 2019
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu Dhruv Batra Devi Parikh Stefan Lee SSL VLM 255 3,699 0 06 Aug 2019
Learning Cross-Modal Embeddings with Adversarial Networks for Cooking Recipes and Food Images Hao Wang Doyen Sahoo Chenghao Liu Ee-Peng Lim Guosheng Lin 52 132 0 03 May 2019
Visual Entailment: A Novel Task for Fine-Grained Image Understanding Ning Xie Farley Lai Derek Doran Asim Kadav CoGe 120 326 0 20 Jan 2019
Learning Incremental Triplet Margin for Person Re-identification Yingying Zhang Qiaoyong Zhong Liang Ma Di Xie Shiliang Pu 60 42 0 17 Dec 2018
Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images Javier Marín Aritro Biswas Ferda Ofli Nick Hynes Amaia Salvador Y. Aytar Ingmar Weber Antonio Torralba 62 324 0 14 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,364 0 10 Jul 2018
Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings Micael Carvalho Rémi Cadène David Picard Laure Soulier Nicolas Thome Matthieu Cord 53 180 0 30 Apr 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 805 132,725 0 12 Jun 2017
In Defense of the Triplet Loss for Person Re-Identification Alexander Hermans Lucas Beyer Bastian Leibe DML 113 3,212 0 22 Mar 2017
Is Saki #delicious? The Food Perception Gap on Instagram and Its Relation to Health Ferda Ofli Y. Aytar Ingmar Weber Raggi al Hammouri Antonio Torralba 61 65 0 21 Feb 2017
Deep Feature Learning with Relative Distance Comparison for Person Re-identification Shengyong Ding Liang Lin Guangrun Wang Hongyang Chao 93 670 0 11 Dec 2015
Skip-Thought Vectors Ryan Kiros Yukun Zhu Ruslan Salakhutdinov R. Zemel Antonio Torralba R. Urtasun Sanja Fidler SSL 224 2,412 0 22 Jun 2015
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models Bryan A. Plummer Liwei Wang Christopher M. Cervantes Juan C. Caicedo Julia Hockenmaier Svetlana Lazebnik 208 2,074 0 19 May 2015
VQA: Visual Question Answering Aishwarya Agrawal Jiasen Lu Stanislaw Antol Margaret Mitchell C. L. Zitnick Dhruv Batra Devi Parikh CoGe 233 5,509 0 03 May 2015
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 391 13,172 0 12 Mar 2015