v1v2 (latest)

Representation Learning with Contrastive Predictive Coding

10 July 2018

Papers citing "Representation Learning with Contrastive Predictive Coding"

50 / 3,656 papers shown

Title
Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge Benjamin van Niekerk Leanne Nortje Herman Kamper 132 117 0 19 May 2020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation Po-Han Chi Pei-Hung Chung Tsung-Han Wu Chun-Cheng Hsieh Yen-Hao Chen Shang-Wen Li Hung-yi Lee SSL 99 148 0 18 May 2020
Vector-Quantized Autoregressive Predictive Coding Yu-An Chung Hao Tang James R. Glass SSL 68 115 0 17 May 2020
C-MI-GAN : Estimation of Conditional Mutual Information using MinMax formulation A. Mondal A. Bhattacharya Sudipto Mukherjee A. Prathosh Sreeram Kannan Himanshu Asnani 87 15 0 17 May 2020
Mutual Information Maximization for Robust Plannable Representations Yiming Ding I. Clavera Pieter Abbeel 62 15 0 16 May 2020
Speech Recognition and Multi-Speaker Diarization of Long Conversations H. H. Mao Shuyang Li Julian McAuley G. Cottrell VLM 87 40 0 16 May 2020
CERT: Contrastive Self-supervised Learning for Language Understanding Hongchao Fang Sicheng Wang Meng Zhou Jiayuan Ding P. Xie ELM SSL 83 345 0 16 May 2020
Improved Prosody from Learned F0 Codebook Representations for VQ-VAE Speech Waveform Reconstruction Yi Zhao Haoyu Li Cheng-I Jeff Lai Jennifer Williams Erica Cooper Junichi Yamagishi 84 18 0 16 May 2020
Large scale weakly and semi-supervised learning for low-resource video ASR Kritika Singh Vimal Manohar Alex Xiao Sergey Edunov Ross B. Girshick Vitaliy Liptchinsky Christian Fuegen Yatharth Saraf Geoffrey Zweig Abdel-rahman Mohamed 77 9 0 16 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 182 984 0 11 May 2020
COBRA: Contrastive Bi-Modal Representation Algorithm Vishaal Udandarao A. Maiti Deepak Srivatsav Suryatej Reddy Vyalla Yifang Yin R. Shah 81 23 0 07 May 2020
Plan2Vec: Unsupervised Representation Learning by Latent Plans Ge Yang Amy Zhang Ari S. Morcos Joelle Pineau Pieter Abbeel Roberto Calandra SSL OffRL 89 27 0 07 May 2020
Adaptive Invariance for Molecule Property Prediction Wengong Jin Regina Barzilay Tommi Jaakkola 64 7 0 05 May 2020
Does Visual Self-Supervision Improve Learning of Speech Representations for Emotion Recognition? Abhinav Shukla Stavros Petridis Maja Pantic SSL 96 28 0 04 May 2020
Mutual Information Gradient Estimation for Representation Learning Liangjiang Wen Yiji Zhou Lirong He Mingyuan Zhou Zenglin Xu DRL SSL 160 27 0 03 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 118 14 0 01 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 161 507 0 01 May 2020
Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning Z. Guo Bernardo Avila-Pires Bilal Piot Jean-Bastien Grill Florent Altché Rémi Munos M. G. Azar BDL DRL SSL 192 143 0 30 Apr 2020
DiVA: Diverse Visual Feature Aggregation for Deep Metric Learning Timo Milbich Karsten Roth Homanga Bharadhwaj Samarth Sinha Yoshua Bengio Bjorn Ommer Joseph Paul Cohen 130 67 0 28 Apr 2020
Audio-Visual Instance Discrimination with Cross-Modal Agreement Pedro Morgado Nuno Vasconcelos Ishan Misra SSL 92 276 0 27 Apr 2020
First return, then explore Adrien Ecoffet Joost Huizinga Joel Lehman Kenneth O. Stanley Jeff Clune 127 365 0 27 Apr 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 232 4,617 0 23 Apr 2020
Vector Quantized Contrastive Predictive Coding for Template-based Music Generation Gaëtan Hadjeres Léopold Crestel 82 18 0 21 Apr 2020
ETC: Encoding Long and Structured Inputs in Transformers Joshua Ainslie Santiago Ontanon Chris Alberti Vaclav Cvicek Zachary Kenneth Fisher Philip Pham Anirudh Ravula Sumit Sanghai Qifan Wang Li Yang 98 55 0 17 Apr 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 237 2,074 0 16 Apr 2020
Distilling Localization for Self-Supervised Representation Learning Nanxuan Zhao Zhirong Wu Rynson W. H. Lau Stephen Lin SSL 170 56 0 14 Apr 2020
Decoupling Global and Local Representations via Invertible Generative Flows Xuezhe Ma X. Kong Shanghang Zhang Eduard H. Hovy DRL 92 3 0 12 Apr 2020
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding Yu-An Chung James R. Glass SSL 90 56 0 11 Apr 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 171 1,097 0 08 Apr 2020
Context-Aware Multi-Task Learning for Traffic Scene Recognition in Autonomous Vehicles Younkwan Lee Ji-Kwang Jeon Jongmin Yu M. Jeon 49 8 0 03 Apr 2020
How Useful is Self-Supervised Pretraining for Visual Tasks? Alejandro Newell Jia Deng SSL 80 139 0 31 Mar 2020
Edge Guided GANs with Contrastive Learning for Semantic Image Synthesis Hao Tang Xiaojuan Qi Guolei Sun Dan Xu N. Sebe Radu Timofte Luc Van Gool GAN 97 11 0 31 Mar 2020
Improving out-of-distribution generalization via multi-task self-supervised pretraining Isabela Albuquerque Nikhil Naik Junnan Li N. Keskar R. Socher SSL OOD 95 40 0 30 Mar 2020
Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds Yongming Rao Jiwen Lu Jie Zhou 3DPC 73 133 0 29 Mar 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 106 16 0 27 Mar 2020
Are Labels Necessary for Neural Architecture Search? Chenxi Liu Piotr Dollár Kaiming He Ross B. Girshick Alan Yuille Saining Xie 88 75 0 26 Mar 2020
A Survey of Deep Learning for Scientific Discovery M. Raghu Erica Schmidt OOD AI4CE 184 123 0 26 Mar 2020
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning Joshua Knights Ben Harwood Daniel Ward Anthony Vanderkop Olivia Mackenzie-Ross Peyman Moghadam AI4TS 102 38 0 21 Mar 2020
A unifying mutual information view of metric learning: cross-entropy vs. pairwise losses Malik Boudiaf Jérôme Rony Imtiaz Masud Ziko Eric Granger M. Pedersoli Pablo Piantanida Ismail Ben Ayed SSL 117 160 0 19 Mar 2020
A Metric Learning Reality Check Kevin Musgrave Serge J. Belongie Ser-Nam Lim 190 479 0 18 Mar 2020
A comprehensive study on the prediction reliability of graph neural networks for virtual screening Soojung Yang K. Lee Seongok Ryu 61 7 0 17 Mar 2020
Predictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition Jongmin Yu Yongsang Yoon M. Jeon 205 47 0 17 Mar 2020
Visual Task Progress Estimation with Appearance Invariant Embeddings for Robot Control and Planning Guilherme J. Maeda Joni Väätäinen Hironori Yoshida 73 2 0 16 Mar 2020
DHOG: Deep Hierarchical Object Grouping L. N. Darlow Amos Storkey 55 7 0 13 Mar 2020
Learning Predictive Representations for Deformable Objects Using Contrastive Estimation Wilson Yan Ashwin Vangipuram Pieter Abbeel Lerrel Pinto 111 191 0 11 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 684 3,451 0 09 Mar 2020
On Compositions of Transformations in Contrastive Self-Supervised Learning Mandela Patrick Yuki M. Asano Polina Kuznetsova Ruth C. Fong João F. Henriques Geoffrey Zweig Andrea Vedaldi 96 50 0 09 Mar 2020
VQ-DRAW: A Sequential Discrete VAE Alex Nichol BDL 45 3 0 03 Mar 2020
Predictive Coding for Locally-Linear Control Rui Shu Tung D. Nguyen Yinlam Chow Tu Pham Khoat Than Mohammad Ghavamzadeh Stefano Ermon Hung Bui OffRL BDL 104 25 0 02 Mar 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 367 948 0 02 Mar 2020