Representation Learning with Contrastive Predictive Coding

10 July 2018

Papers citing "Representation Learning with Contrastive Predictive Coding"

50 / 2,650 papers shown

Title
Improving Transformer-based Speech Recognition Using Unsupervised Pre-training Dongwei Jiang Xiaoning Lei Wubo Li Ne Luo Yuxuan Hu Wei Zou Xiangang Li 29 99 0 22 Oct 2019
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 226 166 0 18 Oct 2019
Understanding the Limitations of Variational Mutual Information Estimators Jiaming Song Stefano Ermon SSL DRL 33 202 0 14 Oct 2019
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations Alexei Baevski Steffen Schneider Michael Auli SSL 30 661 0 12 Oct 2019
When Does Self-supervision Improve Few-shot Learning? Jong-Chyi Su Subhransu Maji B. Hariharan 33 168 0 08 Oct 2019
BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle Peter West Ari Holtzman Jan Buys Yejin Choi SSL 27 58 0 16 Sep 2019
Learning Deep Representations by Mutual Information for Person Re-identification Peng Chen Tong Jia Pengfei Wu Jianjun Wu Dongyue Chen SSL 40 5 0 16 Aug 2019
Detecting semantic anomalies Faruk Ahmed Aaron Courville 19 83 0 13 Aug 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 45 487 0 31 Jul 2019
Charting the Right Manifold: Manifold Mixup for Few-shot Learning Puneet Mangla M. Singh Abhishek Sinha Nupur Kumari V. Balasubramanian Balaji Krishnamurthy SSL 41 327 0 28 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 69 542 0 04 Jul 2019
Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Model Alex X. Lee Anusha Nagabandi Pieter Abbeel Sergey Levine OffRL BDL 41 374 0 01 Jul 2019
BERTphone: Phonetically-Aware Encoder Representations for Utterance-Level Speaker and Language Recognition Shaoshi Ling Julian Salazar Yuzong Liu Katrin Kirchhoff SSL 33 28 0 30 Jun 2019
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty Dan Hendrycks Mantas Mazeika Saurav Kadavath D. Song OOD SSL 10 938 0 28 Jun 2019
Learning Belief Representations for Imitation Learning in POMDPs Tanmay Gangwani Joel Lehman Qiang Liu Jian Peng 29 37 0 22 Jun 2019
Shaping Belief States with Generative Environment Models for RL Karol Gregor Danilo Jimenez Rezende F. Besse Yan Wu Hamza Merzic Aaron van den Oord OffRL AI4CE 46 118 0 21 Jun 2019
Unsupervised State Representation Learning in Atari Ankesh Anand Evan Racah Sherjil Ozair Yoshua Bengio Marc-Alexandre Côté R. Devon Hjelm SSL 44 254 0 19 Jun 2019
Disentangled Inference for GANs with Latently Invertible Autoencoder Jiapeng Zhu Deli Zhao Bo Zhang Bolei Zhou GAN DRL 30 35 0 19 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 105 2,374 0 13 Jun 2019
Learning Video Representations using Contrastive Bidirectional Transformer Chen Sun Fabien Baradel Kevin Patrick Murphy Cordelia Schmid SSL ViT 27 133 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 123 1,459 0 03 Jun 2019
Putting An End to End-to-End: Gradient-Isolated Learning of Representations Sindy Löwe Peter O'Connor Bastiaan S. Veeling SSL 16 143 0 28 May 2019
Self-supervised audio representation learning for mobile devices Marco Tagliasacchi Beat Gfeller Félix de Chaumont Quitry Dominik Roblek SSL AI4TS 13 46 0 24 May 2019
Unsupervised Discovery of Temporal Structure in Noisy Data with Dynamical Components Analysis David G. Clark J. Livezey K. Bouchard AI4TS 41 24 0 23 May 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 72 1,418 0 22 May 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 28 799 0 16 May 2019
Meta reinforcement learning as task inference Jan Humplik Alexandre Galashov Leonard Hasenclever Pedro A. Ortega Yee Whye Teh N. Heess OffRL 56 127 0 15 May 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 31 396 0 03 May 2019
Biphasic Learning of GANs for High-Resolution Image-to-Image Translation Jie Cao Huaibo Huang Yi Li Jingtuo Liu Ran He Zhenan Sun GAN 26 4 0 14 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 44 444 0 29 Mar 2019
Wasserstein Dependency Measure for Representation Learning Sherjil Ozair Corey Lynch Yoshua Bengio Aaron van den Oord Sergey Levine P. Sermanet SSL DRL 30 116 0 28 Mar 2019
Hierarchical Autoregressive Image Models with Auxiliary Decoders J. Fauw Sander Dieleman Karen Simonyan GAN 35 37 0 06 Mar 2019
World Discovery Models M. G. Azar Bilal Piot Bernardo Avila-Pires Jean-Bastien Grill Florent Altché Rémi Munos 42 26 0 20 Feb 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 82 715 0 25 Jan 2019
Maximum Entropy Generators for Energy-Based Models Rithesh Kumar Sherjil Ozair Anirudh Goyal Aaron Courville Yoshua Bengio 19 112 0 24 Jan 2019
Deep Clustering with a Dynamic Autoencoder: From Reconstruction towards Centroids Construction Nairouz Mrabah N. Khan Riadh Ksantini Z. Lachiri 28 63 0 23 Jan 2019
Mid-Level Visual Representations Improve Generalization and Sample Efficiency for Learning Visuomotor Policies Alexander Sax Bradley Emi Amir Zamir Leonidas Guibas Silvio Savarese Jitendra Malik SSL 49 16 0 31 Dec 2018
Learning Speaker Representations with Mutual Information Mirco Ravanelli Yoshua Bengio SSL DRL 27 91 0 01 Dec 2018
Learning Actionable Representations with Goal-Conditioned Policies Dibya Ghosh Abhishek Gupta Sergey Levine 37 109 0 19 Nov 2018
Neural Predictive Belief Representations Z. Guo M. G. Azar Bilal Piot Bernardo Avila-Pires Rémi Munos SSL 24 80 0 15 Nov 2018
Improving Generalization for Abstract Reasoning Tasks Using Disentangled Feature Representations Xander Steenbrugge Sam Leroux Tim Verbelen Bart Dhoedt OOD DRL 22 68 0 12 Nov 2018
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 33 274 0 10 Nov 2018
Neural Image Compression for Gigapixel Histopathology Image Analysis David Tellez G. Litjens Jeroen van der Laak F. Ciompi 35 206 0 07 Nov 2018
Invertible Residual Networks Jens Behrmann Will Grathwohl Ricky T. Q. Chen David Duvenaud J. Jacobsen UQCV TPM 53 620 0 02 Nov 2018
One Size Does Not Fit All: Generating and Evaluating Variable Number of Keyphrases Xingdi Yuan Tong Wang Rui Meng Khushboo Thaker Peter Brusilovsky Daqing He Adam Trischler 32 102 0 11 Oct 2018
Unsupervised Learning via Meta-Learning Kyle Hsu Sergey Levine Chelsea Finn SSL OffRL 37 229 0 04 Oct 2018
Near-Optimal Representation Learning for Hierarchical Reinforcement Learning Ofir Nachum S. Gu Honglak Lee Sergey Levine 33 206 0 02 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 97 2,643 0 20 Aug 2018
Playing hard exploration games by watching YouTube Y. Aytar Tobias Pfaff David Budden T. Paine Ziyun Wang Nando de Freitas 35 269 0 29 May 2018
Mutual Information Maximization for Simple and Accurate Part-Of-Speech Induction K. Stratos 26 26 0 20 Apr 2018