Representation Learning with Contrastive Predictive Coding

10 July 2018

Papers citing "Representation Learning with Contrastive Predictive Coding"

50 / 2,551 papers shown

Title
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
Wav2vec-Switch: Contrastive Learning from Original-noisy Speech Pairs for Robust Speech Recognition Yiming Wang Jinyu Li Heming Wang Yao Qian Chengyi Wang Yu Wu 40 48 0 11 Oct 2021
Injecting Text and Cross-lingual Supervision in Few-shot Learning from Self-Supervised Models Sanjeev Khudanpur Desh Raj Sanjeev Khudanpur 64 6 0 10 Oct 2021
Vector-quantized Image Modeling with Improved VQGAN Jiahui Yu Xin Li Jing Yu Koh Han Zhang Ruoming Pang James Qin Alexander Ku Yuanzhong Xu Jason Baldridge Yonghui Wu ViT VLM DRL 54 489 0 09 Oct 2021
Universal Paralinguistic Speech Representations Using Self-Supervised Conformers Joel Shor A. Jansen Wei Han Daniel S. Park Yu Zhang SSL AI4TS 48 54 0 09 Oct 2021
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition Xuankai Chang Takashi Maekaku Pengcheng Guo Jing Shi Yen-Ju Lu ... Tianzi Wang Shu-Wen Yang Yu Tsao Hung-yi Lee Shinji Watanabe SSL AI4TS 24 81 0 09 Oct 2021
X-model: Improving Data Efficiency in Deep Learning with A Minimax Model Ximei Wang Xinyang Chen Jianmin Wang Mingsheng Long 32 1 0 09 Oct 2021
Unsupervised Representation Learning Meets Pseudo-Label Supervised Self-Distillation: A New Approach to Rare Disease Classification Jinghan Sun Dong Wei Kai Ma Liansheng Wang Yefeng Zheng 32 8 0 09 Oct 2021
Temperature as Uncertainty in Contrastive Learning Oliver Zhang Mike Wu Jasmine Bayrooti Noah D. Goodman UQCV 27 30 0 08 Oct 2021
SubTab: Subsetting Features of Tabular Data for Self-Supervised Representation Learning Talip Uçar Ehsan Hajiramezanali Lindsay Edwards LMTD SSL 39 124 0 08 Oct 2021
Cognitive Coding of Speech Reza Lotfidereshgi P. Gournay 38 5 0 08 Oct 2021
3D Infomax improves GNNs for Molecular Property Prediction Hannes Stärk Dominique Beaini Gabriele Corso Prudencio Tossou Christian Dallago Stephan Günnemann Pietro Lio AI4CE 39 204 0 08 Oct 2021
RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Training Ziyue Qiao Yanjie Fu Pengyang Wang Meng Xiao Zhiyuan Ning Denghui Zhang Yi Du Yuanchun Zhou 34 13 0 08 Oct 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 126 304 0 07 Oct 2021
Mandarin-English Code-switching Speech Recognition with Self-supervised Speech Representation Models Liang-Hsuan Tseng Yu-Kuan Fu Heng-Jui Chang Hung-yi Lee SSL 28 14 0 07 Oct 2021
Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu 153 212 0 07 Oct 2021
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 61 31 0 06 Oct 2021
KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier Linyang Li Demin Song Ruotian Ma Xipeng Qiu Xuanjing Huang 31 21 0 06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 46 19 0 06 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Zou Linjun Zhang SSL 55 49 0 06 Oct 2021
Unsupervised Speech Segmentation and Variable Rate Representation Learning using Segmental Contrastive Predictive Coding Saurabhchand Bhati Jesús Villalba Piotr Żelasko Laureano Moro-Velazquez Najim Dehak SSL 61 22 0 05 Oct 2021
ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning Jun Xia Lirong Wu Ge Wang Jintao Chen Stan Z. Li 30 121 0 05 Oct 2021
DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT Heng-Jui Chang Shu-Wen Yang Hung-yi Lee SSL 43 165 0 05 Oct 2021
Wireless Link Scheduling via Graph Representation Learning: A Comparative Study of Different Supervision Levels Navid Naderializadeh 49 3 0 04 Oct 2021
Deep Fraud Detection on Non-attributed Graph Chen Wang Yingtong Dou Min Chen Jia Chen Zhiwei Liu Philip S. Yu GNN 35 19 0 04 Oct 2021
Counterfactual Samples Synthesizing and Training for Robust Visual Question Answering Long Chen Yuhang Zheng Yulei Niu Hanwang Zhang Jun Xiao AAML OOD 23 36 0 03 Oct 2021
Seeking Visual Discomfort: Curiosity-driven Representations for Reinforcement Learning Elie Aljalbout Maximilian Ulmer Rudolph Triebel 24 2 0 02 Oct 2021
Stochastic Contrastive Learning Jason Ramapuram Dan Busbridge Xavier Suau Russ Webb BDL SSL 44 3 0 01 Oct 2021
Do Self-Supervised and Supervised Methods Learn Similar Visual Representations? Tom George Grigg Dan Busbridge Jason Ramapuram Russ Webb SSL DRL 27 27 0 01 Oct 2021
DualNet: Continual Learning, Fast and Slow Quang Pham Chenghao Liu Guosheng Lin CLL 77 44 0 01 Oct 2021
Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation Jay Patravali Gaurav Mittal Ye Yu Fuxin Li Mei Chen 18 19 0 30 Sep 2021
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging Shuangrui Ding Maomao Li Tianyu Yang Rui Qian Haohang Xu Qingyi Chen Jue Wang Hongkai Xiong SSL 32 50 0 30 Sep 2021
CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations Mohammadreza Zolfaghari Yi Zhu Peter V. Gehler Thomas Brox 137 127 0 30 Sep 2021
Comparison of Self-Supervised Speech Pre-Training Methods on Flemish Dutch Jakob Poncelet Hugo Van hamme SSL 28 1 0 29 Sep 2021
Adaptive Multi-layer Contrastive Graph Neural Networks S. Shi Pengfei Xie Xu Luo Kai Qiao Linyuan Wang Jian Chen B. Yan OOD 24 5 0 29 Sep 2021
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding Hu Xu Gargi Ghosh Po-Yao (Bernie) Huang Dmytro Okhonko Armen Aghajanyan Florian Metze Luke Zettlemoyer Florian Metze Luke Zettlemoyer Christoph Feichtenhofer CLIP VLM 259 561 0 28 Sep 2021
A Contrastive Learning Approach to Auroral Identification and Classification Jeremiah W. Johnson Swathi Hari D. Hampton H. Connor A. Keesee 13 4 0 28 Sep 2021
Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning Zixu Zhao Yueming Jin Pheng-Ann Heng SSL 42 21 0 28 Sep 2021
Instance-Based Neural Dependency Parsing Hiroki Ouchi Jun Suzuki Sosuke Kobayashi Sho Yokoi Tatsuki Kuribayashi Masashi Yoshikawa Kentaro Inui 44 3 0 28 Sep 2021
BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition Yu Zhang Daniel S. Park Wei Han James Qin Anmol Gulati ... Zhifeng Chen Quoc V. Le Chung-Cheng Chiu Ruoming Pang Yonghui Wu SSL 34 175 0 27 Sep 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 97 29 0 27 Sep 2021
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings Che Liu Rui Wang Jinghua Liu Jian Sun Fei Huang Luo Si 48 40 0 26 Sep 2021
Structure-Preserving Image Super-Resolution Cheng Ma Yongming Rao Jiwen Lu Jie Zhou SupR 31 65 0 26 Sep 2021
Hard-sample Guided Hybrid Contrast Learning for Unsupervised Person Re-Identification Zheng Hu Chuang Zhu Gang He SSL 60 37 0 25 Sep 2021
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation An Yan Zexue He Xing Lu Jingfeng Du E. Chang Amilcare Gentili Julian McAuley Chun-Nan Hsu MedIm 88 64 0 25 Sep 2021
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition Qiantong Xu Alexei Baevski Michael Auli VLM 34 79 0 23 Sep 2021
Long Short View Feature Decomposition via Contrastive Video Representation Learning Nadine Behrmann Mohsen Fayyaz Juergen Gall M. Noroozi 18 36 0 23 Sep 2021
Multi-view Contrastive Self-Supervised Learning of Accounting Data Representations for Downstream Audit Tasks Marco Schreyer Timur Sattarov Damian Borth MLAU 37 15 0 23 Sep 2021
Learning Contrastive Representation for Semantic Correspondence Taihong Xiao Sifei Liu Shalini De Mello Zhiding Yu Jan Kautz Ming-Hsuan Yang SSL 90 15 0 22 Sep 2021
Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation Yuanxun Lu Jinxiang Chai Xun Cao 31 84 0 22 Sep 2021