Contrastive Code Representation Learning

9 July 2020

Paras Jain

Ajay Jain

Tianjun Zhang

Pieter Abbeel

Papers citing "Contrastive Code Representation Learning"

50 / 56 papers shown

Title
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 146 5,328 0 07 Jul 2021
Scaling Laws for Transfer Danny Hernandez Jared Kaplan T. Henighan Sam McCandlish 46 242 0 02 Feb 2021
You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion R. Schuster Congzheng Song Eran Tromer Vitaly Shmatikov SILM AAML 73 152 0 05 Jul 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 47 558 0 01 Jul 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 78 494 0 05 Jun 2020
On Mutual Information in Contrastive Learning for Visual Representations Mike Wu Chengxu Zhuang Milan Mossé Daniel L. K. Yamins Noah D. Goodman SSL 39 83 0 27 May 2020
CERT: Contrastive Self-supervised Learning for Language Understanding Hongchao Fang Sicheng Wang Meng Zhou Jiayuan Ding P. Xie ELM SSL 49 336 0 16 May 2020
A Transformer-based Approach for Source Code Summarization Wasi Uddin Ahmad Saikat Chakraborty Baishakhi Ray Kai-Wei Chang ViT 70 377 0 01 May 2020
LambdaNet: Probabilistic Type Inference using Graph Neural Networks Jiayi Wei Maruth Goyal Greg Durrett Işıl Dillig 42 108 0 29 Apr 2020
SCELMo: Source Code Embeddings from Language Models Rafael-Michael Karampatsis Charles Sutton 41 52 0 28 Apr 2020
Evaluation of Generalizability of Neural Program Analyzers under Semantic-Preserving Transformations Md Rafiqul Islam Rabin Mohammad Amin Alipour NAI 52 20 0 15 Apr 2020
Typilus: Neural Type Hints Miltiadis Allamanis Earl T. Barr Soline Ducousso Zheng Gao 107 131 0 06 Apr 2020
OptTyper: Probabilistic Type Inference by Optimising Logical and Natural Constraints Irene Vlassi Pandi Earl T. Barr Andrew D. Gordon Charles Sutton 82 29 0 01 Apr 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 418 3,397 0 09 Mar 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 126 2,570 0 19 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 194 18,523 0 13 Feb 2020
Adversarial Robustness for Code Pavol Bielik Martin Vechev AAML 22 89 0 11 Feb 2020
Synthetic Datasets for Neural Program Synthesis Richard Shin Neel Kant Kavi Gupta Christopher M. Bender Brandon Trabucco Rishabh Singh D. Song NAI 82 45 0 27 Dec 2019
Learning and Evaluating Contextual Embedding of Source Code Aditya Kanade Petros Maniatis Gogul Balakrishnan Kensen Shi ELM 55 76 0 21 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 99 11,959 0 13 Nov 2019
Adversarial Examples for Models of Code Noam Yefet Uri Alon Eran Yahav SILM AAML MLAU 57 164 0 15 Oct 2019
Deep Transfer Learning for Source Code Modeling Yasir Hussain Zhiqiu Huang Yu Zhou Senzhang Wang 37 21 0 12 Oct 2019
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search Hamel Husain Hongqiu Wu Tiferet Gazit Miltiadis Allamanis Marc Brockschmidt ELM 114 1,062 0 20 Sep 2019
Visualizing and Understanding the Effectiveness of BERT Y. Hao Li Dong Furu Wei Ke Xu 94 183 0 15 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 392 24,160 0 26 Jul 2019
Mercem: Method Name Recommendation Based on Call Graph Embedding Hiroshi Yonai Yasuhiro Hayase H. Kitagawa 24 15 0 12 Jul 2019
Learning Blended, Precise Semantic Program Embeddings Ke Wang Z. Su NAI 37 25 0 03 Jul 2019
Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty Dan Hendrycks Mantas Mazeika Saurav Kadavath D. Song OOD SSL 31 940 0 28 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 129 2,385 0 13 Jun 2019
COSET: A Benchmark for Evaluating Neural Program Embeddings Ke Wang Mihai Christodorescu 23 37 0 27 May 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 91 1,422 0 22 May 2019
Adversarial Examples Are Not Bugs, They Are Features Andrew Ilyas Shibani Santurkar Dimitris Tsipras Logan Engstrom Brandon Tran Aleksander Madry SILM 80 1,825 0 06 May 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 86 768 0 25 Feb 2019
The Adverse Effects of Code Duplication in Machine Learning Models of Code Miltiadis Allamanis 47 319 0 16 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 914 93,936 0 11 Oct 2018
Ithemal: Accurate, Portable and Fast Basic Block Throughput Estimation using Deep Neural Networks Charith Mendis Alex Renda Saman P. Amarasinghe Michael Carbin 22 152 0 21 Aug 2018
code2seq: Generating Sequences from Structured Representations of Code Uri Alon Shaked Brody Omer Levy Eran Yahav 46 695 0 04 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 220 10,152 0 10 Jul 2018
Neural Code Comprehension: A Learnable Representation of Code Semantics Tal Ben-Nun Alice Shoshana Jakobovits Torsten Hoefler 37 240 0 19 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 146 3,437 0 05 May 2018
Exploring the Limits of Weakly Supervised Pretraining D. Mahajan Ross B. Girshick Vignesh Ramanathan Kaiming He Manohar Paluri Yixuan Li Ashwin R. Bharambe Laurens van der Maaten VLM 162 1,362 0 02 May 2018
Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates Taku Kudo 144 1,153 0 29 Apr 2018
code2vec: Learning Distributed Representations of Code Uri Alon Meital Zilberstein Omer Levy Eran Yahav 50 1,164 0 26 Mar 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 192 3,272 0 21 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 104 11,520 0 15 Feb 2018
A Survey of Machine Learning for Big Code and Naturalness Miltiadis Allamanis Earl T. Barr Premkumar T. Devanbu Charles Sutton 97 846 0 18 Sep 2017
Challenges in Data-to-Document Generation Sam Wiseman Stuart M. Shieber Alexander M. Rush 98 586 0 25 Jul 2017
Device Placement Optimization with Reinforcement Learning Azalia Mirhoseini Hieu H. Pham Quoc V. Le Benoit Steiner Rasmus Larsen Yuefeng Zhou Naveen Kumar Mohammad Norouzi Samy Bengio J. Dean 51 438 0 13 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 430 129,831 0 12 Jun 2017
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 46 5,277 0 25 Apr 2016