Notes on Noise Contrastive Estimation and Negative Sampling

30 October 2014

Papers citing "Notes on Noise Contrastive Estimation and Negative Sampling"

42 / 42 papers shown

Title
Breast tumor classification based on self-supervised contrastive learning from ultrasound videos Yunxin Tang Siyuan Tang Jian Zhang Hao Chen SSL 26 0 0 20 Aug 2024
EG-ConMix: An Intrusion Detection Method based on Graph Contrastive Learning Lijin Wu Shanshan Lei Feilong Liao Yuanjun Zheng Yuxin Liu Wentao Fu Hao Song Jiajun Zhou 45 1 0 24 Mar 2024
CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledge Xiao Lin Minghao Zhu Ronghao Dang Guangliang Zhou Shaolong Shu Feng Lin Chengju Liu Qi Chen CLIP 55 8 0 24 Feb 2024
Degradation-Aware Self-Attention Based Transformer for Blind Image Super-Resolution Qingguo Liu Pan Gao Kang Han Ningzhong Liu Weikang Xiang ViT 33 10 0 06 Oct 2023
Knowledge Graph Embeddings in the Biomedical Domain: Are They Useful? A Look at Link Prediction, Rule Learning, and Downstream Polypharmacy Tasks Aryo Pradipta Gema Dominik Grabarczyk Wolf De Wulf Piyush Borole J. Alfaro Pasquale Minervini Antonio Vergari A. Rajan 30 10 0 31 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 50 275 0 24 Apr 2023
PARFormer: Transformer-based Multi-Task Network for Pedestrian Attribute Recognition Xinwen Fan Yukang Zhang Yang Lu Hanzi Wang ViT 29 29 0 14 Apr 2023
Neural networks for learning personality traits from natural language Giorgia Adorni GNN 22 0 0 23 Feb 2023
Bridging the Emotional Semantic Gap via Multimodal Relevance Estimation Chuan Zhang Daoxin Zhang Ruixiu Zhang Jiawei Li Jianke Zhu 35 1 0 03 Feb 2023
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 62 0 07 Sep 2022
Word Embedding for Social Sciences: An Interdisciplinary Survey Akira Matsui Emilio Ferrara 21 5 0 07 Jul 2022
Comprehensive Analysis of Negative Sampling in Knowledge Graph Representation Learning Hidetaka Kamigaito Katsuhiko Hayashi 11 25 0 21 Jun 2022
Intra-agent speech permits zero-shot task acquisition Chen Yan Federico Carnevale Petko Georgiev Adam Santoro Aurelia Guy Alistair Muldal Chia-Chun Hung Josh Abramson Timothy Lillicrap Greg Wayne LM&Ro 46 9 0 07 Jun 2022
From $t$ -SNE to UMAP with contrastive learning Sebastian Damrich Jan Niklas Böhm Fred Hamprecht D. Kobak SSL 48 21 0 03 Jun 2022
Brainish: Formalizing A Multimodal Language for Intelligence and Consciousness Paul Pu Liang 30 4 0 14 Apr 2022
Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimation Bingbin Liu Elan Rosenfeld Pradeep Ravikumar Andrej Risteski 25 13 0 21 Oct 2021
Residual2Vec: Debiasing graph embedding with random graphs Sadamori Kojaku Jisung Yoon I. Constantino Yong-Yeol Ahn CML 45 23 0 14 Oct 2021
Unified Interpretation of Softmax Cross-Entropy and Negative Sampling: With Case Study for Knowledge Graph Embedding Hidetaka Kamigaito Katsuhiko Hayashi 21 11 0 14 Jun 2021
On Sampling-Based Training Criteria for Neural Language Modeling Yingbo Gao David Thulke Alexander Gerstenberger Viet Anh Khoa Tran Ralf Schluter Hermann Ney 25 2 0 21 Apr 2021
Weather Analogs with a Machine Learning Similarity Metric for Renewable Resource Forecasting Weiming Hu G. Cervone George Young L. D. Monache 21 2 0 08 Mar 2021
Exploring the Limits of Few-Shot Link Prediction in Knowledge Graphs Dora Jambor Komal K. Teru Joelle Pineau William L. Hamilton 14 9 0 05 Feb 2021
Calibrating and Improving Graph Contrastive Learning Kaili Ma Haochen Yang Han Yang Yongqiang Chen James Cheng 52 6 0 27 Jan 2021
Social NCE: Contrastive Learning of Socially-aware Motion Representations Yuejiang Liu Qi Yan Alexandre Alahi 34 101 0 21 Dec 2020
Neural Methods for Effective, Efficient, and Exposure-Aware Information Retrieval Bhaskar Mitra 20 5 0 21 Dec 2020
Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment Paul Pu Liang Peter Wu Liu Ziyin Louis-Philippe Morency Ruslan Salakhutdinov 33 30 0 04 Dec 2020
A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks Nikunj Saunshi Sadhika Malladi Sanjeev Arora 33 87 0 07 Oct 2020
Evaluating a Generative Adversarial Framework for Information Retrieval Ameet Deshpande Mitesh M. Khapra 13 0 0 01 Oct 2020
Likelihood Ratios and Generative Classifiers for Unsupervised Out-of-Domain Detection In Task Oriented Dialog Varun Gangal Abhinav Arora Arash Einolghozati S. Gupta OODD 14 53 0 30 Dec 2019
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 33 313 0 04 Dec 2019
Long-span language modeling for speech recognition S. Parthasarathy W. Gale Xie Chen George Polovets Shuangyu Chang RALM 14 10 0 11 Nov 2019
Neural Embedding Allocation: Distributed Representations of Topic Models Kamrun Naher Keya Yannis Papanikolaou James R. Foulds BDL 27 5 0 10 Sep 2019
Follow the Leader: Documents on the Leading Edge of Semantic Change Get More Citations Sandeep Soni Kristina Lerman Jacob Eisenstein AI4TS 37 12 0 09 Sep 2019
Improving Textual Network Embedding with Global Attention via Optimal Transport Liqun Chen Guoyin Wang Chenyang Tao Dinghan Shen Pengyu Cheng Xinyuan Zhang Wenlin Wang Yizhe Zhang Lawrence Carin GNN OT 14 21 0 05 Jun 2019
Compositional Fairness Constraints for Graph Embeddings A. Bose William L. Hamilton FaML 22 256 0 25 May 2019
Characterization of citizens using word2vec and latent topic analysis in a large set of tweets V. Vladimir Camargo Jorge 11 41 0 15 Apr 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 62 764 0 25 Feb 2019
GANE: A Generative Adversarial Network Embedding Huiting Hong Xin Li Mingzhong Wang GAN 21 30 0 18 May 2018
Adversarial Contrastive Estimation A. Bose Huan Ling Yanshuai Cao 13 56 0 09 May 2018
Slim Embedding Layers for Recurrent Neural Language Models Zhongliang Li Raymond Kulhanek Shaojun Wang Yunxin Zhao Shuang Wu KELM 32 23 0 27 Nov 2017
A Simple Language Model based on PMI Matrix Approximations Oren Melamud Ido Dagan Jacob Goldberger 14 11 0 17 Jul 2017
PMI Matrix Approximations with Applications to Neural Language Modeling Oren Melamud Ido Dagan Jacob Goldberger 14 4 0 05 Sep 2016
Modelling Context with User Embeddings for Sarcasm Detection in Social Media Silvio Amir Byron C. Wallace Hao Lyu Mário J. Silva 20 252 0 04 Jul 2016