A Mutual Information Maximization Perspective of Language Representation Learning

18 October 2019

Lingpeng Kong

Cyprien de Masson dÁutume

Papers citing "A Mutual Information Maximization Perspective of Language Representation Learning"

37 / 37 papers shown

Title
Constructing Fair Latent Space for Intersection of Fairness and Explainability Hyungjun Joo Hyeonggeun Han Sehwan Kim Sangwoo Hong Jungwoo Lee 40 0 0 23 Dec 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
kTrans: Knowledge-Aware Transformer for Binary Code Embedding Wenyu Zhu Hao Wang Yuchen Zhou Jiaming Wang Zihan Sha Zeyu Gao Chao Zhang 32 10 0 24 Aug 2023
DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification Kuan-Yu Chen Cheng Li Kuo-Jung Lee 28 1 0 12 Jul 2023
InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling Xiaobao Wu Xinshuai Dong Thong Nguyen Chaoqun Liu Liangming Pan Anh Tuan Luu 28 23 0 07 Apr 2023
MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling Zhaoheng Huang Zhicheng Dou Yutao Zhu Zhengyi Ma 42 8 0 17 Oct 2022
Entropy-driven Unsupervised Keypoint Representation Learning in Videos A. Younes Simone Schaub-Meyer Georgia Chalvatzaki SSL 33 0 0 30 Sep 2022
A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis Wei Chen Jinglong Du Zhao Zhang Fuzhen Zhuang Zhongshi He 20 6 0 24 Aug 2022
RevUp: Revise and Update Information Bottleneck for Event Representation Mehdi Rezaee Francis Ferraro 27 0 0 24 May 2022
Statistical applications of contrastive learning Michael U. Gutmann Steven Kleinegesse Benjamin Rhodes 21 7 0 29 Apr 2022
Cross-Lingual Phrase Retrieval Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 32 3 0 19 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 19 4 0 18 Apr 2022
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation Xiangpeng Wei Heng Yu Yue Hu Rongxiang Weng Weihua Luo Jun Xie Rong Jin CLL 17 24 0 14 Apr 2022
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 28 25 0 08 Apr 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Anton van den Hengel Louis-Philippe Morency Ruslan Salakhutdinov 19 25 0 11 Feb 2022
Representation Learning for Conversational Data using Discourse Mutual Information Maximization Bishal Santra Sumegh Roychowdhury Aishik Mandal Vasu Gurram Atharva Naik Manish Gupta Pawan Goyal SSL 16 4 0 04 Dec 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 13 30 0 31 Aug 2021
Deep Dive into Semi-Supervised ELBO for Improving Classification Performance Fahim Faisal Niloy M. A. Amin Akm Mahbubur Rahman A. Ali DRL 25 0 0 29 Aug 2021
ProtoInfoMax: Prototypical Networks with Mutual Information Maximization for Out-of-Domain Detection Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 27 5 0 27 Aug 2021
An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers Lu Wang Munif Ishad Mujib Jake Williams G. Demiris Jina Huh-Yoo AI4MH 27 32 0 28 Jul 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq R. Joty Caiming Xiong S. Hoi FaML 56 1,886 0 16 Jul 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 37 815 0 14 Jun 2021
Self-Supervised Graph Learning with Proximity-based Views and Channel Contrast Wei Zhuo Guang Tan SSL 19 0 0 07 Jun 2021
CLEVE: Contrastive Pre-training for Event Extraction Ziqi Wang Xiaozhi Wang Xu Han Yankai Lin Lei Hou Zhiyuan Liu Peng Li Juan-Zi Li Jie Zhou 34 116 0 30 May 2021
Divide and Contrast: Self-supervised Learning from Uncurated Data Yonglong Tian Olivier J. Hénaff Aaron van den Oord SSL 64 96 0 17 May 2021
Composable Augmentation Encoding for Video Representation Learning Chen Sun Arsha Nagrani Yonglong Tian Cordelia Schmid SSL AI4TS 32 17 0 01 Apr 2021
The Rediscovery Hypothesis: Language Models Need to Meet Linguistics Vassilina Nikoulina Maxat Tezekbayev Nuradil Kozhakhmet Madina Babazhanova Matthias Gallé Z. Assylbekov 34 8 0 02 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 90 90 0 25 Feb 2021
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 52 125 0 30 Dec 2020
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective Wei Ping Shuohang Wang Yu Cheng Zhe Gan R. Jia Bo-wen Li Jingjing Liu AAML 43 113 0 05 Oct 2020
S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization Kun Zhou Haibo Wang Wayne Xin Zhao Yutao Zhu Sirui Wang Fuzheng Zhang Zhongyuan Wang Ji-Rong Wen 28 781 0 18 Aug 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 44 1,586 0 15 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 19 489 0 05 Jun 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 48 229 0 05 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 39 1,305 0 20 May 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,959 0 20 Apr 2018