A Mutual Information Maximization Perspective of Language Representation Learning

18 October 2019

Lingpeng Kong

Cyprien de Masson dÁutume

Papers citing "A Mutual Information Maximization Perspective of Language Representation Learning"

50 / 105 papers shown

Title
Constructing Fair Latent Space for Intersection of Fairness and Explainability Hyungjun Joo Hyeonggeun Han Sehwan Kim Sangwoo Hong Jungwoo Lee 40 0 0 23 Dec 2024
Leveraging Superfluous Information in Contrastive Representation Learning Xuechu Yu SSL 32 1 0 19 Aug 2024
Pacer and Runner: Cooperative Learning Framework between Single- and Cross-Domain Sequential Recommendation Chung Park Taesan Kim Hyungjun Yoon Junui Hong Yelim Yu Mincheol Cho Minsung Choi Jaegul Choo 33 4 0 15 Jul 2024
Representation Learning with Conditional Information Flow Maximization Dou Hu Lingwei Wei Wei Zhou Songlin Hu SSL 45 1 0 08 Jun 2024
Improving Group Robustness on Spurious Correlation Requires Preciser Group Inference Yujin Han Difan Zou AAML 34 3 0 22 Apr 2024
Robust Graph Structure Learning under Heterophily Xuanting Xie Zhao Kang Wenyu Chen 44 3 0 06 Mar 2024
Does Negative Sampling Matter? A Review with Insights into its Theory and Applications Zhen Yang Ming Ding Tinglin Huang Yukuo Cen Junshuai Song Bin Xu Yuxiao Dong Jie Tang 36 9 0 27 Feb 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
Machine Unlearning for Image-to-Image Generative Models Guihong Li Hsiang Hsu Chun-Fu Chen R. Marculescu MU VLM 70 25 0 01 Feb 2024
Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective Alexander H. Liu Sung-Lin Yeh James R. Glass SSL 24 3 0 16 Jan 2024
Invariant Anomaly Detection under Distribution Shifts: A Causal Perspective João B. S. Carvalho Mengtao Zhang Robin Geyer C. Jiménez J. M. Buhmann 23 5 0 21 Dec 2023
EdgePruner: Poisoned Edge Pruning in Graph Contrastive Learning Hiroya Kato Kento Hasegawa Seira Hidano Kazuhide Fukushima AAML 32 0 0 12 Dec 2023
Prompt-based Logical Semantics Enhancement for Implicit Discourse Relation Recognition Chenxu Wang Ping Jian Mu Huang 11 5 0 01 Nov 2023
Understanding Contrastive Learning via Distributionally Robust Optimization Junkang Wu Jiawei Chen Jiancan Wu Wentao Shi Xiang Wang Xiangnan He 32 24 0 17 Oct 2023
Self-supervised Representation Learning From Random Data Projectors Yi Sui Tongzi Wu Jesse C. Cresswell Ga Wu George Stein Xiao Shi Huang Xiaochen Zhang M. Volkovs 32 10 0 11 Oct 2023
Gene-induced Multimodal Pre-training for Image-omic Classification Ting Jin Xingran Xie Renjie Wan Qingli Li Yan Wang AI4CE 44 11 0 06 Sep 2023
kTrans: Knowledge-Aware Transformer for Binary Code Embedding Wenyu Zhu Hao Wang Yuchen Zhou Jiaming Wang Zihan Sha Zeyu Gao Chao Zhang 32 10 0 24 Aug 2023
Multimodal Molecular Pretraining via Modality Blending Qiying Yu Yudi Zhang Yuyan Ni Shi Feng Yanyan Lan Hao Zhou Jingjing Liu 21 13 0 12 Jul 2023
DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification Kuan-Yu Chen Cheng Li Kuo-Jung Lee 28 1 0 12 Jul 2023
Learning Unnormalized Statistical Models via Compositional Optimization Wei Jiang Jiayu Qin Lingyu Wu Changyou Chen Tianbao Yang Lijun Zhang 28 3 0 13 Jun 2023
Enhancing the Unified Streaming and Non-streaming Model with Contrastive Learning Yuting Yang Yuke Li Binbin Du AI4TS 33 0 0 01 Jun 2023
Beyond Individual Input for Deep Anomaly Detection on Tabular Data Hugo Thimonier Fabrice Popineau Arpad Rimmel Bich-Liên Doan 20 5 0 24 May 2023
A Simplified Framework for Contrastive Learning for Node Representations Ilgee Hong Huy Tran Claire Donnat SSL 19 1 0 01 May 2023
Improving Items and Contexts Understanding with Descriptive Graph for Conversational Recommendation H. Dao Dung D. Le C. Chu 28 2 0 11 Apr 2023
InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling Xiaobao Wu Xinshuai Dong Thong Nguyen Chaoqun Liu Liangming Pan Anh Tuan Luu 33 23 0 07 Apr 2023
Rethinking the Effect of Data Augmentation in Adversarial Contrastive Learning Rundong Luo Yifei Wang Yisen Wang 34 25 0 02 Mar 2023
Multi-Task Self-Supervised Time-Series Representation Learning Heejeong Choi Pilsung Kang AI4TS SSL 52 11 0 02 Mar 2023
Adapting a Language Model While Preserving its General Knowledge Zixuan Ke Yijia Shao Haowei Lin Hu Xu Lei Shu Bin Liu KELM CLL VLM 39 20 0 21 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 124 0 13 Jan 2023
What Makes for Good Tokenizers in Vision Transformer? Shengju Qian Yi Zhu Wenbo Li Mu Li Jiaya Jia ViT 37 14 0 21 Dec 2022
MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling Zhaoheng Huang Zhicheng Dou Yutao Zhu Zhengyi Ma 50 8 0 17 Oct 2022
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective Baijun Ji Tong Zhang Yicheng Zou Bojie Hu Sitian Shen 25 12 0 16 Oct 2022
How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders Qi Zhang Yifei Wang Yisen Wang 25 73 0 15 Oct 2022
Multi-Modal Recommendation System with Auxiliary Information Mufhumudzi Muthivhi Terence L van Zyl Hairong Wang 8 2 0 13 Oct 2022
Entropy-driven Unsupervised Keypoint Representation Learning in Videos A. Younes Simone Schaub-Meyer Georgia Chalvatzaki SSL 33 0 0 30 Sep 2022
A Hierarchical Interactive Network for Joint Span-based Aspect-Sentiment Analysis Wei Chen Jinglong Du Zhao Zhang Fuzhen Zhuang Zhongshi He 20 6 0 24 Aug 2022
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 30 15 0 20 Aug 2022
CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation Jinfeng Zhou Chujie Zheng Bo Wang Zheng Zhang Minlie Huang 26 29 0 18 Aug 2022
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training Yan Zeng Wangchunshu Zhou Ao Luo Ziming Cheng Xinsong Zhang VLM 27 30 0 01 Jun 2022
RevUp: Revise and Update Information Bottleneck for Event Representation Mehdi Rezaee Francis Ferraro 27 0 0 24 May 2022
Hyperspectral Image Classification With Contrastive Graph Convolutional Network Wentao Yu Sheng Wan Guangyu Li Jian Yang Chen Gong 43 25 0 11 May 2022
Statistical applications of contrastive learning Michael U. Gutmann Steven Kleinegesse Benjamin Rhodes 24 7 0 29 Apr 2022
Cross-Lingual Phrase Retrieval Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 32 3 0 19 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 21 4 0 18 Apr 2022
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation Xiangpeng Wei Heng Yu Yue Hu Rongxiang Weng Weihua Luo Jun Xie Rong Jin CLL 17 24 0 14 Apr 2022
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 28 25 0 08 Apr 2022
Decentralized Collaborative Learning Framework for Next POI Recommendation Jing Long Tong Chen Nguyen Quoc Viet Hung Hongzhi Yin 25 61 0 30 Mar 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 11 11 0 27 Feb 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Kun Zhang Louis-Philippe Morency Ruslan Salakhutdinov 19 25 0 11 Feb 2022
Representation Learning for Conversational Data using Discourse Mutual Information Maximization Bishal Santra Sumegh Roychowdhury Aishik Mandal Vasu Gurram Atharva Naik Manish Gupta Pawan Goyal SSL 24 4 0 04 Dec 2021