Specializing Word Embeddings (for Parsing) by Information Bottleneck

1 October 2019

Xiang Lisa Li

Papers citing "Specializing Word Embeddings (for Parsing) by Information Bottleneck"

41 / 41 papers shown

Title
Learning Distribution-Wise Control in Representation Space for Language Models Chunyuan Deng Ruidi Chang Hanjie Chen 24 0 0 07 Jun 2025
Mitigating Hallucinations in Large Vision-Language Models by Adaptively Constraining Information Flow Jiaqi Bai Hongcheng Guo Zhongyuan Peng Jian Yang Zhiyu Li Mingze Li Zhihong Tian VLM 106 2 0 28 Feb 2025
Distilling Monolingual and Crosslingual Word-in-Context Representations Yuki Arase Tomoyuki Kajiwara 71 0 0 13 Sep 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs O. Ostapenko Zhan Su Edoardo Ponti Laurent Charlin Nicolas Le Roux Matheus Pereira Lucas Caccia Alessandro Sordoni MoMe 111 37 0 18 May 2024
Protecting Your LLMs with Information Bottleneck Zichuan Liu Zefan Wang Linjie Xu Jinyu Wang Lei Song Tianchun Wang Chunlin Chen Wei Cheng Jiang Bian KELM AAML 129 18 0 22 Apr 2024
Decoding Continuous Character-based Language from Non-invasive Brain Recordings Cenyuan Zhang Xiaoqing Zheng Ruicheng Yin Shujie Geng Jianhan Xu ... Changze Lv Zixuan Ling Xuanjing Huang Miao Cao Jianfeng Feng 114 0 0 17 Mar 2024
When does word order matter and when doesn't it? Xuanda Chen T. O'Donnell Siva Reddy 103 1 0 29 Feb 2024
Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis Zhenxiao Cheng Jie Zhou Wen Wu Qin Chen Liang He 84 0 0 28 Feb 2024
Enhancing Phrase Representation by Information Bottleneck Guided Text Diffusion Process for Keyphrase Extraction Yuanzhen Luo Qingyu Zhou F. Zhou DiffM 65 2 0 17 Aug 2023
Span-based Named Entity Recognition by Generating and Compressing Information Nhung T. H. Nguyen Makoto Miwa Sophia Ananiadou 74 10 0 10 Feb 2023
Recursive Neural Networks with Bottlenecks Diagnose (Non-)Compositionality Verna Dankers Ivan Titov 88 2 0 31 Jan 2023
Rationalizing Predictions by Adversarial Information Calibration Lei Sha Oana-Maria Camburu Thomas Lukasiewicz 77 7 0 15 Jan 2023
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck Jie Zhou Qi Zhang Qin Chen Liang He Xuanjing Huang 109 21 0 27 Aug 2022
Text Revision by On-the-Fly Representation Optimization Jingjing Li Zichao Li Tao Ge Irwin King Michael R. Lyu BDL 93 18 0 15 Apr 2022
Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging Houquan Zhou Yang Li Zhenghua Li Min Zhang BDL 59 3 0 19 Mar 2022
Hierarchical Interpretation of Neural Text Classification Hanqi Yan Lin Gui Yulan He 107 14 0 20 Feb 2022
Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu Aparna Balagopalan Marzyeh Ghassemi Frank Rudzicz 76 4 0 17 Oct 2021
PAC-Bayes Information Bottleneck Zifeng Wang Shao-Lun Huang E. Kuruoglu Jimeng Sun Xi Chen Yefeng Zheng 105 36 0 29 Sep 2021
Variational Information Bottleneck for Effective Low-Resource Fine-Tuning Rabeeh Karimi Mahabadi Yonatan Belinkov James Henderson DRL 78 76 0 10 Jun 2021
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality Adithya Ganesan Matthew Matero Aravind Reddy Ravula Huy-Hien Vu H. Andrew Schwartz 90 35 0 07 May 2021
On Geodesic Distances and Contextual Embedding Compression for Text Classification Rishi Jha Kai Mihata 46 6 0 22 Apr 2021
Linguistic Dependencies and Statistical Dependence Jacob Louis Hoover Alessandro Sordoni Wenyu Du Timothy J. O'Donnell 77 15 0 18 Apr 2021
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification Xudong Tian Zhizhong Zhang Shaohui Lin Yanyun Qu Yuan Xie Lizhuang Ma 90 115 0 07 Apr 2021
Progressive Interpretation Synthesis: Interpreting Task Solving by Quantifying Previously Used and Unused Information Zhengqi He Taro Toyoizumi 66 1 0 08 Jan 2021
SemGloVe: Semantic Co-occurrences for GloVe from BERT Leilei Gan Zhiyang Teng Yue Zhang Linchao Zhu Leilei Gan Yi Yang 75 17 0 30 Dec 2020
Learning from the Best: Rationalizing Prediction by Adversarial Information Calibration Lei Sha Oana-Maria Camburu Thomas Lukasiewicz 203 38 0 16 Dec 2020
Exploring Pair-Wise NMT for Indian Languages Kartheek Akella Sai Himal Allu S. Ragupathi Aman Singhal Zeeshan Khan Vinay P. Namboodiri C. V. Jawahar 61 7 0 10 Dec 2020
Deep Clustering of Text Representations for Supervision-free Probing of Syntax Vikram Gupta Haoyue Shi Kevin Gimpel Mrinmaya Sachan 91 9 0 24 Oct 2020
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations Shauli Ravfogel Yanai Elazar Jacob Goldberger Yoav Goldberg 81 12 0 11 Oct 2020
Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers Hanjie Chen Yangfeng Ji AAML VLM 131 66 0 01 Oct 2020
Improving Robustness and Generality of NLP Models Using Disentangled Representations Jiawei Wu Xiaoya Li Xiang Ao Yuxian Meng Leilei Gan Jiwei Li OOD DRL 43 11 0 21 Sep 2020
Demystifying Deep Learning in Predictive Spatio-Temporal Analytics: An Information-Theoretic Framework Qi Tan Yang Liu Jiming Liu AI4TS 65 8 0 14 Sep 2020
MICE: Mining Idioms with Contextual Embeddings Tadej Škvorc P. Gantar Marko Robnik-Šikonja 33 19 0 13 Aug 2020
Building Interpretable Interaction Trees for Deep NLP Models Die Zhang Huilin Zhou Hao Zhang Xiaoyi Bao Da Huo Ruizhao Chen Xu Cheng Mengyue Wu Quanshi Zhang FAtt 37 3 0 29 Jun 2020
The Dual Information Bottleneck Zoe Piran Ravid Shwartz-Ziv Naftali Tishby 75 15 0 08 Jun 2020
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 96 151 0 09 May 2020
Emergence of Syntax Needs Minimal Supervision Raphaël Bailly Kata Gábor 100 5 0 03 May 2020
An Information Bottleneck Approach for Controlling Conciseness in Rationale Extraction Bhargavi Paranjape Mandar Joshi John Thickstun Hannaneh Hajishirzi Luke Zettlemoyer 89 101 0 01 May 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 463 1,500 0 18 Mar 2020
Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning Mitchell A. Gordon Kevin Duh Nicholas Andrews VLM 105 343 0 19 Feb 2020
The Convex Information Bottleneck Lagrangian Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 62 29 0 25 Nov 2019