A Theory of Usable Information Under Computational Constraints

25 February 2020

Papers citing "A Theory of Usable Information Under Computational Constraints"

37 / 37 papers shown

Title
Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii Kola Ayonrinde Louis Jaburi XAI 88 1 0 02 May 2025
On the generalization of language models from in-context learning and finetuning: a controlled study Andrew Kyle Lampinen Arslan Chaudhry Stephanie Chan Cody Wild Diane Wan Alex Ku Jorg Bornschein Razvan Pascanu Murray Shanahan James L. McClelland 57 1 0 01 May 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data Anish Acharya Sujay Sanghavi Alexandros G. Dimakis Inderjit S Dhillon AAML 64 0 0 01 Apr 2025
Statistical Deficiency for Task Inclusion Estimation Loïc Fosse Frédéric Béchet Benoit Favre Géraldine Damnati Gwénolé Lecorvé Maxime Darrin Philippe Formont Pablo Piantanida 231 0 0 07 Mar 2025
Geometric Median (GM) Matching for Robust Data Pruning Anish Acharya Inderjit S Dhillon Sujay Sanghavi AAML 59 0 0 20 Jan 2025
Disentanglement with Factor Quantized Variational Autoencoders Gulcin Baykal M. Kandemir Gözde B. Ünal CoGe DRL 41 0 0 23 Sep 2024
Establishing Deep InfoMax as an effective self-supervised learning methodology in materials informatics Michael Moran Vladimir V. Gusev M. Gaultois Dmytro Antypov M. Rosseinsky AI4CE 46 0 0 30 Jun 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost Xinyi Shang Peng Sun Tao Lin 55 3 0 23 May 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
A Geometric Notion of Causal Probing Clément Guerner Anej Svete Tianyu Liu Alex Warstadt Ryan Cotterell LLMSV 44 12 0 27 Jul 2023
LEACE: Perfect linear concept erasure in closed form Nora Belrose David Schneider-Joseph Shauli Ravfogel Ryan Cotterell Edward Raff Stella Biderman KELM MU 41 103 0 06 Jun 2023
Gaussian Process Probes (GPP) for Uncertainty-Aware Probing Zehao Wang Alexander Ku Jason Baldridge Thomas Griffiths Been Kim UQCV 36 11 0 29 May 2023
ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness Archiki Prasad Swarnadeep Saha Xiang Zhou Joey Tianyi Zhou LRM 32 46 0 21 Apr 2023
On the Perception of Difficulty: Differences between Humans and AI Philipp Spitzer Joshua Holstein Michael Vossing Niklas Kühl 28 0 0 19 Apr 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 15 21 0 04 Apr 2023
Predictive Heterogeneity: Measures and Applications Jiashuo Liu Jiayun Wu Yangqiu Song Peng Cui 32 1 0 01 Apr 2023
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions Yunlong Wang Shuyuan Shen Brian Y. Lim 41 88 0 19 Feb 2023
Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics Nihal Murali A. Puli Ke Yu Rajesh Ranganath Kayhan Batmanghelich AAML 43 8 0 18 Feb 2023
Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU? Jakub Ho'scilowicz Marcin Sowanski Piotr Czubowski Artur Janicki 25 2 0 27 Jan 2023
Explanation Regeneration via Information Bottleneck Qintong Li Zhiyong Wu Lingpeng Kong Wei Bi 30 3 0 19 Dec 2022
Log-linear Guardedness and its Implications Shauli Ravfogel Yoav Goldberg Ryan Cotterell 30 2 0 18 Oct 2022
Critical Learning Periods for Multisensory Integration in Deep Networks Michael Kleinman Alessandro Achille Stefano Soatto 35 10 0 06 Oct 2022
SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data Ching-Yun Ko Pin-Yu Chen Jeet Mohapatra Payel Das Lucani E. Daniel 35 3 0 06 Oct 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 41 0 13 Sep 2022
Information Processing Equalities and the Information-Risk Bridge Robert C. Williamson Zac Cranko 30 5 0 25 Jul 2022
Gacs-Korner Common Information Variational Autoencoder Michael Kleinman Alessandro Achille Stefano Soatto J. Kao CML DRL 34 12 0 24 May 2022
Conditional probing: measuring usable information beyond a baseline John Hewitt Kawin Ethayarajh Percy Liang Christopher D. Manning 39 55 0 19 Sep 2021
A Bayesian Framework for Information-Theoretic Probing Tiago Pimentel Ryan Cotterell 28 24 0 08 Sep 2021
Towards Out-Of-Distribution Generalization: A Survey Jiashuo Liu Zheyan Shen Yue He Xingxuan Zhang Renzhe Xu Han Yu Peng Cui CML OOD 69 519 0 31 Aug 2021
What Context Features Can Transformer Language Models Use? J. O'Connor Jacob Andreas KELM 29 75 0 15 Jun 2021
Temporal Predictive Coding For Model-Based Planning In Latent Space Tung D. Nguyen Rui Shu Tu Pham Hung Bui Stefano Ermon OffRL 32 57 0 14 Jun 2021
Fair Normalizing Flows Mislav Balunović Anian Ruoss Martin Vechev AAML 22 36 0 10 Jun 2021
Usable Information and Evolution of Optimal Representations During Training Michael Kleinman Alessandro Achille Daksh Idnani J. Kao 34 13 0 06 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 31 43 0 27 Sep 2020
Evaluating representations by the complexity of learning low-loss predictors William F. Whitney M. Song David Brandfonbrener Jaan Altosaar Kyunghyun Cho 27 23 0 15 Sep 2020
Predicting the Accuracy of a Few-Shot Classifier Myriam Bontonou Louis Bethune Vincent Gripon 8 4 0 08 Jul 2020
Learning Adversarially Fair and Transferable Representations David Madras Elliot Creager T. Pitassi R. Zemel FaML 233 676 0 17 Feb 2018