v1v2v3 (latest)

Discovering the Compositional Structure of Vector Representations with Role Learning Networks

21 October 2019

Papers citing "Discovering the Compositional Structure of Vector Representations with Role Learning Networks"

50 / 71 papers shown

Title
Identifying and Mitigating the Influence of the Prior Distribution in Large Language Models Liyi Zhang Veniamin Veselovsky R. Thomas McCoy Thomas Griffiths 90 0 0 17 Apr 2025
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos Henry Conklin Mattia Opper P. Smolensky Jianfeng Gao Roland Fernandez 123 5 0 18 Dec 2024
A polar coordinate system represents syntax in large language models Pablo Diego-Simón Stéphane DÁscoli Emmanuel Chemla Yair Lakretz J. King LLMSV 113 0 0 07 Dec 2024
Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networks Aaron Mueller CML 59 10 0 05 Jul 2024
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 169 4 0 24 May 2024
How to use and interpret activation patching Stefan Heimersheim Neel Nanda 73 48 0 23 Apr 2024
AtP*: An efficient and scalable method for localizing LLM behaviour to components János Kramár Tom Lieberum Rohin Shah Neel Nanda KELM 89 48 0 01 Mar 2024
Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals Y. Gat Nitay Calderon Amir Feder Alexander Chapanin Amit Sharma Roi Reichart 100 35 0 01 Oct 2023
Towards Best Practices of Activation Patching in Language Models: Metrics and Methods Fred Zhang Neel Nanda LLMSV 199 115 0 27 Sep 2023
Causal interventions expose implicit situation models for commonsense language understanding Takateru Yamakoshi James L. McClelland A. Goldberg Robert D. Hawkins 84 6 0 06 Jun 2023
Differentiable Tree Operations Promote Compositional Generalization Paul Soulos J. E. Hu Kate McCurdy Yunmo Chen Roland Fernandez P. Smolensky Jianfeng Gao AI4CE 52 7 0 01 Jun 2023
Semantic Composition in Visually Grounded Language Models Rohan Pandey CoGe 75 1 0 15 May 2023
Pretrained Embeddings for E-commerce Machine Learning: When it Fails and Why? Da Xu Bo Yang 69 3 0 09 Apr 2023
Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings Rohan Pandey 131 1 0 21 Jan 2023
Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality Anuj Diwan Layne Berry Eunsol Choi David Harwath Kyle Mahowald CoGe 158 44 0 01 Nov 2022
Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models Emmy Liu Graham Neubig CoGe 50 11 0 07 Oct 2022
Causal Proxy Models for Concept-Based Model Explanations Zhengxuan Wu Karel DÓosterlinck Atticus Geiger Amir Zur Christopher Potts MILM 106 37 0 28 Sep 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages Paul Soulos Sudha Rao Caitlin Smith Eric Rosen Asli Celikyilmaz ... Coleman Haley Roland Fernandez Hamid Palangi Jianfeng Gao P. Smolensky 70 7 0 11 Aug 2022
CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior Eldar David Abraham Karel DÓosterlinck Amir Feder Y. Gat Atticus Geiger Christopher Potts Roi Reichart Zhengxuan Wu CML 118 47 0 27 May 2022
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems P. Smolensky R. Thomas McCoy Roland Fernandez Matthew A. Goldrick Jia-Hao Gao 102 64 0 02 May 2022
Inducing Causal Structure for Interpretable Neural Networks Atticus Geiger Zhengxuan Wu Hanson Lu J. Rozner Elisa Kreiss Thomas Icard Noah D. Goodman Christopher Potts CML OOD 89 76 0 01 Dec 2021
Distributionally Robust Recurrent Decoders with Random Network Distillation Antonio Valerio Miceli Barone Alexandra Birch Rico Sennrich 125 1 0 25 Oct 2021
General Cross-Architecture Distillation of Pretrained Language Models into Matrix Embeddings Lukas Galke Isabelle Cuber Christophe Meyer Henrik Ferdinand Nolscher Angelina Sonderecker A. Scherp 135 2 0 17 Sep 2021
Causal Abstractions of Neural Networks Atticus Geiger Hanson Lu Thomas Icard Christopher Potts NAI CML 71 246 0 06 Jun 2021
Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing Rowan Hall Maudslay Ryan Cotterell 73 33 0 04 Jun 2021
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization Yichen Jiang Asli Celikyilmaz P. Smolensky Paul Soulos Sudha Rao Hamid Palangi Roland Fernandez Caitlin Smith Joey Tianyi Zhou Jianfeng Gao 64 19 0 02 Jun 2021
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language Hassan Akbari Hamid Palangi Jianwei Yang Sudha Rao Asli Celikyilmaz Roland Fernandez P. Smolensky Jianfeng Gao Shih-Fu Chang 87 3 0 18 Nov 2020
Compositional Explanations of Neurons Jesse Mu Jacob Andreas FAtt CoGe MILM 71 179 0 24 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 889 42,463 0 28 May 2020
Probing Linguistic Systematicity Emily Goodwin Koustuv Sinha Timothy J. O'Donnell 126 58 0 08 May 2020
A Systematic Assessment of Syntactic Generalization in Neural Language Models Jennifer Hu Jon Gauthier Peng Qian Ethan Gotlieb Wilcox R. Levy ELM 86 221 0 07 May 2020
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 87 276 0 27 Mar 2020
BLiMP: The Benchmark of Linguistic Minimal Pairs for English Alex Warstadt Alicia Parrish Haokun Liu Anhad Mohananey Wei Peng Sheng-Fu Wang Samuel R. Bowman 89 495 0 02 Dec 2019
Compositional Generalization for Primitive Substitutions Yuanpeng Li Liang Zhao Jianyu Wang Joel Hestness 67 87 0 07 Oct 2019
Analyzing machine-learned representations: A natural language case study Ishita Dasgupta Demi Guo S. Gershman Noah D. Goodman NAI 58 13 0 12 Sep 2019
Compositionality decomposed: how do neural networks generalise? Dieuwke Hupkes Verna Dankers Mathijs Mul Elia Bruni CoGe 160 339 0 22 Aug 2019
Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains Samira Abnar Lisa Beinborn Rochelle Choenni Willem H. Zuidema 37 76 0 04 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 187 865 0 15 May 2019
Correlating neural and symbolic representations of language Grzegorz Chrupała Afra Alishahi NAI 38 72 0 14 May 2019
Compositional generalization in a deep seq2seq model by separating syntax and semantics Jacob Russin Jason Jo R. C. O'Reilly Yoshua Bengio 69 103 0 22 Apr 2019
The emergence of number and syntax units in LSTM language models Yair Lakretz Germán Kruszewski T. Desbordes Dieuwke Hupkes S. Dehaene Marco Baroni 53 172 0 18 Mar 2019
Measuring Compositionality in Representation Learning Jacob Andreas CoGe 76 150 0 19 Feb 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 143 1,244 0 04 Feb 2019
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 95 558 0 21 Dec 2018
RNNs Implicitly Implement Tensor Product Representations R. Thomas McCoy Tal Linzen Ewan Dunbar P. Smolensky 72 54 0 20 Dec 2018
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 126 324 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
On learning an interpreted language with recurrent models Denis Paperno 124 4 0 11 Sep 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 83 417 0 27 Aug 2018
Dissecting Contextual Word Embeddings: Architecture and Representation Matthew E. Peters Mark Neumann Luke Zettlemoyer Wen-tau Yih 101 431 0 27 Aug 2018