oLMpics -- On what Language Model Pre-training Captures

31 December 2019

Papers citing "oLMpics -- On what Language Model Pre-training Captures"

50 / 197 papers shown

Title
LoNLI: An Extensible Framework for Testing Diverse Logical Reasoning Capabilities for NLI Ishan Tarunesh Somak Aditya Monojit Choudhury ELM LRM 31 4 0 04 Dec 2021
Learning Symbolic Rules for Reasoning in Quasi-Natural Language Kaiyu Yang Jia Deng NAI ReLM LRM 19 13 0 23 Nov 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Chenyu You Luo Si KELM 40 18 0 22 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,035 0 01 Nov 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 29 45 0 16 Oct 2021
The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail Sam Bowman OffRL 24 45 0 15 Oct 2021
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models Gregor Betz Kyle Richardson 22 8 0 04 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 37 5 0 01 Oct 2021
RuleBert: Teaching Soft Rules to Pre-trained Language Models Mohammed Saeed N. Ahmadi Preslav Nakov Paolo Papotti LRM 253 31 0 24 Sep 2021
Distilling Relation Embeddings from Pre-trained Language Models Asahi Ushio Jose Camacho-Collados Steven Schockaert 24 21 0 21 Sep 2021
SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment Analysis Chengxi Li Feiyu Gao Jiajun Bu Lu Xu Xiang Chen ... Zirui Shao Qi Zheng Ningyu Zhang Yongpan Wang Zhi Yu 38 55 0 17 Sep 2021
Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations Mohsen Fayyaz Ehsan Aghazadeh Ali Modarressi Hosein Mohebbi Mohammad Taher Pilehvar 18 21 0 13 Sep 2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy S. Rajaee Mohammad Taher Pilehvar 79 20 0 10 Sep 2021
Transformers in the loop: Polarity in neural models of language Lisa Bylinina Alexey Tikhonov 38 0 0 08 Sep 2021
Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models Steven Y. Feng Kevin Lu Zhuofu Tao Malihe Alikhani Teruko Mitamura Eduard H. Hovy Varun Gangal LRM 38 13 0 08 Sep 2021
A Bayesian Framework for Information-Theoretic Probing Tiago Pimentel Ryan Cotterell 28 24 0 08 Sep 2021
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models Zhihua Jin Xin Jiang Xingbo Wang Qun Liu Yong Wang Xiaozhe Ren Huamin Qu 16 19 0 07 Sep 2021
Rethinking Why Intermediate-Task Fine-Tuning Works Ting-Yun Chang Chi-Jen Lu LRM 19 29 0 26 Aug 2021
SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation Steven Y. Feng Jessica Huynh Chaitanya Narisetty Eduard H. Hovy Varun Gangal VLM 35 9 0 15 Aug 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 183 53 0 15 Jul 2021
A Closer Look at How Fine-tuning Changes BERT Yichu Zhou Vivek Srikumar 26 63 0 27 Jun 2021
Core Challenges in Embodied Vision-Language Planning Jonathan M Francis Nariaki Kitamura Felix Labelle Xiaopeng Lu Ingrid Navarro Jean Oh LM&Ro 47 45 0 26 Jun 2021
Probing Pre-Trained Language Models for Disease Knowledge Israa Alghanmi Luis Espinosa-Anke Steven Schockaert LM&MA ELM 27 13 0 14 Jun 2021
Prompting Contrastive Explanations for Commonsense Reasoning Tasks Bhargavi Paranjape Julian Michael Marjan Ghazvininejad Luke Zettlemoyer Hannaneh Hajishirzi ReLM LRM 22 66 0 12 Jun 2021
PROST: Physical Reasoning of Objects through Space and Time Stéphane Aroca-Ouellette Cory Paik A. Roncone Katharina Kann LRM 19 46 0 07 Jun 2021
Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA? Cunxiang Wang Pai Liu Yue Zhang RALM 33 80 0 03 Jun 2021
Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution Jiacheng Xu Greg Durrett 38 16 0 03 Jun 2021
John praised Mary because he? Implicit Causality Bias and Its Interaction with Explicit Cues in LMs Yova Kementchedjhieva Mark Anderson Anders Søgaard 21 13 0 02 Jun 2021
Inside ASCENT: Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answering Tuan-Phong Nguyen Simon Razniewski Gerhard Weikum 16 5 0 28 May 2021
Inspecting the concept knowledge graph encoded by modern language models Carlos Aspillaga Marcelo Mendoza Alvaro Soto 27 13 0 27 May 2021
Understanding by Understanding Not: Modeling Negation in Language Models Arian Hosseini Siva Reddy Dzmitry Bahdanau R. Devon Hjelm Alessandro Sordoni Rameswar Panda 22 87 0 07 May 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates Yuqing Xie Yi-An Lai Yuanjun Xiong Yi Zhang Stefano Soatto UQCV 19 16 0 07 May 2021
Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses Aina Garí Soler Marianna Apidianaki MILM 211 68 0 29 Apr 2021
Novel Aficionados and Doppelgängers: a referential task for semantic representations of individual entities Andrea Bruera Aurélie Herbelot 17 1 0 20 Apr 2021
Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks Lisa Bauer Mohit Bansal 19 19 0 20 Apr 2021
Probing for Bridging Inference in Transformer Language Models Onkar Pandit Yufang Hou 53 14 0 19 Apr 2021
Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema Yanai Elazar Hongming Zhang Yoav Goldberg Dan Roth ReLM LRM 45 44 0 16 Apr 2021
Probing Across Time: What Does RoBERTa Know and When? Leo Z. Liu Yizhong Wang Jungo Kasai Hannaneh Hajishirzi Noah A. Smith KELM 13 80 0 16 Apr 2021
Learning How to Ask: Querying LMs with Mixtures of Soft Prompts Guanghui Qin J. Eisner 9 533 0 14 Apr 2021
AR-LSAT: Investigating Analytical Reasoning of Text Wanjun Zhong Siyuan Wang Duyu Tang Zenan Xu Daya Guo Jiahai Wang Jian Yin Ming Zhou Nan Duan ELM 27 40 0 14 Apr 2021
What's in your Head? Emergent Behaviour in Multi-Task Transformer Models Mor Geva Uri Katz Aviv Ben-Arie Jonathan Berant LRM 43 11 0 13 Apr 2021
DirectProbe: Studying Representations without Classifiers Yichu Zhou Vivek Srikumar 32 27 0 13 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 35 51 0 12 Apr 2021
What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult Avishai Zagoury Einat Minkov Idan Szpektor William W. Cohen ELM 35 6 0 05 Apr 2021
Exploring the Role of BERT Token Representations to Explain Sentence Probing Results Hosein Mohebbi Ali Modarressi Mohammad Taher Pilehvar MILM 24 23 0 03 Apr 2021
CURIE: An Iterative Querying Approach for Reasoning About Situations Dheeraj Rajagopal Aman Madaan Niket Tandon Yiming Yang Shrimai Prabhumoye Abhilasha Ravichander Peter Clark Eduard H. Hovy ReLM LRM 8 6 0 01 Apr 2021
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 Gregor Betz Kyle Richardson Christian Voigt ReLM LRM 24 30 0 24 Mar 2021
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do P. Schramowski Cigdem Turan Nico Andersen Constantin Rothkopf Kristian Kersting 33 281 0 08 Mar 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 24 122 0 25 Feb 2021