oLMpics -- On what Language Model Pre-training Captures

31 December 2019

Papers citing "oLMpics -- On what Language Model Pre-training Captures"

50 / 197 papers shown

Title
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 38 0 0 09 Apr 2025
Tgea: An error-annotated dataset and benchmark tasks for text generation from pretrained language models Jie He Bo Peng Yi-Lun Liao Qun Liu Deyi Xiong 62 8 0 06 Mar 2025
SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models Jiawen Zhang Kejia Chen Zunlei Feng Jian Lou Mingli Song Jiaheng Liu Xiaoyu Yang AAML SILM FedML 45 1 0 02 Feb 2025
Automatic High-quality Verilog Assertion Generation through Subtask-Focused Fine-Tuned LLMs and Iterative Prompting M. Shahidzadeh B. Ghavami S. Wilton Lesley Shannon 64 0 0 23 Nov 2024
Temporally Consistent Factuality Probing for Large Language Models Ashutosh Bajpai Aaryan Goyal Atif Anwer Tanmoy Chakraborty HILM 17 0 0 21 Sep 2024
Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning Santosh Kumar Radha Yasamin Nouri Jelyani Ara Ghukasyan Oktay Goktas LLMAG LM&Ro LRM 38 5 0 19 Sep 2024
A Mechanistic Interpretation of Syllogistic Reasoning in Auto-Regressive Language Models Geonhee Kim Marco Valentino André Freitas LRM AI4CE 30 7 0 16 Aug 2024
HIRO: Hierarchical Information Retrieval Optimization Krish Goel Mahek Chandak RALM 39 1 0 14 Jun 2024
Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization Boshi Wang Xiang Yue Yu-Chuan Su Huan Sun LRM 29 42 0 23 May 2024
Logical Negation Augmenting and Debiasing for Prompt-based Methods Yitian Li Jidong Tian Hao He Yaohui Jin 38 0 0 08 May 2024
Deconstructing In-Context Learning: Understanding Prompts via Corruption Namrata Shivagunde Vladislav Lialin Sherin Muckatira Anna Rumshisky 38 2 0 02 Apr 2024
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models Stephan Linzbach Dimitar Dimitrov Laura Kallmeyer Kilian Evang Hajira Jabeen Stefan Dietze KELM 35 0 0 02 Apr 2024
OffensiveLang: A Community Based Implicit Offensive Language Dataset Amit Das Mostafa Rahgouy Dongji Feng Zheng Zhang Tathagata Bhattacharya ... Aman Chadha Mary J. Sandage Lauramarie Pope Gerry V. Dozier Cheryl Seals 34 1 0 04 Mar 2024
Probing Multimodal Large Language Models for Global and Local Semantic Representations Mingxu Tao Quzhe Huang Kun Xu Liwei Chen Yansong Feng Dongyan Zhao 29 5 0 27 Feb 2024
GRAFFORD: A Benchmark Dataset for Testing the Knowledge of Object Affordances of Language and Vision Models Sayantan Adak Daivik Agrawal Animesh Mukherjee Somak Aditya 24 3 0 20 Feb 2024
Strong hallucinations from negation and how to fix them Nicholas Asher Swarnadeep Bhar ReLM LRM 40 4 0 16 Feb 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization Andreas Waldis Yufang Hou Iryna Gurevych ELM 32 7 0 02 Feb 2024
RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval Parth Sarthi Salman Abdullah Aditi Tuli Shubh Khanna Anna Goldie Christopher D. Manning RALM 19 122 0 31 Jan 2024
Probing Pretrained Language Models with Hierarchy Properties Jesús Lovón-Melgarejo José G. Moreno Romaric Besançon Olivier Ferret L. Tamine 16 3 0 15 Dec 2023
The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation Rongwu Xu Brian S. Lin Shujian Yang Tianqi Zhang Weiyan Shi Lei Bai Zhixuan Fang Wei Xu Han Qiu 52 51 0 14 Dec 2023
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models Srinath Namburi Makesh Narsimhan Sreedhar Srinath Srinivasan Frederic Sala MQ 26 8 0 01 Dec 2023
An Eye on Clinical BERT: Investigating Language Model Generalization for Diabetic Eye Disease Phenotyping Keith Harrigian Tina Tang Anthony Gonzales Cindy X. Cai Mark Dredze VLM 35 2 0 15 Nov 2023
Cognitive Effects in Large Language Models Jonathan Shaki Sarit Kraus Michael Wooldridge 13 7 0 28 Aug 2023
Efficient Benchmarking of Language Models Yotam Perlitz Elron Bandel Ariel Gera Ofir Arviv L. Ein-Dor Eyal Shnarch Noam Slonim Michal Shmueli-Scheuer Leshem Choshen ALM 24 24 0 22 Aug 2023
On the Unexpected Abilities of Large Language Models S. Nolfi LRM 22 11 0 09 Aug 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features Ester Hlavnova Sebastian Ruder 35 5 0 11 Jul 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 29 87 0 20 Jun 2023
Semantic HELM: A Human-Readable Memory for Reinforcement Learning Fabian Paischer Thomas Adler M. Hofmarcher Sepp Hochreiter 23 10 0 15 Jun 2023
MetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification Hongyuan Dong Weinan Zhang Wanxiang Che VLM 21 2 0 15 Jun 2023
Triggering Multi-Hop Reasoning for Question Answering in Language Models using Soft Prompts and Random Walks Kanishka Misra Cicero Nogueira dos Santos Siamak Shakeri KELM LRM 21 1 0 06 Jun 2023
Probing Physical Reasoning with Counter-Commonsense Context Kazushi Kondo Saku Sugawara Akiko Aizawa LRM 19 4 0 04 Jun 2023
Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models Isabelle Lorge J. Pierrehumbert 38 0 0 25 May 2023
Are Chatbots Ready for Privacy-Sensitive Applications? An Investigation into Input Regurgitation and Prompt-Induced Sanitization Aman Priyanshu Supriti Vijay Ayush Kumar Rakshit Naidu Fatemehsadat Mireshghallah SILM 35 24 0 24 May 2023
Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks Sherzod Hakimov David Schlangen VLM 36 5 0 23 May 2023
Exploring Large Language Models for Classical Philology Frederick Riemenschneider Anette Frank 19 15 0 23 May 2023
Few-Shot Dialogue Summarization via Skeleton-Assisted Prompt Transfer in Prompt Tuning Kaige Xie Tong Yu Haoliang Wang Junda Wu Handong Zhao Ruiyi Zhang K. Mahadik A. Nenkova Mark O. Riedl 32 2 0 20 May 2023
Harvesting Event Schemas from Large Language Models Jialong Tang Hongyu Lin Zhuoqun Li Yaojie Lu Xianpei Han Le Sun 26 4 0 12 May 2023
ComputeGPT: A computational chat model for numerical problems Ryan H. Lewis Junfeng Jiao 15 2 0 08 May 2023
Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming Hanlin Zhang Jiani Huang Ziyang Li Mayur Naik Eric P. Xing ReLM LRM 30 28 0 05 May 2023
Larger Probes Tell a Different Story: Extending Psycholinguistic Datasets Via In-Context Learning Namrata Shivagunde Vladislav Lialin Anna Rumshisky 23 1 0 29 Mar 2023
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World Qifan Yu Juncheng Li Yuehua Wu Siliang Tang Wei Ji Yueting Zhuang 30 34 0 23 Mar 2023
LION: Implicit Vision Prompt Tuning Haixin Wang Jianlong Chang Xiao Luo Jinan Sun Zhouchen Lin Qi Tian VLM MLLM VPVLM 38 23 0 17 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 33 27 0 14 Mar 2023
STA: Self-controlled Text Augmentation for Improving Text Classifications Congcong Wang Gonzalo Fiz Pontiveros Steven Derby Tri Kurniawan Wijaya 46 3 0 24 Feb 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 17 15 0 23 Feb 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models Yan Xu Mahdi Namazifar Devamanyu Hazarika Aishwarya Padmakumar Yang Liu Dilek Z. Hakkani-Tür KELM 22 26 0 17 Feb 2023
Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning? Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Ana Brassard Masashi Yoshikawa Keisuke Sakaguchi Kentaro Inui CoGe 24 10 0 15 Feb 2023
Prompting for Multimodal Hateful Meme Classification Rui Cao Roy Ka-Wei Lee Wen-Haw Chong Jing Jiang VLM 25 75 0 08 Feb 2023
A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su ... Tiezheng Yu Willy Chung Quyet V. Do Yan Xu Pascale Fung ReLM LRM 27 1,337 0 08 Feb 2023
Creating a Large Language Model of a Philosopher Eric Schwitzgebel David Schwitzgebel A. Strasser DeLMO AI4CE 27 59 0 02 Feb 2023