Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

14 October 2021

Peter West

Chandrasekhar Bhagavatula

Yejin Choi

Papers citing "Symbolic Knowledge Distillation: from General Language Models to Commonsense Models"

36 / 236 papers shown

Title
PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population Tianqing Fang Quyet V. Do Hongming Zhang Yangqiu Song Ginny Wong Simon See LRM 17 11 0 14 Oct 2022
Extracting Cultural Commonsense Knowledge at Scale Tuan-Phong Nguyen Simon Razniewski A. Varde G. Weikum 33 57 0 14 Oct 2022
Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values Yejin Bang Tiezheng Yu Andrea Madotto Zhaojiang Lin Mona T. Diab Pascale Fung 21 13 0 14 Oct 2022
Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary Daniel Loureiro A. Jorge ReLM KELM AI4MH LRM 19 1 0 12 Oct 2022
Do Children Texts Hold The Key To Commonsense Knowledge? Julien Romero Simon Razniewski 29 1 0 10 Oct 2022
KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding Shangbin Feng Zhaoxuan Tan Wenqian Zhang Zhenyu Lei Yulia Tsvetkov KELM VLM 50 10 0 08 Oct 2022
Modelling Commonsense Properties using Pre-Trained Bi-Encoders Amit Gajbhiye Luis Espinosa-Anke Steven Schockaert 11 12 0 06 Oct 2022
Robot Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Chad Esselink Shiqi Zhang LM&Ro 28 19 0 04 Oct 2022
Elaboration-Generating Commonsense Question Answering at Scale Wenya Wang Vivek Srikumar Hannaneh Hajishirzi Noah A. Smith ELM LRM 29 15 0 02 Sep 2022
Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization Seungone Kim Se June Joo Hyungjoo Chae Chaehyeong Kim Seung-won Hwang Jinyoung Yeo 21 20 0 02 Sep 2022
PASTA: A Dataset for Modeling Participant States in Narratives Sayontan Ghosh Mahnaz Koupaee Isabella Chen Francis Ferraro Nathanael Chambers Niranjan Balasubramanian 25 3 0 31 Jul 2022
Language Models Can Teach Themselves to Program Better Patrick M. Haluptzok Matthew Bowers Adam Tauman Kalai ReLM SyDa LRM 11 80 0 29 Jul 2022
Hidden Schema Networks Ramses J. Sanchez L. Conrads Pascal Welke K. Cvejoski C. Ojeda NAI MILM 19 3 0 08 Jul 2022
BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models Shibo Hao Bowen Tan Kaiwen Tang Bin Ni Xiyan Shao Hengzhe Zhang Eric P. Xing Zhiting Hu 29 26 0 28 Jun 2022
A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge Dustin Schwenk Apoorv Khandelwal Christopher Clark Kenneth Marino Roozbeh Mottaghi 16 505 0 03 Jun 2022
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization Mutian He Tianqing Fang Weiqi Wang Yangqiu Song 37 29 0 03 Jun 2022
Language and Culture Internalisation for Human-Like Autotelic AI Cédric Colas Tristan Karch Clément Moulin-Frier Pierre-Yves Oudeyer LM&Ro 32 25 0 02 Jun 2022
Revisiting DocRED -- Addressing the False Negative Problem in Relation Extraction Qingyu Tan Lu Xu Lidong Bing Hwee Tou Ng Sharifah Mahani Aljunied 44 64 0 25 May 2022
ProsocialDialog: A Prosocial Backbone for Conversational Agents Hyunwoo J. Kim Youngjae Yu Liwei Jiang Ximing Lu Daniel Khashabi Gunhee Kim Yejin Choi Maarten Sap 22 118 0 25 May 2022
Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations Jaehun Jung Lianhui Qin Sean Welleck Faeze Brahman Chandra Bhagavatula Ronan Le Bras Yejin Choi ReLM LRM 226 190 0 24 May 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 41 175 0 12 Apr 2022
Do Multilingual Language Models Capture Differing Moral Norms? Katharina Hämmerl Bjorn Deiseroth P. Schramowski Jindrich Libovický Alexander Fraser Kristian Kersting 11 15 0 18 Mar 2022
AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation Chujie Zheng Sahand Sabour Jiaxin Wen Zheng Zhang Minlie Huang 22 55 0 26 Feb 2022
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation Alisa Liu Swabha Swayamdipta Noah A. Smith Yejin Choi 58 211 0 16 Jan 2022
Materialized Knowledge Bases from Commonsense Transformers Tuan-Phong Nguyen Simon Razniewski 15 6 0 29 Dec 2021
Reframing Human-AI Collaboration for Generating Free-Text Explanations Sarah Wiegreffe Jack Hessel Swabha Swayamdipta Mark O. Riedl Yejin Choi 21 142 0 16 Dec 2021
KAT: A Knowledge Augmented Transformer for Vision-and-Language Liangke Gui Borui Wang Qiuyuan Huang Alexander G. Hauptmann Yonatan Bisk Jianfeng Gao 17 153 0 16 Dec 2021
Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge Ian Porada Alessandro Sordoni Jackie C.K. Cheung 27 5 0 16 Dec 2021
Refined Commonsense Knowledge from Large-Scale Web Contents Tuan-Phong Nguyen Simon Razniewski Julien Romero G. Weikum 39 32 0 30 Nov 2021
Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs Peter Hase Mona T. Diab Asli Celikyilmaz Xian Li Zornitsa Kozareva Veselin Stoyanov Joey Tianyi Zhou Srini Iyer KELM LRM 24 79 0 26 Nov 2021
Guided Generation of Cause and Effect Zhongyang Li Xiao Ding Ting Liu J. E. Hu Benjamin Van Durme 163 78 0 21 Jul 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,848 0 18 Apr 2021
ASER: Towards Large-scale Commonsense Knowledge Acquisition via Higher-order Selectional Preference over Eventualities Hongming Zhang Xin Liu Haojie Pan Hao Ke Jiefu Ou Tianqing Fang Yangqiu Song 14 47 0 05 Apr 2021
Data Augmentation using Pre-trained Transformer Models Varun Kumar Ashutosh Choudhary Eunah Cho VLM 216 315 0 04 Mar 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 417 2,588 0 03 Sep 2019
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 242 320 0 21 Aug 2019