Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

14 October 2021

Peter West

Chandrasekhar Bhagavatula

Yejin Choi

Papers citing "Symbolic Knowledge Distillation: from General Language Models to Commonsense Models"

50 / 236 papers shown

Title
Modeling Empathic Similarity in Personal Narratives Jocelyn Shen Maarten Sap Pedro Colon-Hernandez Hae Won Park C. Breazeal 29 12 0 23 May 2023
The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning Seungone Kim Se June Joo Doyoung Kim Joel Jang Seonghyeon Ye Jamin Shin Minjoon Seo ALM RALM LRM 23 96 0 23 May 2023
Learning from Mistakes via Cooperative Study Assistant for Large Language Models Danqing Wang Lei Li 32 6 0 23 May 2023
Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts Jian Xie Kai Zhang Jiangjie Chen Renze Lou Yu-Chuan Su RALM 211 155 0 22 May 2023
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation Zhenwen Liang W. Yu Tanmay Rajpurohit Peter Clark Xiangliang Zhang Ashwin Kaylan 32 37 0 22 May 2023
LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities Yuqi Zhu Xiaohan Wang Jing Chen Shuofei Qiao Yixin Ou Yunzhi Yao Shumin Deng Huajun Chen Ningyu Zhang LLMAG 38 110 0 22 May 2023
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models Oana Ignat Zhijing Jin Artem Abzaliev Laura Biester Santiago Castro ... Verónica Pérez-Rosas Siqi Shen Zekun Wang Winston Wu Rada Mihalcea LRM 41 6 0 21 May 2023
OPT-R: Exploring the Role of Explanations in Finetuning and Prompting for Reasoning Skills of Large Language Models Badr AlKhamissi Siddharth Verma Ping Yu Zhijing Jin Asli Celikyilmaz Mona T. Diab LRM ReLM 35 10 0 19 May 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models Zorik Gekhman Jonathan Herzig Roee Aharoni Chen Elkind Idan Szpektor HILM ELM 29 71 0 18 May 2023
Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models Shangbin Feng Weijia Shi Yuyang Bai Vidhisha Balachandran Tianxing He Yulia Tsvetkov KELM 50 28 0 17 May 2023
Knowledge Rumination for Pre-trained Language Models Yunzhi Yao Peng Wang Shengyu Mao Chuanqi Tan Fei Huang Huajun Chen Ningyu Zhang KELM 30 3 0 15 May 2023
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge Shangbin Feng Vidhisha Balachandran Yuyang Bai Yulia Tsvetkov KELM HILM 23 52 0 14 May 2023
Harvesting Event Schemas from Large Language Models Jialong Tang Hongyu Lin Zhuoqun Li Yaojie Lu Xianpei Han Le Sun 26 4 0 12 May 2023
COKE: A Cognitive Knowledge Graph for Machine Theory of Mind Jincenzi Wu Zhuang Chen Jiawen Deng Sahand Sabour Helen Meng Minlie Huang 27 16 0 09 May 2023
Distilling Script Knowledge from Large Language Models for Constrained Language Planning Siyu Yuan Jiangjie Chen Ziquan Fu Xuyang Ge Soham Shah C. R. Jankowski Yanghua Xiao Deqing Yang 43 47 0 09 May 2023
NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge Phillip Howard Junlin Wang Vasudev Lal Gadi Singer Yejin Choi Swabha Swayamdipta 37 9 0 08 May 2023
CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning Weiqi Wang Tianqing Fang Baixuan Xu Chun Yi Louis Bo Yangqiu Song Lei Chen ReLM LRM 25 34 0 08 May 2023
SkillQG: Learning to Generate Question for Reading Comprehension Assessment Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 23 3 0 08 May 2023
"When Words Fail, Emojis Prevail": Generating Sarcastic Utterances with Emoji Using Valence Reversal and Semantic Incongruity Faria Binte Kader Nafisa Hossain Nujat Tasmia Binte Sogir Mohsinul Kabir H. Mahmud Md. Kamrul Hasan 10 1 0 06 May 2023
Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements Jiacheng Liu Wenya Wang Dianzhuo Wang Noah A. Smith Yejin Choi Hannaneh Hajishirzi VLM 39 48 0 05 May 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 220 502 0 03 May 2023
ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models Ning Bian Xianpei Han Le Sun Hongyu Lin Yaojie Lu Xianpei Han Shanshan Jiang Bin Dong KELM ELM AI4MH LRM 26 75 0 29 Mar 2023
Causal schema induction for knowledge discovery Michael Regan Jena D. Hwang Keisuke Sakaguchi James Pustejovsky CML 16 1 0 27 Mar 2023
CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification Seungone Kim Se June Joo Yul Jang Hyungjoo Chae Jinyoung Yeo LRM 19 12 0 07 Mar 2023
What happens before and after: Multi-Event Commonsense in Event Coreference Resolution Sahithya Ravi Christy Tanner R. Ng Vered Shwarz 42 16 0 20 Feb 2023
Adversarial Transformer Language Models for Contextual Commonsense Inference Pedro Colon-Hernandez H. Lieberman Yida Xin Claire Yin C. Breazeal Peter Chin 19 2 0 10 Feb 2023
Leaving Reality to Imagination: Robust Classification via Generated Datasets Hritik Bansal Aditya Grover OOD 44 87 0 05 Feb 2023
Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models Zhihong Shao Yeyun Gong Yelong Shen Minlie Huang Nan Duan Weizhu Chen ReLM LRM 43 67 0 01 Feb 2023
Case-Based Reasoning with Language Models for Classification of Logical Fallacies Zhivar Sourati Filip Ilievski Hông-Ân Sandlin Alain Mermoud LRM 26 12 0 27 Jan 2023
Understanding Finetuning for Factual Knowledge Extraction from Language Models Mehran Kazemi Sid Mittal Deepak Ramachandran KELM 34 10 0 26 Jan 2023
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization Srinivasan Iyer Xi Lin Ramakanth Pasunuru Todor Mihaylov Daniel Simig ... Jeff Wang Christopher Dewan Asli Celikyilmaz Luke Zettlemoyer Veselin Stoyanov ALM 31 261 0 22 Dec 2022
Contrastive Error Attribution for Finetuned Language Models Faisal Ladhak Esin Durmus Tatsunori Hashimoto HILM 30 9 0 21 Dec 2022
Self-Instruct: Aligning Language Models with Self-Generated Instructions Yizhong Wang Yeganeh Kordi Swaroop Mishra Alisa Liu Noah A. Smith Daniel Khashabi Hannaneh Hajishirzi ALM SyDa LRM 27 2,055 0 20 Dec 2022
On-the-fly Denoising for Data Augmentation in Natural Language Understanding Tianqing Fang Wenxuan Zhou Fangyu Liu Hongming Zhang Yangqiu Song Muhao Chen 41 1 0 20 Dec 2022
SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization Hyunwoo J. Kim Jack Hessel Liwei Jiang Peter West Ximing Lu ... Ronan Le Bras Malihe Alikhani Gunhee Kim Maarten Sap Yejin Choi HILM 37 155 0 20 Dec 2022
Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor Or Honovich Thomas Scialom Omer Levy Timo Schick ALM 48 361 0 19 Dec 2022
Discovering Language Model Behaviors with Model-Written Evaluations Ethan Perez Sam Ringer Kamilė Lukošiūtė Karina Nguyen Edwin Chen ... Danny Hernandez Deep Ganguli Evan Hubinger Nicholas Schiefer Jared Kaplan ALM 22 364 0 19 Dec 2022
I2D2: Inductive Knowledge Distillation with NeuroLogic and Self-Imitation Chandra Bhagavatula Jena D. Hwang Doug Downey Ronan Le Bras Ximing Lu Lianhui Qin Keisuke Sakaguchi Swabha Swayamdipta Peter West Yejin Choi 23 34 0 19 Dec 2022
ALERT: Adapting Language Models to Reasoning Tasks Ping Yu Tianlu Wang O. Yu. Golovneva Badr AlKhamissi Siddharth Verma Zhijing Jin Gargi Ghosh Mona T. Diab Asli Celikyilmaz ReLM LRM 34 21 0 16 Dec 2022
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning O. Yu. Golovneva Moya Chen Spencer Poff Martin Corredor Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz ReLM LRM 25 138 0 15 Dec 2022
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models Chan Hee Song Jiaman Wu Clay Washington Brian M Sadler Wei-Lun Chao Yu-Chuan Su LLMAG LM&Ro 36 383 0 08 Dec 2022
Automaton-Based Representations of Task Knowledge from Generative Language Models Yunhao Yang Jean-Raphael Gaglione Cyrus Neary Ufuk Topcu 35 11 0 04 Dec 2022
kogito: A Commonsense Knowledge Inference Toolkit Mete Ismayilzada Antoine Bosselut 19 7 0 15 Nov 2022
FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discovery Changlong Yu Weiqi Wang Xin Liu Jiaxin Bai Yangqiu Song Zheng Li Yifan Gao Tianyu Cao Bing Yin 47 22 0 15 Nov 2022
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation Melanie Sclar Peter West Sachin Kumar Yulia Tsvetkov Yejin Choi 20 19 0 25 Oct 2022
VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge Sahithya Ravi Aditya Chinchure Leonid Sigal Renjie Liao Vered Shwartz 37 26 0 24 Oct 2022
Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs Maarten Sap Ronan Le Bras Daniel Fried Yejin Choi 27 207 0 24 Oct 2022
ComFact: A Benchmark for Linking Contextual Commonsense Knowledge Silin Gao Jena D. Hwang Saya Kanno Hiromi Wakaki Yuki Mitsufuji Antoine Bosselut HILM 38 16 0 23 Oct 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks Laura Aina Nikos Voskarides Roi Blanco 16 0 0 21 Oct 2022
TestAug: A Framework for Augmenting Capability-based NLP Tests Guanqun Yang Mirazul Haque Qiaochu Song Wei Yang Xueqing Liu ELM 34 0 0 14 Oct 2022