Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

14 October 2021

Peter West

Chandrasekhar Bhagavatula

Yejin Choi

Papers citing "Symbolic Knowledge Distillation: from General Language Models to Commonsense Models"

50 / 236 papers shown

Title
STEER: Unified Style Transfer with Expert Reinforcement Skyler Hallinan Faeze Brahman Ximing Lu Jaehun Jung Sean Welleck Yejin Choi OffRL 13 14 0 13 Nov 2023
Distilling Large Language Models using Skill-Occupation Graph Context for HR-Related Tasks Pouya Pezeshkpour Hayate Iso Thom Lake Nikita Bhutani Estevam R. Hruschka 38 2 0 10 Nov 2023
Agent Lumos: Unified and Modular Training for Open-Source Language Agents Da Yin Faeze Brahman Abhilasha Ravichander Khyathi Raghavi Chandu Kai-Wei Chang Yejin Choi Bill Yuchen Lin LLMAG 43 36 0 09 Nov 2023
Causal Question Answering with Reinforcement Learning Lukas Blübaum Stefan Heindorf CML 21 3 0 05 Nov 2023
Grounded Intuition of GPT-Vision's Abilities with Scientific Images Alyssa Hwang Andrew Head Chris Callison-Burch 45 3 0 03 Nov 2023
Kiki or Bouba? Sound Symbolism in Vision-and-Language Models Morris Alper Hadar Averbuch-Elor 43 10 0 25 Oct 2023
What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations Kavel Rao Liwei Jiang Valentina Pyatkin Yuling Gu Niket Tandon Nouha Dziri Faeze Brahman Yejin Choi 26 15 0 24 Oct 2023
GD-COMET: A Geo-Diverse Commonsense Inference Model Mehar Bhatia Vered Shwartz 19 6 0 23 Oct 2023
Large Language Models can Share Images, Too! Young-Jun Lee Dokyong Lee Joo Won Sung Jonghwan Hyeon Ho-Jin Choi MLLM 24 2 0 23 Oct 2023
Merging Generated and Retrieved Knowledge for Open-Domain QA Yunxiang Zhang Muhammad Khalifa Lajanugen Logeswaran Moontae Lee Honglak Lee Lu Wang RALM 30 37 0 22 Oct 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation Gaurav Sahu Olga Vechtomova Dzmitry Bahdanau I. Laradji VLM 55 24 0 22 Oct 2023
Gold: A Global and Local-aware Denoising Framework for Commonsense Knowledge Graph Noise Detection Zheye Deng Weiqi Wang Zhaowei Wang Xin Liu Yangqiu Song 33 9 0 18 Oct 2023
SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents Xuhui Zhou Hao Zhu Leena Mathur Ruohong Zhang Haofei Yu ... Louis-Philippe Morency Yonatan Bisk Daniel Fried Graham Neubig Maarten Sap LLMAG 33 118 0 18 Oct 2023
ViPE: Visualise Pretty-much Everything Hassan Shahmohammadi Adhiraj Ghosh Hendrik P. A. Lensch DiffM 28 1 0 16 Oct 2023
Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Commonsense Norms Seungju Han Junhyeok Kim Jack Hessel Liwei Jiang Jiwan Chung Yejin Son Yejin Choi Youngjae Yu 15 2 0 16 Oct 2023
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents Hyungjoo Chae Yongho Song Kai Tzu-iunn Ong Taeyoon Kwon Minjin Kim Youngjae Yu Dongha Lee Dongyeop Kang Jinyoung Yeo LRM 24 39 0 13 Oct 2023
Dont Add, dont Miss: Effective Content Preserving Generation from Pre-Selected Text Spans Aviv Slobodkin Avi Caciularu Eran Hirsch Ido Dagan 20 3 0 13 Oct 2023
PHALM: Building a Knowledge Graph from Scratch by Prompting Humans and a Language Model Tatsuya Ide Eiki Murata Daisuke Kawahara T. Yamazaki Shengzhe Li K. Shinzato Toshinori Sato LRM 43 2 0 11 Oct 2023
We are what we repeatedly do: Inducing and deploying habitual schemas in persona-based responses Benjamin Kane Lenhart Schubert 44 0 0 10 Oct 2023
RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentation Fangyuan Xu Weijia Shi Eunsol Choi RALM 27 145 0 06 Oct 2023
LumiNet: The Bright Side of Perceptual Knowledge Distillation Md. Ismail Hossain M. M. L. Elahi Sameera Ramasinghe A. Cheraghian Fuad Rahman Nabeel Mohammed Shafin Rahman 29 1 0 05 Oct 2023
RelBERT: Embedding Relations with Language Models Asahi Ushio Jose Camacho-Collados Steven Schockaert KELM 22 1 0 30 Sep 2023
ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer Arkadiy Saakyan Smaranda Muresan 23 3 0 15 Sep 2023
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties Taylor Sorensen Liwei Jiang Jena D. Hwang Sydney Levine Valentina Pyatkin ... Kavel Rao Chandra Bhagavatula Maarten Sap J. Tasioulas Yejin Choi SLR 24 51 0 02 Sep 2023
TaskLAMA: Probing the Complex Task Understanding of Language Models Quan Yuan Mehran Kazemi Xinyuan Xu Isaac Noble Vaiva Imbrasaite Deepak Ramachandran LRM 31 10 0 29 Aug 2023
Translate Meanings, Not Just Words: IdiomKB's Role in Optimizing Idiomatic Translation with Language Models Shuang Li Jiangjie Chen Siyu Yuan Xinyi Wu Hao Yang Shimin Tao Yanghua Xiao 48 15 0 26 Aug 2023
AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models Siheng Li Cheng Yang Yichun Yin Xinyu Zhu Ze-Long Cheng Lifeng Shang Xin Jiang Qun Liu Yujiu Yang SyDa 32 3 0 12 Aug 2023
Large Language Models and Knowledge Graphs: Opportunities and Challenges Jeff Z. Pan Simon Razniewski Jan-Christoph Kalo Sneha Singhania Jiaoyan Chen ... Gerard de Melo A. Bonifati Edlira Vakaj M. Dragoni D. Graux KELM 30 73 0 11 Aug 2023
Multimodal Pretrained Models for Verifiable Sequential Decision-Making: Planning, Grounding, and Perception Yunhao Yang Cyrus Neary Ufuk Topcu LM&Ro OffRL 27 5 0 10 Aug 2023
Generative Benchmark Creation for Table Union Search Koyena Pal Aamod Khatiwada Roee Shraga Renée J. Miller 43 0 0 07 Aug 2023
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities Jin Chen Zheng Liu Xunpeng Huang Chenwang Wu Qi Liu ... Yuxuan Lei Xiaolong Chen Xingmei Wang Defu Lian Enhong Chen ALM 32 110 0 31 Jul 2023
Negated Complementary Commonsense using Large Language Models Navid Rezaei Marek Reformat LRM 22 0 0 13 Jul 2023
KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding Zijun Yao Yantao Liu Xin Lv S. Cao Jifan Yu Lei Hou Juanzi Li 37 10 0 06 Jul 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step Liunian Harold Li Jack Hessel Youngjae Yu Xiang Ren Kai-Wei Chang Yejin Choi LRM AI4CE ReLM 22 129 0 24 Jun 2023
Snowman: A Million-scale Chinese Commonsense Knowledge Graph Distilled from Foundation Model Jiaan Wang Jianfeng Qu Yunlong Liang Zhixu Li An Liu Guanfeng Liu Xin Zheng 28 2 0 17 Jun 2023
$RED$^{\rm FM}$: a Filtered and Multilingual Relation Extraction Dataset$ RED $^{\rm FM}$ : a Filtered and Multilingual Relation Extraction Dataset Pere-Lluís Huguet Cabot Simone Tedeschi A. N. Ngomo Roberto Navigli 15 12 0 16 Jun 2023
CHORUS: Foundation Models for Unified Data Discovery and Exploration Moe Kayali A. Lykov Ilias Fountalis N. Vasiloglou Dan Olteanu Dan Suciu 25 21 0 16 Jun 2023
Training Multimedia Event Extraction With Generated Images and Captions Zilin Du Yunxin Li Xu Guo Yidan Sun Boyang Albert Li DiffM 21 7 0 15 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 35 715 0 14 Jun 2023
COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statements Xuhui Zhou Haojie Zhu Akhila Yerukola Thomas Davidson Jena D. Hwang Swabha Swayamdipta Maarten Sap 19 34 0 03 Jun 2023
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning Faeze Brahman Chandra Bhagavatula Valentina Pyatkin Jena D. Hwang Xiang Lorraine Li H. J. Arai Soumya Sanyal Keisuke Sakaguchi Xiang Ren Yejin Choi LRM 26 0 0 31 May 2023
Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Models Qiang Zhang Jason Naradowsky Yusuke Miyao ELM 26 32 0 29 May 2023
Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang LM&Ro 34 49 0 27 May 2023
On the Impact of Knowledge Distillation for Model Interpretability Hyeongrok Han Siwon Kim Hyun-Soo Choi Sungroh Yoon 24 4 0 25 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Raghavi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 22 26 0 24 May 2023
A RelEntLess Benchmark for Modelling Graded Relations between Named Entities Asahi Ushio Jose Camacho-Collados Steven Schockaert 27 1 0 24 May 2023
From Words to Wires: Generating Functioning Electronic Devices from Natural Language Descriptions Peter Alexander Jansen 22 2 0 24 May 2023
CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering Weiqi Wang Tianqing Fang Wenxuan Ding Baixuan Xu Xin Liu Yangqiu Song Antoine Bosselut ReLM LRM 22 39 0 24 May 2023
Leftover Lunch: Advantage-based Offline Reinforcement Learning for Language Models Ashutosh Baheti Ximing Lu Faeze Brahman Ronan Le Bras Maarten Sap Mark O. Riedl 32 9 0 24 May 2023
COMET-M: Reasoning about Multiple Events in Complex Sentences Sahithya Ravi R. Ng Vered Shwartz LRM ReLM 18 3 0 24 May 2023