Symbolic Knowledge Distillation: from General Language Models to Commonsense Models

14 October 2021

Peter West

Chandrasekhar Bhagavatula

Yejin Choi

Papers citing "Symbolic Knowledge Distillation: from General Language Models to Commonsense Models"

50 / 236 papers shown

Title
Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications Wenhan Dong Yuemeng Zhao Zhen Sun Yule Liu Zifan Peng ... Jun Wu Ruiming Wang Shengmin Xu Xinyi Huang Xinlei He LLMAG 61 0 0 30 Apr 2025
Improving In-Context Learning with Reasoning Distillation Nafis Sadeq Xin Xu Zhouhang Xie Julian McAuley Byungkyu Kang Prarit Lamba Xiang Gao RALM ReLM LRM 35 0 0 14 Apr 2025
Persona Dynamics: Unveiling the Impact of Personality Traits on Agents in Text-Based Games Seungwon Lim Seungbeen Lee Dongjun Min Youngjae Yu AI4CE 49 0 0 09 Apr 2025
TwT: Thinking without Tokens by Habitual Reasoning Distillation with Multi-Teachers' Guidance Jingxian Xu Mengyu Zhou Wei Liu Hanbing Liu Shi Han Dongmei Zhang LRM 45 1 0 31 Mar 2025
EmpathyAgent: Can Embodied Agents Conduct Empathetic Actions? Xinyan Chen Jiaxin Ge Hongming Dai Qiang Zhou Qiuxuan Feng Jingtong Hu Yishuo Wang Jiaming Liu Shanghang Zhang LM&Ro 65 0 0 19 Mar 2025
HInter: Exposing Hidden Intersectional Bias in Large Language Models Badr Souani E. Soremekun Mike Papadakis Setsuko Yokoyama Sudipta Chattopadhyay Yves Le Traon 46 0 0 15 Mar 2025
Reasoning-Grounded Natural Language Explanations for Language Models Vojtech Cahlik Rodrigo Alves Pavel Kordík LRM 53 1 0 14 Mar 2025
Similarity-Based Domain Adaptation with LLMs Jie He Wendi Zhou Xiang Li Jeff Z. Pan 49 0 0 07 Mar 2025
Enhancing Vision-Language Compositional Understanding with Multimodal Synthetic Data Haoxin Li Boyang Li CoGe 73 0 0 03 Mar 2025
Democratizing Large Language Model-Based Graph Data Augmentation via Latent Knowledge Graphs Yushi Feng Tsai Hor Chan Guosheng Yin Lequan Yu 44 1 0 20 Feb 2025
Adrenaline: Adaptive Rendering Optimization System for Scalable Cloud Gaming Jin Heo Ketan Bhardwaj Ada Gavrilovska 29 0 0 27 Dec 2024
Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding Zilin Du Haoxin Li Jianfei Yu Boyang Li 152 0 0 01 Dec 2024
CorrSynth -- A Correlated Sampling Method for Diverse Dataset Generation from LLMs Suhas S Kowshik Abhishek Divekar Vijit Malik SyDa 37 0 0 13 Nov 2024
Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models Yilun Jin Zheng Li Chenwei Zhang Tianyu Cao Yifan Gao ... Yi Xu Kai Chen Qiang Yang Meng Jiang Bing Yin RALM 30 2 0 28 Oct 2024
Not All LLM-Generated Data Are Equal: Rethinking Data Weighting in Text Classification Hsun-Yu Kuo Yin-Hsiang Liao Yu-Chieh Chao Wei-Yun Ma Pu-Jen Cheng SyDa 47 2 0 28 Oct 2024
Guiding Through Complexity: What Makes Good Supervision for Hard Math Reasoning Tasks? Xuan He Da Yin Nanyun Peng LRM 40 0 0 27 Oct 2024
Any Other Thoughts, Hedgehog? Linking Deliberation Chains in Collaborative Dialogues Abhijnan Nath Videep Venkatesha Mariah Bradford Avyakta Chelle Austin Youngren Carlos Mabrey Nathaniel Blanchard Nikhil Krishnaswamy 40 1 0 25 Oct 2024
SafetyAnalyst: Interpretable, transparent, and steerable safety moderation for AI behavior Jing-Jing Li Valentina Pyatkin Max Kleiman-Weiner Liwei Jiang Nouha Dziri Anne Collins Jana Schaich Borg Maarten Sap Yejin Choi Sydney Levine 29 1 0 22 Oct 2024
An Active Learning Framework for Inclusive Generation by Large Language Models Sabit Hassan Anthony Sicilia Malihe Alikhani 25 1 0 17 Oct 2024
Robust RL with LLM-Driven Data Synthesis and Policy Adaptation for Autonomous Driving Sihao Wu Jiaxu Liu Xiangyu Yin Guangliang Cheng Xingyu Zhao Meng Fang Xinping Yi Xiaowei Huang 30 0 0 16 Oct 2024
Revealing the Barriers of Language Agents in Planning Jian Xie Kexun Zhang Jiangjie Chen Siyu Yuan Kai Zhang Yikai Zhang Lei Li Yanghua Xiao LM&Ro AIFin LRM 32 6 0 16 Oct 2024
DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedback Zaid Khan Elias Stengel-Eskin Jaemin Cho Joey Tianyi Zhou VGen 43 1 0 08 Oct 2024
DivScene: Benchmarking LVLMs for Object Navigation with Diverse Scenes and Objects Zhaowei Wang Hongming Zhang Tianqing Fang Ye Tian Yue Yang Kaixin Ma Xiaoman Pan Yangqiu Song Dong Yu LM&Ro 42 3 0 03 Oct 2024
Past Meets Present: Creating Historical Analogy with Large Language Models Nianqi Li Siyu Yuan Jiangjie Chen Jiaqing Liang Feng Wei Zujie Liang Deqing Yang Yanghua Xiao 35 0 0 23 Sep 2024
Contextual Compression in Retrieval-Augmented Generation for Large Language Models: A Survey Sourav Verma RALM 3DV 26 2 0 20 Sep 2024
Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights Mohamad Ballout U. Krumnack Gunther Heidemann Kai-Uwe Kühnberger 35 2 0 19 Sep 2024
LLMR: Knowledge Distillation with a Large Language Model-Induced Reward Dongheng Li Yongchang Hao Lili Mou 50 1 0 19 Sep 2024
Shaping the Future of Endangered and Low-Resource Languages -- Our Role in the Age of LLMs: A Keynote at ECIR 2024 Josiane Mothe 39 2 0 05 Sep 2024
Internal and External Knowledge Interactive Refinement Framework for Knowledge-Intensive Question Answering Haowei Du Dongyan Zhao KELM 30 0 0 23 Aug 2024
Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs John Mendonça Isabel Trancoso A. Lavie ALM 29 1 0 20 Aug 2024
DIVE: Towards Descriptive and Diverse Visual Commonsense Generation Jun-Hyung Park Hyuntae Park Youjin Kang Eojin Jeon SangKeun Lee 27 0 0 15 Aug 2024
Infinite Ends from Finite Samples: Open-Ended Goal Inference as Top-Down Bayesian Filtering of Bottom-Up Proposals Zhi-Xuan Tan Gloria Kang Vikash K. Mansinghka Joshua B. Tenenbaum LRM 24 3 0 23 Jul 2024
Knowledge Mechanisms in Large Language Models: A Survey and Perspective Meng Wang Yunzhi Yao Ziwen Xu Shuofei Qiao Shumin Deng ... Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen Ningyu Zhang 52 28 0 22 Jul 2024
ECoh: Turn-level Coherence Evaluation for Multilingual Dialogues John Mendonça Isabel Trancoso A. Lavie 34 3 0 16 Jul 2024
A Survey on Symbolic Knowledge Distillation of Large Language Models Kamal Acharya Alvaro Velasquez H. Song SyDa 41 5 0 12 Jul 2024
Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledge Young-Jun Lee Dokyong Lee Junyoung Youn Kyeongjin Oh ByungSoo Ko Jonghwan Hyeon Ho-Jin Choi 36 2 0 04 Jul 2024
VIVA: A Benchmark for Vision-Grounded Decision-Making with Human Values Zhe Hu Yixiao Ren Jing Li Yu Yin VLM 31 4 0 03 Jul 2024
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application Chuanpeng Yang Wang Lu Yao Zhu Yidong Wang Qian Chen Chenlong Gao Bingjie Yan Yiqiang Chen ALM KELM 44 22 0 02 Jul 2024
CAVE: Controllable Authorship Verification Explanations Sahana Ramnath Kartik Pandey Elizabeth Boschee Xiang Ren 61 1 0 24 Jun 2024
Factual Dialogue Summarization via Learning from Large Language Models Rongxin Zhu Jey Han Lau Jianzhong Qi HILM 52 1 0 20 Jun 2024
Investigating Mysteries of CoT-Augmented Distillation Somin Wadhwa Silvio Amir Byron C. Wallace ReLM LRM 29 8 0 20 Jun 2024
Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics Seungbeen Lee Seungwon Lim Seungju Han Giyeong Oh Hyungjoo Chae ... Beong-woo Kwak Yeonsoo Lee Dongha Lee Jinyoung Yeo Youngjae Yu 41 8 0 20 Jun 2024
Unveiling Implicit Table Knowledge with Question-Then-Pinpoint Reasoner for Insightful Table Summarization Kwangwook Seo Jinyoung Yeo Dongha Lee ReLM LMTD LRM 29 1 0 18 Jun 2024
On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions Weiqi Wang Tianqing Fang Haochen Shi Baixuan Xu Wenxuan Ding ... Wei Fan Jiaxin Bai Haoran Li Xin Liu Yangqiu Song LRM 32 3 0 16 Jun 2024
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning Joongwon Kim Bhargavi Paranjape Tushar Khot Hannaneh Hajishirzi LM&Ro ELM LLMAG LRM 43 9 0 10 Jun 2024
Think out Loud: Emotion Deducing Explanation in Dialogues JiangNan Li Zheng-Shen Lin Lanrui Wang Q. Si Yanan Cao Mo Yu Peng Fu Weiping Wang Jie Zhou 31 0 0 07 Jun 2024
mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humans Yusuke Sakai Hidetaka Kamigaito Taro Watanabe LRM 43 2 0 06 Jun 2024
Efficient Knowledge Infusion via KG-LLM Alignment Zhouyu Jiang Ling Zhong Mengshu Sun Jun Xu Rui Sun Hui Cai Shuhan Luo Qing Cui 42 9 0 06 Jun 2024
MARS: Benchmarking the Metaphysical Reasoning Abilities of Language Models with a Multi-task Evaluation Dataset Weiqi Wang Yangqiu Song LRM 35 8 0 04 Jun 2024
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction Xiaoyuan Li Wenjie Wang Moxin Li Junrong Guo Yang Zhang Fuli Feng ELM LRM 33 15 0 02 Jun 2024