Large Language Models can Learn Rules

10 October 2023

Jian Tang

Papers citing "Large Language Models can Learn Rules"

50 / 55 papers shown

Title
Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate Ziyang Huang Wangtao Sun Jun Zhao Kang-Jun Liu LRM 14 0 0 16 May 2025
DYSTIL: Dynamic Strategy Induction with Large Language Models for Reinforcement Learning Borui Wang Kathleen McKeown Rex Ying OffRL 39 0 0 06 May 2025
SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillation Quang P.M. Pham Khoi T.N. Nguyen Nhi H. Doan Cuong Pham Kentaro Inui Dezhen Song 65 0 0 01 May 2025
WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LM&Ro 32 0 0 22 Apr 2025
Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models Zhanke Zhou Zhaocheng Zhu Xuan Li Mikhail Galkin Xiao Feng Sanmi Koyejo Jian Tang Bo Han LRM 56 0 0 28 Mar 2025
LLM-FE: Automated Feature Engineering for Tabular Data with LLMs as Evolutionary Optimizers Nikhil Abhyankar Parshin Shojaee Chandan K. Reddy 61 0 0 18 Mar 2025
Automated Annotation of Evolving Corpora for Augmenting Longitudinal Network Data: A Framework Integrating Large Language Models and Expert Knowledge Xiao Liu Zirui Wu Jiayi Li Zhicheng Shao Xun Pang Yansong Feng 60 0 0 03 Mar 2025
PhantomWiki: On-Demand Datasets for Reasoning and Retrieval Evaluation Albert Gong Kamilė Stankevičiūtė Chao-gang Wan Anmol Kabra Raphael Thesmar Johann Lee Julius Klenke Carla P. Gomes Kilian Q. Weinberger RALM LRM 62 0 0 27 Feb 2025
AlphaAgent: LLM-Driven Alpha Mining with Regularized Exploration to Counteract Alpha Decay Ziyi Tang Z. Chen Jiarui Yang Jiayao Mai Yongsen Zheng Keze Wang Jinrui Chen Liang Lin AIFin 55 1 0 24 Feb 2025
SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training Tianzhe Chu Yuexiang Zhai Jihan Yang Shengbang Tong Saining Xie Dale Schuurmans Quoc V. Le Sergey Levine Yi Ma OffRL 70 58 0 28 Jan 2025
On the Role of Model Prior in Real-World Inductive Reasoning Zhuo Liu Ding Yu Hangfeng He LRM 82 0 0 18 Dec 2024
RuAG: Learned-rule-augmented Generation for Large Language Models Yudi Zhang Pei Xiao Lu Wang C. Zhang Meng Fang ... Qingwei Lin Mykola Pechenizkiy Dongmei Zhang Saravan Rajmohan Qi Zhang LRM 43 0 0 04 Nov 2024
Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets Thomas Eiter Jan Hadl N. Higuera J. Oetsch 28 0 0 12 Oct 2024
WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LLMAG LM&Ro 28 3 0 09 Oct 2024
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning Qingyu Yin Xuzheng He Luoao Deng Chak Tou Leong Fan Wang Yanzhao Yan Xiaoyu Shen Qiang Zhang 39 2 0 07 Oct 2024
RAGProbe: An Automated Approach for Evaluating RAG Applications Shangeetha Sivasothy Scott Barnett Stefanus Kurniawan Zafaryab Rasool Rajesh Vasa 39 5 0 24 Sep 2024
HALO: Hallucination Analysis and Learning Optimization to Empower LLMs with Retrieval-Augmented Context for Guided Clinical Decision Making Sumera Anjum Hanzhi Zhang Wenjun Zhou Eun Jin Paek Xiaopeng Zhao Yunhe Feng 31 1 0 16 Sep 2024
Symbolic Working Memory Enhances Language Models for Complex Rule Application Siyuan Wang Zhongyu Wei Yejin Choi Xiang Ren LRM LLMAG 38 11 0 24 Aug 2024
Intelligent OPC Engineer Assistant for Semiconductor Manufacturing Guojin Chen Haoyu Yang Bei Yu Haoxing Ren 44 0 0 23 Aug 2024
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting Emmanuel Aboah Boateng Cassiano O. Becker Nabiha Asghar Kabir Walia Ashwin Srinivasan Ehi Nosakhare Victor Dibia Soundar Srinivasan LRM 31 0 0 18 Aug 2024
ONSEP: A Novel Online Neural-Symbolic Framework for Event Prediction Based on Large Language Model Xuanqing Yu Wangtao Sun Jingwei Li Kang Liu Chengbao Liu Jie Tan OffRL AI4TS 41 3 0 14 Aug 2024
Neurosymbolic Methods for Rule Mining Agnieszka Lawrynowicz Luis Galarraga Mehwish Alam Berenice Jaulmes Václav Zeman Tomáš Kliegr 31 0 0 11 Aug 2024
Enhancing Agent Learning through World Dynamics Modeling Zhiyuan Sun Haochen Shi Marc-Alexandre Côté Glen Berseth Xingdi Yuan Bang Liu 55 3 0 25 Jul 2024
Follow the Rules: Reasoning for Video Anomaly Detection with Large Language Models Yuchen Yang Kwonjoon Lee Behzad Dariush Yinzhi Cao Shao-Yuan Lo LRM 42 12 0 14 Jul 2024
Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models Wangtao Sun Chenxiang Zhang Xueyou Zhang Ziyang Huang Haotian Xu Pei Chen Shizhu He Jun Zhao Kang-Jun Liu ELM LRM 35 0 0 11 Jul 2024
AutoManual: Generating Instruction Manuals by LLM Agents via Interactive Environmental Learning Minghao Chen Yihang Li Yanting Yang Shiyu Yu Binbin Lin Xiaofei He LLMAG 38 0 0 25 May 2024
METAREFLECTION: Learning Instructions for Language Agents using Past Reflections Priyanshu Gupta Shashank Kirtania Ananya Singha Sumit Gulwani Arjun Radhakrishna Sherry Shi Gustavo Soares LLMAG 34 4 0 13 May 2024
Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions Xinglin Chen Yishuai Cai Yunxin Mao Minglong Li Wenjing Yang Weixia Xu Ji Wang 54 6 0 13 May 2024
LLM-SR: Scientific Equation Discovery via Programming with Large Language Models Parshin Shojaee Kazem Meidani Shashank Gupta A. Farimani Chandan K. Reddy 42 15 0 29 Apr 2024
Inductive-Deductive Strategy Reuse for Multi-Turn Instructional Dialogues Jiao Ou Jiayu Wu Che Liu Fuzheng Zhang Di Zhang Kun Gai 29 2 0 17 Apr 2024
An Incomplete Loop: Deductive, Inductive, and Abductive Learning in Large Language Models Emmy Liu Graham Neubig Jacob Andreas ReLM LRM 35 6 0 03 Apr 2024
Accelerating Radio Spectrum Regulation Workflows with Large Language Models (LLMs) Amir Ghasemi Paul Guinand 43 1 0 26 Mar 2024
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking E. Zelikman Georges Harik Yijia Shao Varuna Jayasiri Nick Haber Noah D. Goodman LLMAG ReLM LRM 55 113 0 14 Mar 2024
RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models Liangliang Chen Yutian Lei Shiyu Jin Ying Zhang Liangjun Zhang LM&Ro 45 8 0 11 Mar 2024
ItD: Large Language Models Can Teach Themselves Induction through Deduction Wangtao Sun Haotian Xu Xuanqing Yu Pei Chen Shizhu He Jun Zhao Kang Liu LRM 35 10 0 09 Mar 2024
Brain-Inspired Two-Stage Approach: Enhancing Mathematical Reasoning by Imitating Human Thought Processes Yezeng Chen Zui Chen Yi Zhou LRM 32 2 0 23 Feb 2024
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs Siyuan Wang Zhongyu Wei Yejin Choi Xiang Ren ReLM ELM LRM 16 20 0 18 Feb 2024
Chain-of-Thought Reasoning Without Prompting Xuezhi Wang Denny Zhou ReLM LRM 152 101 0 15 Feb 2024
Premise Order Matters in Reasoning with Large Language Models Xinyun Chen Ryan A. Chi Xuezhi Wang Denny Zhou ReLM LRM 44 26 0 14 Feb 2024
Three Pathways to Neurosymbolic Reinforcement Learning with Interpretable Model and Policy Networks Peter Graf Patrick Emami 26 2 0 07 Feb 2024
Fine-Tuned Language Models Generate Stable Inorganic Materials as Text Nate Gruver Anuroop Sriram Andrea Madotto A. Wilson C. L. Zitnick Zachary W. Ulissi 27 56 0 06 Feb 2024
Large Language Models Can Learn Temporal Reasoning Siheng Xiong Ali Payani Ramana Rao Kompella Faramarz Fekri LRM 29 74 0 12 Jan 2024
DCR: Divide-and-Conquer Reasoning for Multi-choice Question Answering with LLMs Zijie Meng Yan Zhang Zhaopeng Feng Zuozhu Liu LRM 27 4 0 10 Jan 2024
Can LLMs Follow Simple Rules? Norman Mu Sarah Chen Zifan Wang Sizhe Chen David Karamardian Lulwa Aljeraisy Basel Alomair Dan Hendrycks David Wagner ALM 25 27 0 06 Nov 2023
How Language Model Hallucinations Can Snowball Muru Zhang Ofir Press William Merrill Alisa Liu Noah A. Smith HILM LRM 85 253 0 22 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 301 2,232 0 22 Mar 2023
Logical Reasoning over Natural Language as Knowledge Representation: A Survey Zonglin Yang Xinya Du Rui Mao Jinjie Ni Erik Cambria LRM ReLM 23 24 0 21 Mar 2023
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought Abulhair Saparov He He ELM LRM ReLM 121 275 0 03 Oct 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,077 0 24 May 2022
R5: Rule Discovery with Reinforced and Recurrent Relational Reasoning Shengyao Lu Bang Liu Keith G. Mills Shangling Jui Di Niu AI4TS 19 8 0 13 May 2022