Injecting Numerical Reasoning Skills into Language Models

9 April 2020

Papers citing "Injecting Numerical Reasoning Skills into Language Models"

50 / 58 papers shown

Title
Intermediate Languages Matter: Formal Choice Drives Neurosymbolic LLM Reasoning Alexander Beiser David Penz Nysret Musliu LRM 64 0 0 24 Feb 2025
Mathematical Language Models: A Survey Wei Liu Hanglei Hu Jie Zhou Yuyang Ding Junsong Li ... Mengliang He Qin Chen Bo Jiang Aimin Zhou Liang He LRM 81 13 0 03 Jan 2025
Number Cookbook: Number Understanding of Language Models and How to Improve It Haotong Yang Yi Hu Shijia Kang Zhouchen Lin Muhan Zhang LRM 46 4 0 06 Nov 2024
Path-Consistency: Prefix Enhancement for Efficient Inference in LLM Jiace Zhu Yingtao Shen Jie Zhao An Zou LLMAG LRM 27 4 0 25 Aug 2024
Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks Mahdi Sabbaghi George Pappas Hamed Hassani Surbhi Goel 45 4 0 04 Jun 2024
Can Large Language Models put 2 and 2 together? Probing for Entailed Arithmetical Relationships D. Panas S. Seth V. Belle ReLM LRM 35 2 0 30 Apr 2024
Pre-Calc: Learning to Use the Calculator Improves Numeracy in Language Models Vishruth Veerendranath Vishwa Shah Kshitish Ghate 32 0 0 22 Apr 2024
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs Yebowen Hu Kaiqiang Song Sangwoo Cho Xiaoyang Wang H. Foroosh Dong Yu Fei Liu 25 8 0 15 Feb 2024
From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning Zheyuan Zhang Shane Storks Fengyuan Hu Sungryull Sohn Moontae Lee Honglak Lee Joyce Chai LRM 39 3 0 24 Oct 2023
LLM-Prop: Predicting Physical And Electronic Properties Of Crystalline Solids From Their Text Descriptions Andre Niyongabo Rubungo Craig Arnold Barry P. Rand Adji Bousso Dieng AI4CE 45 29 0 21 Oct 2023
Teaching Smaller Language Models To Generalise To Unseen Compositional Questions Tim Hartill N. Tan Michael Witbrock Patricia J. Riddle ReLM KELM LRM 34 2 0 02 Aug 2023
FERMAT: An Alternative to Accuracy for Numerical Reasoning Jasivan Sivakumar N. Moosavi ReLM LRM 43 3 0 27 May 2023
Human Behavioral Benchmarking: Numeric Magnitude Comparison Effects in Large Language Models Raj Sanjay Shah Vijay Marupudi Reba Koenen Khushi Bhardwaj Sashank Varma 27 6 0 18 May 2023
Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition Matteo Muffo A. Cocco Enrico Bertino ReLM 26 25 0 21 Apr 2023
From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning Qian Liu Fan Zhou Zhengbao Jiang Longxu Dou Min Lin 18 17 0 17 Apr 2023
REFINER: Reasoning Feedback on Intermediate Representations Debjit Paul Mete Ismayilzada Maxime Peyrard Beatriz Borges Antoine Bosselut Robert West Boi Faltings ReLM LRM 41 171 0 04 Apr 2023
Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning? Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Ana Brassard Masashi Yoshikawa Keisuke Sakaguchi Kentaro Inui CoGe 24 10 0 15 Feb 2023
Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers Yuta Matsumoto Benjamin Heinzerling Masashi Yoshikawa Kentaro Inui AIFin 33 5 0 17 Jan 2023
SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images Ryota Tanaka Kyosuke Nishida Kosuke Nishida Taku Hasegawa Itsumi Saito Kuniko Saito 25 73 0 12 Jan 2023
Inducing Character-level Structure in Subword-based Language Models with Type-level Interchange Intervention Training Jing-ling Huang Zhengxuan Wu Kyle Mahowald Christopher Potts 24 13 0 19 Dec 2022
Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic? Jean-Baptiste Döderlein M. Acher D. Khelladi B. Combemale 34 33 0 26 Oct 2022
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 57 4 0 23 Oct 2022
ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler Jiaxin Zhang Yashar Moshfeghi AIMat 27 18 0 18 Oct 2022
PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance Yang Deng Wenqiang Lei Wenxuan Zhang W. Lam Tat-Seng Chua 44 52 0 17 Oct 2022
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems Fan Zhou Haoyu Dong Qian Liu Zhoujun Cheng Shi Han Dongmei Zhang ReLM LRM 37 5 0 11 Oct 2022
Teaching Neural Module Networks to Do Arithmetic Jiayi Chen Xiao-Yu Guo Yuan-Fang Li Gholamreza Haffari AIMat LRM 27 1 0 06 Oct 2022
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 32 10 0 25 Jul 2022
Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation Samuel Cognolato Alberto Testolin 42 7 0 06 Jul 2022
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data Yilun Zhao Yunxiang Li Chenying Li Rui Zhang AIMat 39 97 0 03 Jun 2022
LogiGAN: Learning Logical Reasoning via Adversarial Pre-training Xinyu Pi Wanjun Zhong Yan Gao Nan Duan Jian-Guang Lou NAI GAN LRM AI4CE 41 16 0 18 May 2022
Improving Downstream Task Performance by Treating Numbers as Entities Dhanasekar Sundararaman Vivek Subramanian Guoyin Wang Liyan Xu Lawrence Carin 27 5 0 07 May 2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks Ruixiang Cui Daniel Hershcovich Anders Søgaard 25 13 0 22 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 49 149 0 15 Apr 2022
FiNER: Financial Numeric Entity Recognition for XBRL Tagging Lefteris Loukas Manos Fergadiotis Ilias Chalkidis Eirini Spyropoulou Prodromos Malakasiotis Ion Androutsopoulos George Giannakopoulos 21 56 0 12 Mar 2022
Impact of Pretraining Term Frequencies on Few-Shot Reasoning Yasaman Razeghi Robert L Logan IV Matt Gardner Sameer Singh ReLM LRM 32 150 0 15 Feb 2022
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey Prajjwal Bhargava Vincent Ng ReLM LRM 49 62 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 416 8,650 0 28 Jan 2022
Reasoning Like Program Executors Xinyu Pi Qian Liu Bei Chen Morteza Ziyadi Zeqi Lin Qiang Fu Yan Gao Jian-Guang Lou Weizhu Chen ReLM LRM 253 52 0 27 Jan 2022
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access Vilém Zouhar Marius Mosbach Debanjali Biswas Dietrich Klakow KELM 34 4 0 24 Jan 2022
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models Gregor Betz Kyle Richardson 22 8 0 04 Oct 2021
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining Zhoujun Cheng Haoyu Dong Ran Jia Pengfei Wu Shi Han Fan Cheng Dongmei Zhang AIMat ReLM LMTD LRM 29 27 0 15 Sep 2021
SHAPE: Shifted Absolute Position Embedding for Transformers Shun Kiyono Sosuke Kobayashi Jun Suzuki Kentaro Inui 236 45 0 13 Sep 2021
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models Zhihua Jin Xin Jiang Xingbo Wang Qun Liu Yong Wang Xiaozhe Ren Huamin Qu 16 19 0 07 Sep 2021
Teaching Autoregressive Language Models Complex Tasks By Demonstration Gabriel Recchia 26 22 0 05 Sep 2021
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving Zhenwen Liang Jipeng Zhang Lei Wang Wei Qin Yunshi Lan Jie Shao Xiangliang Zhang AIMat 44 62 0 28 Jul 2021
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision Zhongyang Li Xiao Ding Kuo Liao Bing Qin Ting Liu CML 29 17 0 21 Jul 2021
A Theoretical Analysis of Fine-tuning with Linear Teachers Gal Shachaf Alon Brutzkus Amir Globerson 34 17 0 04 Jul 2021
TIMEDIAL: Temporal Commonsense Reasoning in Dialog Lianhui Qin Aditya Gupta Shyam Upadhyay Luheng He Yejin Choi Manaal Faruqui LRM 31 65 0 08 Jun 2021
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning Piotr Pikekos Henryk Michalewski Mateusz Malinowski 30 28 0 07 Jun 2021
What's in your Head? Emergent Behaviour in Multi-Task Transformer Models Mor Geva Uri Katz Aviv Ben-Arie Jonathan Berant LRM 43 11 0 13 Apr 2021