Overcoming Barriers to Skill Injection in Language Modeling: Case Study in Arithmetic

3 November 2022

Papers citing "Overcoming Barriers to Skill Injection in Language Modeling: Case Study in Arithmetic"

20 / 20 papers shown

Title
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 62 10 0 25 Jul 2022
Probing for Multilingual Numerical Understanding in Transformer-Based Language Models Devin J. Johnson Denise Mak Drew Barker Lexi Loessberg-Zahl LRM 31 18 0 13 Oct 2020
Do Language Embeddings Capture Scales? Xikun Zhang Deepak Ramachandran Ian Tenney Yanai Elazar Dan Roth MILM ReLM LRM 58 93 0 11 Oct 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 702 41,736 0 28 May 2020
Injecting Numerical Reasoning Skills into Language Models Mor Geva Ankit Gupta Jonathan Berant AIMat LRM 62 225 0 09 Apr 2020
Predicting Neural Network Accuracy from Weights Thomas Unterthiner Daniel Keysers Sylvain Gelly Olivier Bousquet Ilya O. Tolstikhin 55 105 0 26 Feb 2020
Learning Numeral Embeddings Chengyue Jiang Zhonglin Nian Kaihao Guo Shanbo Chu Yinggong Zhao Libin Shen Kewei Tu 39 21 0 28 Dec 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 210 7,481 0 02 Oct 2019
Do NLP Models Know Numbers? Probing Numeracy in Embeddings Eric Wallace Yizhong Wang Sujian Li Sameer Singh Matt Gardner 71 265 0 17 Sep 2019
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs Dheeru Dua Yizhong Wang Pradeep Dasigi Gabriel Stanovsky Sameer Singh Matt Gardner AIMat 91 946 0 01 Mar 2019
EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language Inference Abhilasha Ravichander Aakanksha Naik Carolyn Rose Eduard H. Hovy AIMat ELM 52 85 0 11 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.6K 94,511 0 11 Oct 2018
Stress Test Evaluation for Natural Language Inference Aakanksha Naik Abhilasha Ravichander Norman M. Sadeh Carolyn Rose Graham Neubig ELM 67 376 0 02 Jun 2018
Numeracy for Language Models: Evaluating and Improving their Ability to Predict Numbers Georgios P. Spithourakis Sebastian Riedel 51 83 0 21 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.0K 7,152 0 20 Apr 2018
Learned in Translation: Contextualized Word Vectors Bryan McCann James Bradbury Caiming Xiong R. Socher 115 907 0 01 Aug 2017
SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation Daniel Cer Mona T. Diab Eneko Agirre I. Lopez-Gazpio Lucia Specia 398 1,880 0 31 Jul 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 509 4,473 0 18 Apr 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 332 7,478 0 02 Dec 2016
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 302 6,660 0 08 Jun 2015