LUNA: Language Understanding with Number Augmentations on Transformers
via Number Plugins and Pre-training

v1v2 (latest)

LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training

6 December 2022

ArXiv (abs)PDF HTML

Papers citing "LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training"

16 / 16 papers shown

Title
Why are NLP Models Fumbling at Elementary Math? A Survey of Deep Learning based Word Problem Solvers Sowmya S. Sundaram Sairam Gurajada M. Fisichella Deepak P Savitha Sam Abraham ReLM 54 11 0 31 May 2022
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq Joty Caiming Xiong Guosheng Lin FaML 221 1,975 0 16 Jul 2021
TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance Fengbin Zhu Wenqiang Lei Youcheng Huang Chao Wang Shuo Zhang Jiancheng Lv Fuli Feng Tat-Seng Chua AIMat 123 304 0 17 May 2021
Representing Numbers in NLP: a Survey and a Vision Avijit Thawani Jay Pujara Pedro A. Szekely Filip Ilievski 80 118 0 24 Mar 2021
Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi Yair Schiff Igor Melnyk Mattia Rigotti Youssef Mroueh Pierre Dognin Jerret Ross Ravi Nair Erik Altman LMTD AI4TS 72 92 0 03 Nov 2020
Do Language Embeddings Capture Scales? Xikun Zhang Deepak Ramachandran Ian Tenney Yanai Elazar Dan Roth MILM ReLM LRM 68 93 0 11 Oct 2020
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks Suchin Gururangan Ana Marasović Swabha Swayamdipta Kyle Lo Iz Beltagy Doug Downey Noah A. Smith VLM AI4CE CLL 167 2,440 0 23 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 377 1,489 0 18 Mar 2020
TabFact: A Large-scale Dataset for Table-based Fact Verification Wenhu Chen Hongmin Wang Jianshu Chen Yunkai Zhang Hong Wang Shiyang Li Xiyou Zhou William Yang Wang LMTD 109 514 0 05 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 689 24,557 0 26 Jul 2019
Time2Vec: Learning a Vector Representation of Time Seyed Mehran Kazemi Rishab Goel Sepehr Eghbali J. Ramanan Jaspreet Sahota Sanjay Thakur Stella Wu Cathal Smyth Pascal Poupart Marcus A. Brubaker AI4TS 70 348 0 11 Jul 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Numeracy for Language Models: Evaluating and Improving their Ability to Predict Numbers Georgios P. Spithourakis Sebastian Riedel 59 83 0 21 May 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 803 132,454 0 12 Jun 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 914 6,797 0 26 Sep 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 238 7,760 0 31 Aug 2015