DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

18 November 2021

Papers citing "DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing"

50 / 664 papers shown

Title
RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation Gabriele Sarti Phu Mon Htut Xing Niu B. Hsu Anna Currey Georgiana Dinu Maria Nadejde LRM 45 10 0 26 May 2023
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering Yung-Sung Chuang Wei Fang Shang-Wen Li Wen-tau Yih James R. Glass LRM 29 12 0 26 May 2023
Adversarial Multi-task Learning for End-to-end Metaphor Detection Shenglong Zhang Yong-Jin Liu 11 11 0 26 May 2023
UFO: Unified Fact Obtaining for Commonsense Question Answering Zhifeng Li Yifan Fan Bowei Zou Yu Hong HILM LRM 32 1 0 25 May 2023
Learning Answer Generation using Supervision from Automatic Question Answering Evaluators Matteo Gabburo Siddhant Garg Rik Koncel-Kedziorski Alessandro Moschitti 29 6 0 24 May 2023
Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark Minje Choi Jiaxin Pei Sagar Kumar Chang Shu David Jurgens ALM LLMAG 35 69 0 24 May 2023
Modeling Appropriate Language in Argumentation Timon Ziegenbein S. Syed Felix Lange Martin Potthast Henning Wachsmuth 16 4 0 24 May 2023
CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering Weiqi Wang Tianqing Fang Wenxuan Ding Baixuan Xu Xin Liu Yangqiu Song Antoine Bosselut ReLM LRM 30 39 0 24 May 2023
Mitigating Temporal Misalignment by Discarding Outdated Facts Michael J.Q. Zhang Eunsol Choi KELM HILM 27 17 0 24 May 2023
AMELI: Enhancing Multimodal Entity Linking with Fine-Grained Attributes Barry Menglong Yao Yu Chen Qifan Wang Sijia Wang Minqian Liu Zhiyang Xu Licheng Yu Lifu Huang 26 7 0 24 May 2023
You Are What You Annotate: Towards Better Models through Annotator Representations Naihao Deng Xinliang Frederick Zhang Siyang Liu Winston Wu Lu Wang Rada Mihalcea 29 20 0 24 May 2023
Detecting Propaganda Techniques in Code-Switched Social Media Text Muhammad Salman Asif Hanif Shady Shehata Preslav Nakov 20 5 0 23 May 2023
Revisiting Machine Translation for Cross-lingual Classification Mikel Artetxe Vedanuj Goswami Shruti Bhosale Angela Fan Luke Zettlemoyer LRM 46 34 0 23 May 2023
Multilingual Large Language Models Are Not (Yet) Code-Switchers Ruochen Zhang Samuel Cahyawijaya Jan Christian Blaise Cruz Genta Indra Winata Alham Fikri Aji LRM 33 52 0 23 May 2023
Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis Oscar Chew Hsuan-Tien Lin Kai-Wei Chang Kuan-Hao Huang 38 5 0 23 May 2023
DUMB: A Benchmark for Smart Evaluation of Dutch Models Wietse de Vries Martijn B. Wieling Malvina Nissim ELM ALM MoE 34 6 0 22 May 2023
Fact-Checking Complex Claims with Program-Guided Reasoning Liangming Pan Xiaobao Wu Xinyuan Lu A. Luu William Yang Wang Min-Yen Kan Preslav Nakov LRM 52 116 0 22 May 2023
Continually Improving Extractive QA via Human Feedback Ge Gao Hung-Ting Chen Yoav Artzi Eunsol Choi 26 12 0 21 May 2023
NollySenti: Leveraging Transfer Learning and Machine Translation for Nigerian Movie Sentiment Classification Iyanuoluwa Shode David Ifeoluwa Adelani J. Peng Anna Feldman 35 10 0 18 May 2023
OpenSLU: A Unified, Modularized, and Extensible Toolkit for Spoken Language Understanding Libo Qin Qiguang Chen Xiao Xu Yunlong Feng Wanxiang Che ELM VLM 22 4 0 17 May 2023
Small Models are Valuable Plug-ins for Large Language Models Canwen Xu Yichong Xu Shuohang Wang Yang Liu Chenguang Zhu Julian McAuley LLMAG 44 45 0 15 May 2023
KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answering Zhifeng Li Bowei Zou Yifan Fan Yu Hong 24 3 0 15 May 2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering Qianglong Chen Guohai Xu Mingshi Yan Ji Zhang Fei Huang Luo Si Yin Zhang 21 9 0 14 May 2023
Using Language Models to Detect Alarming Student Responses Christopher M. Ormerod Milan Patel Harry Wang 51 0 0 12 May 2023
ANALOGYKB: Unlocking Analogical Reasoning of Language Models with A Million-scale Knowledge Base Siyu Yuan Jiangjie Chen Changzhi Sun Jiaqing Liang Yanghua Xiao Deqing Yang 39 16 0 10 May 2023
WikiSQE: A Large-Scale Dataset for Sentence Quality Estimation in Wikipedia Kenichiro Ando Satoshi Sekine Mamoru Komachi 30 2 0 10 May 2023
Decker: Double Check with Heterogeneous Knowledge for Commonsense Fact Verification Anni Zou Zhuosheng Zhang Hai Zhao HILM 37 6 0 10 May 2023
CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning Weiqi Wang Tianqing Fang Baixuan Xu Chun Yi Louis Bo Yangqiu Song Lei Chen ReLM LRM 25 34 0 08 May 2023
The Best Defense is Attack: Repairing Semantics in Textual Adversarial Examples Heng Yang Ke Li AAML 35 2 0 06 May 2023
MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic Damien Sileo Antoine Lernould LRM 16 25 0 05 May 2023
SemEval-2023 Task 7: Multi-Evidence Natural Language Inference for Clinical Trial Data Mael Jullien Marco Valentino H. Frost Paul O'Regan Dónal Landers André Freitas ELM 8 31 0 04 May 2023
Faithful Question Answering with Monte-Carlo Planning Ruixin Hong Hongming Zhang Honghui Zhao Dong Yu Changshui Zhang ReLM LRM 60 19 0 04 May 2023
Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understanding Juan Pablo Zuluaga Iuliia Nigmatulina Amrutha Prasad P. Motlícek Driss Khalil ... Allan Tart Igor Szöke Vincent Lenders M. Rigault K. Choukri 24 2 0 02 May 2023
Sebis at SemEval-2023 Task 7: A Joint System for Natural Language Inference and Evidence Retrieval from Clinical Trial Reports Juraj Vladika Florian Matthes 27 14 0 25 Apr 2023
NLP-LTU at SemEval-2023 Task 10: The Impact of Data Augmentation and Semi-Supervised Learning Techniques on Text Classification Performance on an Imbalanced Dataset Sana Al-Azzawi Gyorgy Kovács Filip Nilsson Tosin P. Adewumi Marcus Liwicki 28 6 0 25 Apr 2023
Detecting Spoilers in Movie Reviews with External Movie Knowledge and User Networks Heng Wang Wenqian Zhang Yuyang Bai Zhaoxuan Tan Shangbin Feng Qinghua Zheng Minnan Luo 35 3 0 22 Apr 2023
MasakhaNEWS: News Topic Classification for African languages David Ifeoluwa Adelani Marek Masiak Israel Abebe Azime Jesujoba Oluwadara Alabi A. Tonja ... Moges Ahmed Mehamed Evrard Ngabire Jules Jules Ivan Ssenkungu Pontus Stenetorp 28 24 0 19 Apr 2023
SemEval 2023 Task 6: LegalEval - Understanding Legal Texts Ashutosh Modi Prathamesh Kalamkar S. Karn Aman Tiwari Abhinav Joshi Sai Kiran Tanikella S. Guha Sachin Malhan Vivek Raghavan ELM AILaw 29 41 0 19 Apr 2023
Task-oriented Document-Grounded Dialog Systems by HLTPR@RWTH for DSTC9 and DSTC10 David Thulke Nico Daheim Christian Dugast Hermann Ney 44 6 0 14 Apr 2023
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval) Shamsuddeen Hassan Muhammad Idris Abdulmumin Seid Muhie Yimam David Ifeoluwa Adelani I. Ahmad N. Ousidhoum A. Ayele Saif M. Mohammad Meriem Beloucif Sebastian Ruder 38 67 0 13 Apr 2023
WikiGoldSK: Annotated Dataset, Baselines and Few-Shot Learning Experiments for Slovak Named Entity Recognition Dávid Suba Marek Suppa Jozef Kubík Endre Hamerlik Martin Takáč 32 0 0 08 Apr 2023
MphayaNER: Named Entity Recognition for Tshivenda R. Mbuvha David Ifeoluwa Adelani Tendani Mutavhatsindi Tshimangadzo Rakhuhu A. Mauda Tshifhiwa Joshua Maumela Andisani Masindi Seani Rananga Vukosi Marivate T. Marwala 59 0 0 08 Apr 2023
SSS at SemEval-2023 Task 10: Explainable Detection of Online Sexism using Majority Voted Fine-Tuned Transformers Sriya Rallabandi Sanchit Singhal Pratinav Seth 19 3 0 07 Apr 2023
ScandEval: A Benchmark for Scandinavian Natural Language Processing Dan Saattrup Nielsen ELM 28 14 0 03 Apr 2023
Task Oriented Conversational Modelling With Subjective Knowledge Rajath Kumar 12 1 0 30 Mar 2023
QUADRo: Dataset and Models for QUestion-Answer Database Retrieval S. Campese Ivano Lauriola Alessandro Moschitti 18 3 0 30 Mar 2023
Adapting Pretrained Language Models for Solving Tabular Prediction Problems in the Electronic Health Record C. McMaster D. Liew Douglas E. V. Pires 38 4 0 27 Mar 2023
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning Qingru Zhang Minshuo Chen Alexander Bukharin Nikos Karampatziakis Pengcheng He Yu Cheng Weizhu Chen Tuo Zhao 28 105 0 18 Mar 2023
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models Potsawee Manakul Adian Liusie Mark Gales HILM LRM 152 396 0 15 Mar 2023
NL4Opt Competition: Formulating Optimization Problems Based on Their Natural Language Descriptions Rindranirina Ramamonjison Timothy T. Yu Raymond Li Haley Li Giuseppe Carenini ... Shiqi He Mahdi Mostajabdaveh Amin Banitalebi-Dehkordi Zirui Zhou Yong Zhang 28 36 0 14 Mar 2023