DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

18 November 2021

Papers citing "DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing"

50 / 664 papers shown

Title
FAME-MT Dataset: Formality Awareness Made Easy for Machine Translation Purposes Dawid Wi'sniewski Zofia Rostek Artur Nowakowski 37 0 0 20 May 2024
SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations Fanfan Wang Heqing Ma Jianfei Yu Rui Xia Erik Cambria 40 22 0 19 May 2024
DeepPavlov at SemEval-2024 Task 8: Leveraging Transfer Learning for Detecting Boundaries of Machine-Generated Texts Anastasia Voznyuk Vasily Konovalov DeLMO 36 4 0 17 May 2024
AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning Mina Ghashami Soumya Smruti Mishra LRM 34 1 0 16 May 2024
SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation Abhishek Divekar Greg Durrett 42 6 0 16 May 2024
ALMol: Aligned Language-Molecule Translation LLMs through Offline Preference Contrastive Optimisation Dimitris Gkoumas 39 0 0 14 May 2024
Quantifying and Optimizing Global Faithfulness in Persona-driven Role-playing Letian Peng Jingbo Shang 48 2 0 13 May 2024
Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Facts Wenyu Huang Guancheng Zhou Mirella Lapata Pavlos Vougiouklis Sébastien Montella Jeff Z. Pan KELM 26 4 0 10 May 2024
Automatic Generation of Model and Data Cards: A Step Towards Responsible AI Jiarui Liu Wenkai Li Zhijing Jin Mona T. Diab SyDa 63 3 0 10 May 2024
Vietnamese AI Generated Text Detection Quang-Dan Tran Van-Quan Nguyen Quang-Huy Pham K. B. T. Nguyen Trong-Hop Do DeLMO 30 1 0 06 May 2024
SoftMCL: Soft Momentum Contrastive Learning for Fine-grained Sentiment-aware Pre-training Jin Wang Liang-Chih Yu Xuejie Zhang VLM 21 3 0 03 May 2024
Modeling Empathetic Alignment in Conversation Jiamin Yang David Jurgens 32 0 0 02 May 2024
Self-Play Preference Optimization for Language Model Alignment Yue Wu Zhiqing Sun Huizhuo Yuan Kaixuan Ji Yiming Yang Quanquan Gu 39 113 0 01 May 2024
Explainable Automatic Grading with Neural Additive Models Aubrey Condor Z. Pardos ELM 32 2 0 01 May 2024
Enhanced Language Model Truthfulness with Learnable Intervention and Uncertainty Expression Farima Fatahi Bayat Xin Liu H. V. Jagadish Lu Wang HILM KELM 33 3 0 01 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 38 14 0 29 Apr 2024
MediFact at MEDIQA-M3G 2024: Medical Question Answering in Dermatology with Multimodal Learning Nadia Saeed MedIm 36 2 0 27 Apr 2024
NTIRE 2024 Quality Assessment of AI-Generated Content Challenge Xiaohong Liu Xiongkuo Min Guangtao Zhai Chunyi Li Tengchuan Kou ... Qi Yan Youran Qu Xiaohui Zeng Lele Wang Renjie Liao 58 29 0 25 Apr 2024
AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models Zhiqiang Tang Haoyang Fang Su Zhou Taojiannan Yang Zihan Zhong Tony Hu Katrin Kirchhoff George Karypis 48 11 0 24 Apr 2024
Generating Attractive and Authentic Copywriting from Customer Reviews Yu-Xiang Lin Wei-Yun Ma 46 2 0 22 Apr 2024
Do "English" Named Entity Recognizers Work Well on Global Englishes? Alexander Shan John Bauer Riley Carlson Christopher D. Manning 33 2 0 20 Apr 2024
Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge Khuyagbaatar Batsuren Ekaterina Vylomova Verna Dankers Tsetsuukhei Delgerbaatar Omri Uzan Yuval Pinter Gábor Bella 35 9 0 20 Apr 2024
How often are errors in natural language reasoning due to paraphrastic variability? Neha Srikanth Marine Carpuat Rachel Rudinger LRM 35 2 0 17 Apr 2024
TeClass: A Human-Annotated Relevance-based Headline Classification and Generation Dataset for Telugu Gopichand Kanumolu Lokesh Madasu Nirmal Surange Manish Shrivastava 25 0 0 17 Apr 2024
MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents Liyan Tang Philippe Laban Greg Durrett HILM SyDa 43 78 0 16 Apr 2024
LoRA Dropout as a Sparsity Regularizer for Overfitting Control Yang Lin Xinyu Ma Xu Chu Yujie Jin Zhibang Yang Yasha Wang Hong-yan Mei 52 19 0 15 Apr 2024
Towards Greener Nights: Exploring AI-Driven Solutions for Light Pollution Management Paras Varshney Niral Desai Uzair Ahmed 19 1 0 15 Apr 2024
Neuro-Inspired Information-Theoretic Hierarchical Perception for Multimodal Learning Xiongye Xiao Gengshuo Liu Gaurav Gupta De-An Cao Shixuan Li Yaxing Li Tianqing Fang Mingxi Cheng Paul Bogdan 35 9 0 15 Apr 2024
JaFIn: Japanese Financial Instruction Dataset Kota Tanabe Masahiro Suzuki Hiroki Sakaji Itsuki Noda 47 1 0 14 Apr 2024
Semantic In-Domain Product Identification for Search Queries Sanatan Sharma Jayant Kumar Twisha Naik Z. Lu Arvind Srikantan Tracy Holloway King 34 0 0 13 Apr 2024
Multi-Image Visual Question Answering for Unsupervised Anomaly Detection Jun Li Cosmin I. Bercea Philipp Muller Lina Felsner Suhwan Kim Daniel Rueckert Benedikt Wiestler Julia A. Schnabel 29 3 0 11 Apr 2024
Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain Iker García-Ferrero Rodrigo Agerri Aitziber Atutxa Salazar Elena Cabrio Iker de la Iglesia ... Johana Ramirez-Romero German Rigau J. M. Villa-Gonzalez S. Villata Andrea Zaninello 86 19 0 11 Apr 2024
Meta4XNLI: A Crosslingual Parallel Corpus for Metaphor Detection and Interpretation Elisa Sanchez-Bayona Rodrigo Agerri 45 0 0 10 Apr 2024
Less is More for Improving Automatic Evaluation of Factual Consistency Tong Wang Ninad Kulkarni Yanjun Qi ALM 49 2 0 09 Apr 2024
Generalizable Sarcasm Detection Is Just Around The Corner, Of Course! Hyewon Jang Diego Frassinelli 24 2 0 09 Apr 2024
Understanding Cross-Lingual Alignment -- A Survey Katharina Hämmerl Jindvrich Libovický Alexander Fraser 41 10 0 09 Apr 2024
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders Parishad BehnamGhader Vaibhav Adlakha Marius Mosbach Dzmitry Bahdanau Nicolas Chapados Siva Reddy 53 185 0 09 Apr 2024
Comprehensive Study on German Language Models for Clinical and Biomedical Text Understanding Ahmad Idrissi-Yaghir Amin Dada Henning Schafer Kamyar Arzideh Giulia Baldini ... Peter A. Horn Christin Seifert F. Nensa Jens Kleesiek Christoph M. Friedrich AI4MH 39 2 0 08 Apr 2024
AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets Pietro Lesci Andreas Vlachos 35 2 0 08 Apr 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation Xinyu Ma Xu Chu Zhibang Yang Yang Lin Xin Gao Junfeng Zhao 46 7 0 05 Apr 2024
A School Student Essay Corpus for Analyzing Interactions of Argumentative Structure and Quality Maja Stahl Nadine Michel Sebastian Kilsbach Julian Schmidtke Sara Rezat Henning Wachsmuth 24 2 0 03 Apr 2024
Enhancing Human-Computer Interaction in Chest X-ray Analysis using Vision and Language Model with Eye Gaze Patterns Yunsoo Kim Jinge Wu Yusuf Abdulle Yue Gao Honghan Wu 43 3 0 03 Apr 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 64 76 0 03 Apr 2024
IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT Junchen Fu Xuri Ge Xin Xin Alexandros Karatzoglou Ioannis Arapakis Jie Wang Joemon M. Jose 45 18 0 02 Apr 2024
Can Humans Identify Domains? Maria Barrett Max Müller-Eberstein Elisa Bassignana Amalie Brogaard Pauli Mike Zhang Rob van der Goot 47 1 0 02 Apr 2024
AILS-NTUA at SemEval-2024 Task 9: Cracking Brain Teasers: Transformer Models for Lateral Thinking Puzzles Ioannis Panagiotopoulos Giorgos Filandrianos Maria Lymperaiou Giorgos Stamou 30 1 0 01 Apr 2024
Jetsons at FinNLP 2024: Towards Understanding the ESG Impact of a News Article using Transformer-based Models Parag Dakle Alolika Gon Sihan Zha Liang Wang SaiKrishna Rallabandi Preethi Raghavan 19 1 0 30 Mar 2024
EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs Cheng Jiayang Lin Qiu Chunkit Chan Xin Liu Yangqiu Song Zheng-Wei Zhang 43 9 0 30 Mar 2024
LUQ: Long-text Uncertainty Quantification for LLMs Caiqi Zhang Fangyu Liu Marco Basaldella Nigel Collier HILM 58 24 0 29 Mar 2024
RealKIE: Five Novel Datasets for Enterprise Key Information Extraction Benjamin Townsend Madison May Christopher Wells SyDa 37 0 0 29 Mar 2024