MPNet: Masked and Permuted Pre-training for Language Understanding

20 April 2020

Xu Tan

Papers citing "MPNet: Masked and Permuted Pre-training for Language Understanding"

50 / 163 papers shown

Title
Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning Milan Ganai Rohan Sinha Christopher Agia Daniel Morton Marco Pavone OffRL LRM AI4CE 35 0 0 15 May 2025
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for Documentaries Jinze Lv Jian Chen Zi Long Xianghua Fu Yin Chen VGen 47 0 0 09 May 2025
QBR: A Question-Bank-Based Approach to Fine-Grained Legal Knowledge Retrieval for the General Public Mingruo Yuan Ben Kao Tien-Hsuan Wu AILaw 76 0 0 08 May 2025
Understanding LLM Scientific Reasoning through Promptings and Model's Explanation on the Answers Alice Rueda Mohammed S. Hassan Argyrios Perivolaris Bazen G. Teferra Reza Samavi ... Y. Wu Wenjie Qu Bo Cao Divya Sharma Sridhar Krishnan Venkat Bhat ELM LRM 58 0 0 02 May 2025
Harnessing Structured Knowledge: A Concept Map-Based Approach for High-Quality Multiple Choice Question Generation with Effective Distractors Nicy Scaria Silvester John Joseph Kennedy Diksha Seth Ananya Thakur Deepak N. Subramani AI4Ed 25 0 0 02 May 2025
Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions Saffron Huang Esin Durmus Miles McCain Kunal Handa Alex Tamkin Jerry Hong Michael Stern Arushi Somani Xiuruo Zhang Deep Ganguli VLM 59 1 0 21 Apr 2025
An evaluation of LLMs and Google Translate for translation of selected Indian languages via sentiment and semantic analyses Rohitash Chandra Aryan Chaudhary Yeshwanth Rayavarapu 44 0 0 27 Mar 2025
ConSCompF: Consistency-focused Similarity Comparison Framework for Generative Large Language Models Alexey Karev Dong Xu 58 0 0 18 Mar 2025
Adaptively profiling models with task elicitation Davis Brown Prithvi Balehannina Helen Jin Shreya Havaldar Hamed Hassani Eric Wong ALM ELM 111 0 0 03 Mar 2025
Detecting Code Vulnerabilities with Heterogeneous GNN Training Yu Luo Weifeng Xu Dianxiang Xu 46 0 0 24 Feb 2025
Question Answering with Texts and Tables through Deep Reinforcement Learning M. M. José Flávio Nakasato Cação Maria F. Ribeiro Rafael M. Cheang Paulo Pirozelli Fabio Gagliardi Cozman LMTD RALM 167 0 0 21 Feb 2025
Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment Jingcheng Deng Zhongtao Jiang Liang Pang Liwei Chen Kun Xu Zihao Wei Huawei Shen Xueqi Cheng 57 1 0 17 Feb 2025
FactIR: A Real-World Zero-shot Open-Domain Retrieval Benchmark for Fact-Checking Venktesh V Vinay Setty HILM 54 0 0 09 Feb 2025
On Memory Construction and Retrieval for Personalized Conversational Agents Zhuoshi Pan Qianhui Wu Huiqiang Jiang Xufang Luo Hao Cheng ... Yuqing Yang Chin-Yew Lin H. Vicky Zhao Lili Qiu Jianfeng Gao RALM 61 3 0 08 Feb 2025
Detecting harassment and defamation in cyberbullying with emotion-adaptive training Peiling Yi A. Zubiaga Yunfei Long 87 0 0 28 Jan 2025
Irony Detection, Reasoning and Understanding in Zero-shot Learning Peiling Yi Yuhan Xia 56 0 0 28 Jan 2025
AgentRec: Agent Recommendation Using Sentence Embeddings Aligned to Human Feedback Joshua Park Yongfeng Zhang LLMAG LM&Ro 97 1 0 23 Jan 2025
Compositional Instruction Following with Language Models and Reinforcement Learning Vanya Cohen Geraud Nangue Tasse N. Gopalan Steven D. James Matthew C. Gombolay Ray Mooney Benjamin Rosman 73 0 0 21 Jan 2025
Multi-Agent Planning Using Visual Language Models Michele Brienza F. Argenziano Vincenzo Suriani D. Bloisi Daniele Nardi LM&Ro LLMAG 70 4 0 31 Dec 2024
Personality Differences Drive Conversational Dynamics: A High-Dimensional NLP Approach Julia R. Fischer Nilam Ram 39 0 0 31 Dec 2024
VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation Manan Suri Puneet Mathur Franck Dernoncourt Kanika Goswami Ryan Rossi Dinesh Manocha 95 3 0 14 Dec 2024
UniHGKR: Unified Instruction-aware Heterogeneous Knowledge Retrievers Dehai Min Zhiyang Xu Guilin Qi Lifu Huang Chenyu You RALM 75 1 0 26 Oct 2024
Isolated Causal Effects of Natural Language Victoria Lin Louis-Philippe Morency Eli Ben-Michael CML 36 1 0 18 Oct 2024
Towards Graph Foundation Models: Training on Knowledge Graphs Enables Transferability to General Graphs Kai Wang Siqiang Luo Caihua Shan Yifei Shen 34 0 0 16 Oct 2024
ERASMO: Leveraging Large Language Models for Enhanced Clustering Segmentation Fillipe dos Santos Silva Gabriel Kenzo Kakimoto Julio Cesar dos Reis Marcelo S. Reis 29 0 0 01 Oct 2024
Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models Patrick Amadeus Irawan Genta Indra Winata Samuel Cahyawijaya Ayu Purwarianti 34 0 0 23 Sep 2024
Algorithmic Behaviors Across Regions: A Geolocation Audit of YouTube Search for COVID-19 Misinformation Between the United States and South Africa Hayoung Jung Prerna Juneja Tanushree Mitra MLAU 68 0 0 16 Sep 2024
Extracting Paragraphs from LLM Token Activations Nicholas Pochinkov Angelo Benoit Lovkush Agarwal Zainab Ali Majid Lucile Ter-Minassian 32 1 0 10 Sep 2024
Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theory Haoran Li Wei Fan Yulin Chen Jiayang Cheng Tianshu Chu Xuebing Zhou Peizhao Hu Yangqiu Song AILaw 50 2 0 19 Aug 2024
Cybersecurity Defenses: Exploration of CVE Types through Attack Descriptions Refat Othman Bruno Rossi Barbara Russo 24 1 0 09 Jul 2024
Crafting Large Language Models for Enhanced Interpretability Chung-En Sun Tuomas P. Oikarinen Tsui-Wei Weng 38 6 0 05 Jul 2024
Query-Guided Self-Supervised Summarization of Nursing Notes Ya Gao H. Moen S. Koivusalo M. Koskinen Pekka Marttinen 44 1 0 04 Jul 2024
LLCoach: Generating Robot Soccer Plans using Multi-Role Large Language Models Michele Brienza Emanuele Musumeci Vincenzo Suriani Daniele Affinita A. Pennisi Daniele Nardi D. Bloisi LLMAG LM&Ro 44 1 0 26 Jun 2024
Few-shot Personalization of LLMs with Mis-aligned Responses Jaehyung Kim Yiming Yang 50 7 0 26 Jun 2024
Efficient Parallel Multi-Hop Reasoning: A Scalable Approach for Knowledge Graph Analysis Jesmin Jahan Tithi Fabio Checconi Fabrizio Petrini LRM 35 0 0 11 Jun 2024
The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding Kenneth Enevoldsen Márton Kardos Niklas Muennighoff Kristoffer Nielbo 42 9 0 04 Jun 2024
Don't Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models A. Bavaresco A. Testoni Raquel Fernández 36 2 0 31 May 2024
$$\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning$ $\textit{Trans-LoRA}$ : towards data-free Transferable Parameter Efficient Finetuning Runqian Wang Soumya Ghosh David D. Cox Diego Antognini Aude Oliva Rogerio Feris Leonid Karlinsky 40 1 0 27 May 2024
A Cross-Dataset Study for Text-based 3D Human Motion Retrieval Léore Bensabath Mathis Petrovich Gül Varol 55 2 0 27 May 2024
How Well Do Deep Learning Models Capture Human Concepts? The Case of the Typicality Effect Siddhartha K. Vemuri Raj Sanjay Shah Sashank Varma VLM 37 5 0 25 May 2024
Intervention-Aware Forecasting: Breaking Historical Limits from a System Perspective Zhijian Xu Hao Wang Qiang Xu AI4TS 41 11 0 22 May 2024
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training Hyesong Choi Hyejin Park Kwang Moo Yi Sungmin Cha Dongbo Min 39 9 0 12 Apr 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 71 5 0 11 Apr 2024
AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets Pietro Lesci Andreas Vlachos 35 2 0 08 Apr 2024
NLP4Gov: A Comprehensive Library for Computational Policy Analysis Mahasweta Chakraborti Sailendra Akash Bonagiri Santiago Virgüez-Ruiz Seth Frey AILaw 38 0 0 04 Apr 2024
HETAL: Efficient Privacy-preserving Transfer Learning with Homomorphic Encryption Seewoo Lee Garam Lee Jung Woo Kim Junbum Shin Mun-Kyu Lee 36 26 0 21 Mar 2024
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering Armin Toroghi Willis Guo Mohammad Mahdi Torabi pour Scott Sanner LRM 31 8 0 03 Mar 2024
Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents Renxi Wang Haonan Li Xudong Han Yixuan Zhang Timothy Baldwin LLMAG 27 22 0 18 Feb 2024
SemScore: Automated Evaluation of Instruction-Tuned LLMs based on Semantic Textual Similarity Ansar Aynetdinov Alan Akbik ALM 44 12 0 30 Jan 2024
SMUTF: Schema Matching Using Generative Tags and Hybrid Features Yu Zhang Mei Di Haozheng Luo Chenwei Xu Richard Tzong-Han Tsai 65 7 0 22 Jan 2024