MPNet: Masked and Permuted Pre-training for Language Understanding

20 April 2020

Xu Tan

Papers citing "MPNet: Masked and Permuted Pre-training for Language Understanding"

50 / 164 papers shown

Title
Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding Yuu Jinnai Ukyo Honda Tetsuro Morimura Peinan Zhang 34 6 0 10 Jan 2024
Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selection G. Fatouros Konstantinos Metaxas John Soldatos D. Kyriazis AIFin 44 20 0 08 Jan 2024
Action-Item-Driven Summarization of Long Meeting Transcripts Logan Golia Jugal Kalita 30 1 0 29 Dec 2023
Information Type Classification with Contrastive Task-Specialized Sentence Encoders Philipp Seeberger Tobias Bocklet Korbinian Riedhammer 25 1 0 18 Dec 2023
The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning Bill Yuchen Lin Abhilasha Ravichander Ximing Lu Nouha Dziri Melanie Sclar Khyathi Raghavi Chandu Chandra Bhagavatula Yejin Choi 22 166 0 04 Dec 2023
Some Like It Small: Czech Semantic Embedding Models for Industry Applications Jirí Bednár Jakub Náplava Petra Barancíková Ondrej Lisický 30 5 0 23 Nov 2023
PELMS: Pre-training for Effective Low-Shot Multi-Document Summarization Joseph Peper Wenzhao Qiu Lu Wang 23 0 0 16 Nov 2023
Word Definitions from Large Language Models Yunting Yin Steven Skiena Samuel Kim Yunting Yin Steven Skiena AILaw 35 0 0 10 Nov 2023
Making LLMs Worth Every Penny: Resource-Limited Text Classification in Banking Lefteris Loukas Ilias Stogiannidis Odysseas Diamantopoulos Prodromos Malakasiotis Stavros Vassos 12 45 0 10 Nov 2023
Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated? David Novoa-Paradela O. Fontenla-Romero B. Guijarro-Berdiñas 20 0 0 08 Nov 2023
OmniVec: Learning robust representations with cross modal sharing Siddharth Srivastava Gaurav Sharma SSL 37 64 0 07 Nov 2023
Contextualizing the Limits of Model & Evaluation Dataset Curation on Semantic Similarity Classification Tasks Daniel Theron 20 0 0 03 Nov 2023
Unified Representation for Non-compositional and Compositional Expressions Ziheng Zeng Suma Bhat 25 3 0 29 Oct 2023
Cultural Adaptation of Recipes Yong Cao Yova Kementchedjhieva Ruixiang Cui Antonia Karamolegkou Li Zhou Megan Dare Lucia Donatelli Daniel Hershcovich 18 5 0 26 Oct 2023
Kiki or Bouba? Sound Symbolism in Vision-and-Language Models Morris Alper Hadar Averbuch-Elor 48 10 0 25 Oct 2023
RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Models Zefan Wang Zichuan Liu Yingying Zhang Aoxiao Zhong Lunting Fan Lingfei Wu Qingsong Wen 46 24 0 25 Oct 2023
Statistical Depth for Ranking and Characterizing Transformer-Based Text Embeddings Parker Seegmiller S. Preum 36 3 0 23 Oct 2023
Multilingual estimation of political-party positioning: From label aggregation to long-input Transformers Dmitry Nikolaev Tanise Ceron Sebastian Padó 32 1 0 19 Oct 2023
GeRA: Label-Efficient Geometrically Regularized Alignment Dustin Klebe Tal Shnitzer Mikhail Yurochkin Leonid Karlinsky Justin Solomon 13 2 0 01 Oct 2023
Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model Yoshiki Obinata Kento Kawaharazuka Naoaki Kanazawa N. Yamaguchi Naoto Tsukamoto Iori Yanokura Shingo Kitagawa Koki Shinjo K. Okada Masayuki Inaba LM&Ro 17 6 0 28 Sep 2023
Benchmarking Multilabel Topic Classification in the Kyrgyz Language Anton M. Alekseev Sergey I. Nikolenko Gulnara Kabaeva 35 3 0 30 Aug 2023
Graecia capta ferum victorem cepit. Detecting Latin Allusions to Ancient Greek Literature Frederick Riemenschneider Anette Frank 22 1 0 23 Aug 2023
ExpeL: LLM Agents Are Experiential Learners Andrew Zhao Daniel Huang Quentin Xu Matthieu Lin Yong-Jin Liu Gao Huang LLMAG 22 196 0 20 Aug 2023
Three Ways of Using Large Language Models to Evaluate Chat Ondvrej Plátek Vojtvech Hudevcek Patrícia Schmidtová Mateusz Lango Ondrej Dusek ALM 19 6 0 12 Aug 2023
Targeted and Troublesome: Tracking and Advertising on Children's Websites Zahra Moti Asuman Senol Hamid Bostani F. Z. Borgesius Veelasha Moonsamy Arunesh Mathur Gunes Acar 51 2 0 09 Aug 2023
Detecting Spells in Fantasy Literature with a Transformer Based Artificial Intelligence Marcel Moravek Alexander Zender Andreas Müller 10 0 0 07 Aug 2023
The Visual Language of Fabrics Valentin Deschaintre Julia Guerrero-Viu Diego F. F. Gutierrez T. Boubekeur B. Masiá 3DV 40 9 0 25 Jul 2023
KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding Zijun Yao Yantao Liu Xin Lv S. Cao Jifan Yu Lei Hou Juanzi Li 37 10 0 06 Jul 2023
Utilizing ChatGPT Generated Data to Retrieve Depression Symptoms from Social Media Ana-Maria Bucur AI4MH 32 10 0 05 Jul 2023
GIO: Gradient Information Optimization for Training Dataset Selection Dante Everaert Christopher Potts 23 3 0 20 Jun 2023
WizMap: Scalable Interactive Visualization for Exploring Large Machine Learning Embeddings Zijie J. Wang Fred Hohman Duen Horng Chau 37 20 0 15 Jun 2023
Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training Lorenzo Baraldi Roberto Amoroso Marcella Cornia Lorenzo Baraldi Andrea Pilzer Rita Cucchiara 38 2 0 12 Jun 2023
RadLing: Towards Efficient Radiology Report Understanding Rikhiya Ghosh Sanjeev Kumar Karn Manuela Danu Larisa Micu Ramya Vunikili Oladimeji Farri MedIm 29 6 0 04 Jun 2023
Bidirectional Transformer Reranker for Grammatical Error Correction Ying Zhang Hidetaka Kamigaito Manabu Okumura 24 2 0 22 May 2023
Description-Based Text Similarity Shauli Ravfogel Valentina Pyatkin Amir D. N. Cohen Avshalom Manevich Yoav Goldberg 28 5 0 21 May 2023
Machine-Made Media: Monitoring the Mobilization of Machine-Generated Articles on Misinformation and Mainstream News Websites Hans W. A. Hanley Zakir Durumeric DeLMO 23 29 0 16 May 2023
Going beyond research datasets: Novel intent discovery in the industry setting Aleksandra Chrabrowa Tsimur Hadeliya D. Kajtoch Robert Mroczkowski Piotr Rybak 24 2 0 09 May 2023
Curating corpora with classifiers: A case study of clean energy sentiment online M. V. Arnold P. Dodds C. Danforth 27 0 0 04 May 2023
Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11 James Gung Raphael Shu Emily Moeng Wesley Rose Salvatore Romeo Yassine Benajiba Arshit Gupta Saab Mansour Yi Zhang 23 8 0 25 Apr 2023
Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark] Alexandros Zeakis G. Papadakis Dimitrios Skoutas Manolis Koubarakis 32 37 0 24 Apr 2023
Procedure-Aware Pretraining for Instructional Video Understanding Honglu Zhou Roberto Martín-Martín Mubbasir Kapadia Silvio Savarese Juan Carlos Niebles 36 39 0 31 Mar 2023
Prefix tuning for automated audio captioning Minkyu Kim Kim Sung-Bin Tae-Hyun Oh 21 42 0 30 Mar 2023
Personalizing Task-oriented Dialog Systems via Zero-shot Generalizable Reward Function A. B. Siddique M. H. Maqbool Kshitija Taywade H. Foroosh 24 12 0 24 Mar 2023
Multi-View Zero-Shot Open Intent Induction from Dialogues: Multi Domain Batch and Proxy Gradient Transfer Hyukhun Koh Haesung Pyun Nakyeong Yang Kyomin Jung 40 1 0 23 Mar 2023
Improving Content Retrievability in Search with Controllable Query Generation Gustavo Penha Enrico Palumbo Maryam Aziz Alice Wang Hugues Bouchard 37 11 0 21 Mar 2023
mCPT at SemEval-2023 Task 3: Multilingual Label-Aware Contrastive Pre-Training of Transformers for Few- and Zero-shot Framing Detection Markus Reiter-Haas Alexander Ertl Kevin Innerhofer Elisabeth Lex VLM 19 7 0 17 Mar 2023
Proactive Prioritization of App Issues via Contrastive Learning Moghis Fereidouni A. Mosharrof Umar Farooq A. B. Siddique 33 4 0 12 Mar 2023
IGB: Addressing The Gaps In Labeling, Features, Heterogeneity, and Size of Public Graph Datasets for Deep Learning Research Arpandeep Khatua Vikram Sharma Mailthody Bhagyashree Taleka Tengfei Ma Xiang Song Wen-mei W. Hwu AI4CE 48 38 0 27 Feb 2023
Learning Visual Representations via Language-Guided Sampling Mohamed El Banani Karan Desai Justin Johnson SSL VLM 21 28 0 23 Feb 2023
In-context Example Selection with Influences Nguyen Tai Eric Wong 13 48 0 21 Feb 2023