MPNet: Masked and Permuted Pre-training for Language Understanding

20 April 2020

Xu Tan

Papers citing "MPNet: Masked and Permuted Pre-training for Language Understanding"

50 / 164 papers shown

Title
Few-shot Multimodal Multitask Multilingual Learning Aman Chadha Vinija Jain 53 0 0 19 Feb 2023
ClusterLog: Clustering Logs for Effective Log-based Anomaly Detection Chris Egersdoerfer Dong Dai Di Zhang 22 6 0 19 Jan 2023
Rethinking with Retrieval: Faithful Large Language Model Inference Hangfeng He Hongming Zhang Dan Roth KELM LRM 143 157 0 31 Dec 2022
Homonymy Information for English WordNet Rowan Hall Maudslay Simone Teufel 19 2 0 16 Dec 2022
A large-scale and PCR-referenced vocal audio dataset for COVID-19 Jobie Budd Kieran Baker E. Karoune H. Coppock Selina Patel ... D. Pigoli Stephen J. Roberts Josef Packham T. Thornley Chris Holmes 35 5 0 15 Dec 2022
DeepJoin: Joinable Table Discovery with Pre-trained Language Models Yuyang Dong Chuan Xiao Takuma Nozawa Masafumi Enomoto Masafumi Oyamada 27 18 0 15 Dec 2022
LAMBRETTA: Learning to Rank for Twitter Soft Moderation Pujan Paudel Jeremy Blackburn Emiliano De Cristofaro Savvas Zannettou Gianluca Stringhini 17 11 0 12 Dec 2022
Counterfactual reasoning: Do language models need world knowledge for causal understanding? Jiaxuan Li Lang-Chi Yu Allyson Ettinger CML LRM 19 1 0 06 Dec 2022
I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification Muhammad Ferjad Naeem Muhammad Gul Zain Ali Khan Yongqin Xian Muhammad Zeshan Afzal D. Stricker Luc Van Gool F. Tombari VLM 35 52 0 05 Dec 2022
Analysis of Utterance Embeddings and Clustering Methods Related to Intent Induction for Task-Oriented Dialogue Jeiyoon Park Yoonna Jang Chanhee Lee Heu-Jeoung Lim 41 3 0 05 Dec 2022
Utilizing Background Knowledge for Robust Reasoning over Traffic Situations Jiarui Zhang Filip Ilievski Aravinda Kollaa Jonathan M Francis Kaixin Ma A. Oltramari 21 2 0 04 Dec 2022
Legal Prompting: Teaching a Language Model to Think Like a Lawyer Fang Yu Lee Quartey Frank Schilder ELM LRM 18 64 0 02 Dec 2022
Sonus Texere! Automated Dense Soundtrack Construction for Books using Movie Adaptations Jaidev Shriram Makarand Tapaswi Vinoo Alluri 11 2 0 02 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 34 2 0 01 Dec 2022
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations Amanpreet Singh Mike DÁrcy Arman Cohan Doug Downey Sergey Feldman 22 82 0 23 Nov 2022
BESS: Balanced Entity Sampling and Sharing for Large-Scale Knowledge Graph Completion A. Cattaneo Daniel Justus Harry Mellor Douglas Orr Jérôme Maloberti Ziqiang Liu Thorin Farnsworth Andrew Fitzgibbon Bla.zej Banaszewski Carlo Luschi 24 4 0 22 Nov 2022
Evaluating the Knowledge Dependency of Questions Hyeongdon Moon Yoonseok Yang Jamin Shin Hangyeol Yu Seunghyun Lee Myeongho Jeong Juneyoung Park Minsam Kim Seungtaek Choi AI4Ed 31 10 0 21 Nov 2022
Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues Canyu Chen Haoran Wang Matthew A. Shapiro Yunyu Xiao Fei Wang Kai Shu 22 12 0 10 Nov 2022
Discord Questions: A Computational Approach To Diversity Analysis in News Coverage Philippe Laban Chien-Sheng Wu Lidiya Murakhovs'ka Xiang Ánthony' Chen Caiming Xiong 24 12 0 09 Nov 2022
Unsupervised Audio-Visual Lecture Segmentation Darshan Singh Anchit Gupta C. V. Jawahar Makarand Tapaswi VOS 24 4 0 29 Oct 2022
Robustifying Sentiment Classification by Maximally Exploiting Few Counterfactuals Maarten De Raedt Fréderic Godin Chris Develder Thomas Demeester 13 1 0 21 Oct 2022
MTEB: Massive Text Embedding Benchmark Niklas Muennighoff Nouamane Tazi L. Magne Nils Reimers 28 375 0 13 Oct 2022
Noise-Robust De-Duplication at Scale Emily Silcock Luca DÁmico-Wong Jinglin Yang Melissa Dell SyDa 39 20 0 09 Oct 2022
One-Shot Doc Snippet Detection: Powering Search in Document Beyond Text Abhinav Java Shripad Deshmukh Milan Aggarwal Surgan Jandial Mausoom Sarkar Balaji Krishnamurthy 32 3 0 12 Sep 2022
Towards explainable evaluation of language models on the semantic similarity of visual concepts Maria Lymperaiou George Manoliadis Orfeas Menis Mastromichalakis Edmund Dervakos Giorgos Stamou AAML 24 5 0 08 Sep 2022
Evaluating Dense Passage Retrieval using Transformers Nima Sadri 15 0 0 15 Aug 2022
Continuous Active Learning Using Pretrained Transformers Nima Sadri G. Cormack KELM 29 2 0 15 Aug 2022
Cause-and-Effect Analysis of ADAS: A Comparison Study between Literature Review and Complaint Data Jackie Ayoub Zifei Wang Meitang Li Huizhong Guo Rini Sherony Shan Bao Feng Zhou 13 17 0 30 Jul 2022
Two-Pass Low Latency End-to-End Spoken Language Understanding Siddhant Arora Siddharth Dalmia Xuankai Chang Brian Yan A. Black Shinji Watanabe VLM 30 19 0 14 Jul 2022
Text Enriched Sparse Hyperbolic Graph Convolutional Networks Nurendra Choudhary Nikhil S. Rao Karthik Subbian Chandan K. Reddy 28 0 0 06 Jul 2022
Shopping Queries Dataset: A Large-Scale ESCI Benchmark for Improving Product Search Chandan K. Reddy Lluís Màrquez i Villodre Francisco B. Valero Nikhil S. Rao H. Zaragoza S. Bandyopadhyay Arnab Biswas Anlu Xing Karthik Subbian 21 46 0 14 Jun 2022
GateNLP-UShef at SemEval-2022 Task 8: Entity-Enriched Siamese Transformer for Multilingual News Article Similarity Iknoor Singh Yue Li Melissa Thong Carolina Scarton 28 3 0 31 May 2022
Happenstance: Utilizing Semantic Search to Track Russian State Media Narratives about the Russo-Ukrainian War On Reddit Hans W. A. Hanley Deepak Kumar Zakir Durumeric 19 40 0 28 May 2022
Can Foundation Models Help Us Achieve Perfect Secrecy? Simran Arora Christopher Ré FedML 24 6 0 27 May 2022
What's in a Caption? Dataset-Specific Linguistic Diversity and Its Effect on Visual Description Models and Metrics David M. Chan Austin Myers Sudheendra Vijayanarasimhan David A. Ross Bryan Seybold John F. Canny 28 6 0 12 May 2022
Scim: Intelligent Skimming Support for Scientific Papers Raymond Fok Hita Kambhamettu Luca Soldaini Jonathan Bragg Kyle Lo Andrew Head Marti A. Hearst Daniel S. Weld 18 36 0 09 May 2022
Towards a Progression-Aware Autonomous Dialogue Agent Abraham Sanders T. Strzalkowski Mei Si Albert Ling Sheng Chang D. Dey J. Braasch Usa LLMAG 33 8 0 07 May 2022
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders Ivan Vulić Goran Glavavs Fangyu Liu Nigel Collier Edoardo Ponti Anna Korhonen 28 8 0 30 Apr 2022
UMass PCL at SemEval-2022 Task 4: Pre-trained Language Model Ensembles for Detecting Patronizing and Condescending Language David Koleczek Alexander Scarlatos Siddha Makarand Karkare Preshma Linet Pereira 24 0 0 18 Apr 2022
What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Data Oier Mees Lukás Hermann Wolfram Burgard LM&Ro 30 149 0 13 Apr 2022
Clickbait Spoiling via Question Answering and Passage Retrieval Matthias Hagen Maik Frobe Artur Jurk Martin Potthast 32 35 0 19 Mar 2022
BERTopic: Neural topic modeling with a class-based TF-IDF procedure M. Grootendorst 44 1,378 0 11 Mar 2022
Matching Tweets With Applicable Fact-Checks Across Languages Ashkan Kazemi Zehua Li Verónica Pérez-Rosas Scott A. Hale Rada Mihalcea 28 16 0 14 Feb 2022
Learning To Recognize Procedural Activities with Distant Supervision Xudong Lin Fabio Petroni Gedas Bertasius Marcus Rohrbach Shih-Fu Chang Lorenzo Torresani 35 83 0 26 Jan 2022
Extending CLIP for Category-to-image Retrieval in E-commerce Mariya Hendriksen Maurits J. R. Bleeker Svitlana Vakulenko Nanne van Noord E. Kuiper Maarten de Rijke VLM 11 30 0 21 Dec 2021
Evaluating Pretrained Transformer Models for Entity Linking in Task-Oriented Dialog Sai Muralidhar Jayanthi Varsha Embar Karthik Raghunathan 17 6 0 15 Dec 2021
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet Siddhant Arora Siddharth Dalmia Pavel Denisov Xuankai Chang Yushi Ueda ... Karthik Ganesan Brian Yan Ngoc Thang Vu A. Black Shinji Watanabe VLM 33 74 0 29 Nov 2021
Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity Sheshera Mysore Arman Cohan Tom Hope 11 39 0 16 Nov 2021
FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference Alejandro Martín Javier Huertas-Tato Álvaro Huertas-García Guillermo Villar-Rodríguez David Camacho HILM 25 31 0 27 Oct 2021
Detecting Anti-Vaccine Users on Twitter Matheus Schmitz Goran Murić Keith Burghardt 24 5 0 21 Oct 2021