XLNet: Generalized Autoregressive Pretraining for Language Understanding

19 June 2019

Papers citing "XLNet: Generalized Autoregressive Pretraining for Language Understanding"

50 / 1,333 papers shown

Title
Manipulating Predictions over Discrete Inputs in Machine Teaching Xiaodong Wu Yufei Han H. Dahrouj Jianbing Ni Zhenwen Liang Xiangliang Zhang 14 0 0 31 Jan 2024
Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks Savas Yildirim 11 6 0 30 Jan 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 79 15 0 30 Jan 2024
BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining Wen-Chieh Liang Youzhi Liang OffRL 30 2 0 29 Jan 2024
Quantifying Stereotypes in Language Yang Liu 38 1 0 28 Jan 2024
Looking Right is Sometimes Right: Investigating the Capabilities of Decoder-only LLMs for Sequence Labeling David Dukić Jan Šnajder 24 13 0 25 Jan 2024
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval Guangyuan Ma Xing Wu Zijia Lin Songlin Hu 31 4 0 20 Jan 2024
ScripTONES: Sentiment-Conditioned Music Generation for Movie Scripts Vishruth Veerendranath Vibha Masti Utkarsh Gupta Hrishit Chaudhuri Gowri Srinivasa 25 1 0 13 Jan 2024
MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognition Zheng Lian Guoying Zhao Yong Ren Hao Gu Haiyang Sun Lan Chen Bin Liu Jianhua Tao 21 12 0 07 Jan 2024
A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Software Engineering Tasks Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen LiGuo Huang Bin Luo 32 5 0 25 Dec 2023
C2FAR: Coarse-to-Fine Autoregressive Networks for Precise Probabilistic Forecasting Shane Bergsma Timothy J. Zeyl J. R. Anaraki Lei Guo BDL AI4TS 26 9 0 22 Dec 2023
Zebra: Extending Context Window with Layerwise Grouped Local-Global Attention Kaiqiang Song Xiaoyang Wang Sangwoo Cho Xiaoman Pan Dong Yu 34 7 0 14 Dec 2023
SLJP: Semantic Extraction based Legal Judgment Prediction Prameela Madambakam Shathanaa Rajmohan Himangshu Sharma Tummepalli Anka Chandrahas Purushotham Gupta ELM AILaw 28 0 0 13 Dec 2023
Exploring Large Language Models to Facilitate Variable Autonomy for Human-Robot Teaming Younes Lakhnati Max Pascher Jens Gerken LLMAG LM&Ro 40 3 0 12 Dec 2023
Dynamic Corrective Self-Distillation for Better Fine-Tuning of Pretrained Models Ibtihel Amara Vinija Jain Aman Chadha 32 0 0 12 Dec 2023
4M: Massively Multimodal Masked Modeling David Mizrahi Roman Bachmann Ouguzhan Fatih Kar Teresa Yeo Mingfei Gao Afshin Dehghan Amir Zamir MLLM 50 64 0 11 Dec 2023
Evaluating ChatGPT as a Question Answering System: A Comprehensive Analysis and Comparison with Existing Models Hossein Bahak Farzaneh Taheri Zahra Zojaji Arefeh Kazemi ELM AI4MH 36 17 0 11 Dec 2023
Long-MIL: Scaling Long Contextual Multiple Instance Learning for Histopathology Whole Slide Image Analysis Honglin Li Yunlong Zhang Chenglu Zhu Jiatong Cai Sunyi Zheng Lin Yang VLM 35 4 0 21 Nov 2023
Argumentation Element Annotation Modeling using XLNet Christopher M. Ormerod Amy Burkhardt Mackenzie Young Susan Lottridge 28 2 0 10 Nov 2023
Making LLMs Worth Every Penny: Resource-Limited Text Classification in Banking Lefteris Loukas Ilias Stogiannidis Odysseas Diamantopoulos Prodromos Malakasiotis Stavros Vassos 12 45 0 10 Nov 2023
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences Yuanhe Tian Ruyi Gan Yan Song Jiaxing Zhang Yongdong Zhang AI4MH AI4CE LM&MA 27 31 0 10 Nov 2023
Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated? David Novoa-Paradela O. Fontenla-Romero B. Guijarro-Berdiñas 20 0 0 08 Nov 2023
Evaluating multiple large language models in pediatric ophthalmology J. Holmes Rui Peng Yiwei Li Jinyu Hu Zheng Liu ... Wei Liu Hong Wei Jie Zou Tianming Liu Yi Shao AI4Ed ELM LM&MA 21 0 0 07 Nov 2023
OmniVec: Learning robust representations with cross modal sharing Siddharth Srivastava Gaurav Sharma SSL 29 64 0 07 Nov 2023
Sentiment Analysis through LLM Negotiations Xiaofei Sun Xiaoya Li Shengyu Zhang Shuhe Wang Fei Wu Jiwei Li Tianwei Zhang Guoyin Wang 32 16 0 03 Nov 2023
Towards Concept-Aware Large Language Models Chen Shani Jilles Vreeken Dafna Shahaf LRM 27 6 0 03 Nov 2023
Discourse Relations Classification and Cross-Framework Discourse Relation Classification Through the Lens of Cognitive Dimensions: An Empirical Investigation Yingxue Fu 24 0 0 01 Nov 2023
XAI-CLASS: Explanation-Enhanced Text Classification with Extremely Weak Supervision Daniel Hajialigol Hanwen Liu Xuan Wang VLM 21 5 0 31 Oct 2023
Unveiling Black-boxes: Explainable Deep Learning Models for Patent Classification Md. Shajalal Sebastian Denef Md. Rezaul Karim Alexander Boden Gunnar Stevens XAI 24 5 0 31 Oct 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 30 137 0 31 Oct 2023
An Ensemble Method Based on the Combination of Transformers with Convolutional Neural Networks to Detect Artificially Generated Text Vijini Liyanage Davide Buscaldi DeLMO 29 2 0 26 Oct 2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance? Ahmed Alajrami Katerina Margatina Nikolaos Aletras AAML 19 1 0 26 Oct 2023
Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluation S. Nigam Aniket Deroy Noel Shallum Ayush Kumar Mishra Anup Roy Shubham Kumar Mishra Arnab Bhattacharya Saptarshi Ghosh Kripabandhu Ghosh AILaw ELM 23 10 0 17 Oct 2023
DropMix: Better Graph Contrastive Learning with Harder Negative Samples Yueqi Ma Minjie Chen Xiang Li SSL 28 1 0 15 Oct 2023
Language Models As Semantic Indexers Bowen Jin Hansi Zeng Guoyin Wang Xiusi Chen Tianxin Wei ... Yang Li Hanqing Lu Suhang Wang Jiawei Han Xianfeng Tang RALM 40 18 0 11 Oct 2023
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models Ariel Goldstein Eric Ham Mariano Schain Samuel A. Nastase Zaid Zada ... Avinatan Hassidim O. Devinsky A. Flinker Omer Levy Uri Hasson AI4CE 18 10 0 11 Oct 2023
Argumentative Stance Prediction: An Exploratory Study on Multimodality and Few-Shot Learning Arushi Sharma Abhibha Gupta Maneesh Bilalpur 24 5 0 11 Oct 2023
GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Models B. Silva Leonardo Nunes Roberto Estevão Vijay Aski Ranveer Chandra ELM LM&MA 43 12 0 10 Oct 2023
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models Huiqiang Jiang Qianhui Wu Chin-Yew Lin Yuqing Yang Lili Qiu 34 102 0 09 Oct 2023
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models Chenzhuang Du Yue Zhao Chonghua Liao Jiacheng You Jie Fu Hang Zhao 39 2 0 08 Oct 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jiadong Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
Word Embedding with Neural Probabilistic Prior Shaogang Ren Dingcheng Li P. Li BDL 22 0 0 21 Sep 2023
SplitEE: Early Exit in Deep Neural Networks with Split Computing Divya J. Bajpai Vivek K. Trivedi S. L. Yadav M. Hanawal 28 5 0 17 Sep 2023
Balanced and Explainable Social Media Analysis for Public Health with Large Language Models Yan Jiang Ruihong Qiu Yi Zhang Peng Zhang 24 7 0 12 Sep 2023
UQ at #SMM4H 2023: ALEX for Public Health Analysis with Social Media Yan Jiang Ruihong Qiu Yi Zhang Zi Huang LM&MA 22 2 0 08 Sep 2023
Evaluating ChatGPT as a Recommender System: A Rigorous Approach Dario Di Palma Giovanni Maria Biancofiore Vito Walter Anelli Fedelucio Narducci Tommaso Di Noia E. Sciascio ALM 46 27 0 07 Sep 2023
A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER Guanting Dong Zechen Wang Jinxu Zhao Gang Zhao Daichi Guo ... Keqing He Xuefeng Li Liwen Wang Xinyue Cui Weiran Xu 37 19 0 28 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Xiaozhong Liu 78 31 0 27 Aug 2023
Learning Representations on Logs for AIOps Pranjal Gupta Harshit Kumar Debanjana Kar Karan Bhukar Pooja Aggarwal P. Mohapatra 37 11 0 18 Aug 2023
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge Minsu Kim Jeong Hun Yeo J. Choi Y. Ro 34 16 0 18 Aug 2023