v1v2v3 (latest)

Neural Network Acceptability Judgments

31 May 2018

Alex Warstadt

Amanpreet Singh

Samuel R. Bowman

ArXiv (abs)PDF HTML

Papers citing "Neural Network Acceptability Judgments"

50 / 894 papers shown

Title
Advancing Parameter Efficiency in Fine-tuning via Representation Editing Muling Wu Tianlong Li Xiaohua Wang Changze Lv Changze Lv Zixuan Ling Jianhao Zhu Cenyuan Zhang Xiaoqing Zheng Xuanjing Huang 79 25 0 23 Feb 2024
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning Zhisheng Lin Han Fu Chenghao Liu Zhuo Li Jianling Sun MoE MoMe 47 6 0 23 Feb 2024
Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond Xinyu Wang Hainiu Xu Lin Gui Yulan He MoMe AIFin 104 1 0 22 Feb 2024
Beyond Simple Averaging: Improving NLP Ensemble Performance with Topological-Data-Analysis-Based Weighting P. Proskura Alexey Zaytsev 90 0 0 22 Feb 2024
Improving Language Understanding from Screenshots Tianyu Gao Zirui Wang Adithya Bhaskar Danqi Chen VLM 82 10 0 21 Feb 2024
On Sensitivity of Learning with Limited Labelled Data to the Effects of Randomness: Impact of Interactions and Systematic Choices Branislav Pecher Ivan Srba Maria Bielikova 130 5 0 20 Feb 2024
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts Hao Zhao Zihan Qiu Huijia Wu Zili Wang Zhaofeng He Jie Fu MoE 120 13 0 20 Feb 2024
Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performance Branislav Pecher Ivan Srba Maria Bielikova ALM 100 8 0 20 Feb 2024
In-Context Learning Demonstration Selection via Influence Analysis Vinay M.S. Minh-Hao Van Xintao Wu 93 6 0 19 Feb 2024
Induced Model Matching: Restricted Models Help Train Full-Featured Models Usama Muneeb Mesrob I. Ohannessian 26 0 0 19 Feb 2024
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models Yifan Yang Jiajun Zhou Ngai Wong Zheng Zhang 73 8 0 18 Feb 2024
Contrastive Instruction Tuning Tianyi Yan Fei Wang James Y. Huang Wenxuan Zhou Fan Yin Aram Galstyan Wenpeng Yin Muhao Chen ALM 58 6 0 17 Feb 2024
Uncertainty Quantification for In-Context Learning of Large Language Models Chen Ling Xujiang Zhao Xuchao Zhang Wei Cheng Yanchi Liu ... Katsushi Matsuda Jie Ji Guangji Bai Liang Zhao Haifeng Chen 94 20 0 15 Feb 2024
Reusing Softmax Hardware Unit for GELU Computation in Transformers C. Peltekis K. Alexandridis G. Dimitrakopoulos 38 1 0 15 Feb 2024
JAMDEC: Unsupervised Authorship Obfuscation using Constrained Decoding over Small Language Models Jillian R. Fisher Ximing Lu Jaehun Jung Liwei Jiang Zaid Harchaoui Yejin Choi 91 7 0 13 Feb 2024
Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning Haeju Lee Minchan Jeong SeYoung Yun Kee-Eung Kim AAML VPVLM 88 3 0 13 Feb 2024
Should I try multiple optimizers when fine-tuning pre-trained Transformers for NLP tasks? Should I tune their hyperparameters? Nefeli Gkouti Prodromos Malakasiotis Stavros Toumpis Ion Androutsopoulos 51 5 0 10 Feb 2024
A Unified Causal View of Instruction Tuning Luyao Chen Wei Huang Ruqing Zhang Wei Chen Jiafeng Guo Xueqi Cheng 50 1 0 09 Feb 2024
Learn To be Efficient: Build Structured Sparsity in Large Language Models Haizhong Zheng Xiaoyan Bai Xueshen Liu Z. Morley Mao Beidi Chen Fan Lai Atul Prakash 118 17 0 09 Feb 2024
SoftEDA: Rethinking Rule-Based Data Augmentation with Soft Labels Juhwan Choi Kyohoon Jin Junho Lee Sang-hyŏn Song Youngbin Kim 72 6 0 08 Feb 2024
AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes Juhwan Choi Kyohoon Jin Junho Lee Sangmin Song Youngbin Kim 52 1 0 08 Feb 2024
The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry Michael Zhang Kush S. Bhatia Hermann Kumbong Christopher Ré 80 54 0 06 Feb 2024
Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes Yingyi Chen Qinghua Tao F. Tonin Johan A. K. Suykens 63 1 0 02 Feb 2024
SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing Sheng Li Geng Yuan Yuezhen Dai Youtao Zhang Yanzhi Wang Xulong Tang 92 19 0 30 Jan 2024
A Survey on Data Augmentation in Large Model Era Yue Zhou Chenlu Guo Xu Wang Yi-Ju Chang Yuan Wu LM&MA VLM 128 27 0 27 Jan 2024
HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy Yongkang Liu Yiqun Zhang Qian Li Tong Liu Shi Feng Daling Wang Yifei Zhang Hinrich Schütze 87 9 0 26 Jan 2024
Instructional Fingerprinting of Large Language Models Lyne Tchapmi Fei Wang Mingyu Derek Ma Pang Wei Koh Chaowei Xiao Muhao Chen WaLM 67 33 0 21 Jan 2024
Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion Aly M. Kassem Sherif Saad AAML 56 1 0 21 Jan 2024
Quantum Transfer Learning for Acceptability Judgements Giuseppe Buonaiuto Raffaele Guarasci Aniello Minutolo G. De Pietro M. Esposito 68 8 0 15 Jan 2024
Model Editing at Scale leads to Gradual and Catastrophic Forgetting Akshat Gupta Anurag Rao Gopala Anumanchipalli KELM CLL 82 55 0 15 Jan 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models Zhengxin Zhang Dan Zhao Xupeng Miao Gabriele Oliaro Qing Li Yong Jiang Zhihao Jia MQ 85 9 0 13 Jan 2024
The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performance A. Salinas Fred Morstatter 91 55 0 08 Jan 2024
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining Jacob P. Portes Alex Trott Sam Havens Daniel King Abhinav Venigalla Moin Nadeem Nikhil Sardana D. Khudia Jonathan Frankle 104 18 0 29 Dec 2023
Can persistent homology whiten Transformer-based black-box models? A case study on BERT compression Luis Balderas Miguel Lastra José M. Benítez 34 1 0 17 Dec 2023
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets Dirk Groeneveld Anas Awadalla Iz Beltagy Akshita Bhagia Ian H. Magnusson Hao Peng Oyvind Tafjord Pete Walsh Kyle Richardson Jesse Dodge 143 1 0 15 Dec 2023
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision Collin Burns Pavel Izmailov Jan Hendrik Kirchner Bowen Baker Leo Gao ... Adrien Ecoffet Manas Joglekar Jan Leike Ilya Sutskever Jeff Wu ELM 129 297 0 14 Dec 2023
GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction Jiacheng Ruan Jingsheng Gao Mingye Xie Suncheng Xiang Zefang Yu Ting Liu Yuzhuo Fu MoE 94 6 0 12 Dec 2023
Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks Mohammad-Javad Davari Eugene Belilovsky MoMe 99 71 0 11 Dec 2023
GTA: Gated Toxicity Avoidance for LM Performance Preservation Heegyu Kim Hyunsouk Cho 47 1 0 11 Dec 2023
Beyond Gradient and Priors in Privacy Attacks: Leveraging Pooler Layer Inputs of Language Models in Federated Learning Jianwei Li Sheng Liu Qi Lei PILM SILM AAML 68 4 0 10 Dec 2023
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 110 5 0 07 Dec 2023
LayerCollapse: Adaptive compression of neural networks Soheil Zibakhsh Shabgahi Mohammad Soheil Shariff F. Koushanfar AI4CE 61 1 0 29 Nov 2023
Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxification Daryna Dementieva Daniil Moskovskiy David Dale Alexander Panchenko 105 16 0 23 Nov 2023
Sparse Low-rank Adaptation of Pre-trained Language Models Ning Ding Xingtai Lv Qiaosen Wang Yulin Chen Bowen Zhou Zhiyuan Liu Maosong Sun 78 70 0 20 Nov 2023
Tensor-Aware Energy Accounting Timur Babakol Yu David Liu 38 4 0 19 Nov 2023
The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Text Yanzhu Guo Guokan Shang Michalis Vazirgiannis Chloé Clavel 100 59 0 16 Nov 2023
GistScore: Learning Better Representations for In-Context Example Selection with Gist Bottlenecks Shivanshu Gupta Clemens Rosenbaum Ethan R. Elenberg LRM 77 8 0 16 Nov 2023
MELA: Multilingual Evaluation of Linguistic Acceptability Ziyin Zhang Yikang Liu Wei-Ping Huang Junyu Mao Rui Wang Hai Hu 74 3 0 15 Nov 2023
DALA: A Distribution-Aware LoRA-Based Adversarial Attack against Language Models Yibo Wang Xiangjue Dong James Caverlee Philip S. Yu 76 2 0 14 Nov 2023
How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language Questions Houquan Zhou Yang Hou Zhenghua Li Xuebin Wang Zhefeng Wang Xinyu Duan Min Zhang ELM 81 5 0 14 Nov 2023