Don't Judge a Language Model by Its Last Layer: Contrastive Learning
with Layer-Wise Attention Pooling

Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling

13 September 2022

Papers citing "Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling"

9 / 9 papers shown

Title
Predicting Through Generation: Why Generation Is Better for Prediction Md. Kowsher Nusrat Jahan Prottasha Prakash Bhat Chun-Nam Yu Mojtaba Soltanalian Ivan Garibay O. Garibay Chen Chen Niloofar Yousefi AI4TS 65 0 0 25 Feb 2025
Adaptive Large Language Models By Layerwise Attention Shortcuts Prateek Verma Mert Pilanci KELM OffRL 58 0 0 17 Sep 2024
Pooling And Attention: What Are Effective Designs For LLM-Based Embedding Models? Yixuan Tang Yi Yang 33 3 0 04 Sep 2024
Improving Content Recommendation: Knowledge Graph-Based Semantic Contrastive Learning for Diversity and Cold-Start Users Yejin Kim Scott Rome Kevin Foley Mayur Nankani Rimon Melamed Javier Morales Abhay Yadav Maria Peifer Sardar Hamidian H. H. Huang 53 0 0 27 Mar 2024
Don't be a Fool: Pooling Strategies in Offensive Language Detection from User-Intended Adversarial Attacks Seunguk Yu Juhwan Choi Youngbin Kim AAML 21 0 0 20 Mar 2024
PWESuite: Phonetic Word Embeddings and Tasks They Facilitate Vilém Zouhar Kalvin Chang Chenxuan Cui Nathaniel Carlson Nathaniel R. Robinson Mrinmaya Sachan David R. Mortensen 28 2 0 05 Apr 2023
Quick Dense Retrievers Consume KALE: Post Training Kullback Leibler Alignment of Embeddings for Asymmetrical dual encoders Daniel Fernando Campos Alessandro Magnani Chengxiang Zhai 17 3 0 31 Mar 2023
L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi Ananya Joshi Aditi Kajale Janhavi Gadre Samruddhi Deode Raviraj Joshi 44 11 0 21 Nov 2022
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,926 0 17 Aug 2015