When Dimensionality Hurts: The Role of LLM Embedding Compression for Noisy Regression Tasks

4 February 2025

Papers citing "When Dimensionality Hurts: The Role of LLM Embedding Compression for Noisy Regression Tasks"

14 / 14 papers shown

Title
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models Chankyu Lee Rajarshi Roy Mengyao Xu Jonathan Raiman Mohammad Shoeybi Bryan Catanzaro Ming-Yu Liu RALM 161 170 0 27 May 2024
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders Parishad BehnamGhader Vaibhav Adlakha Marius Mosbach Dzmitry Bahdanau Nicolas Chapados Siva Reddy 67 203 0 09 Apr 2024
Efficient Prompting Methods for Large Language Models: A Survey Kaiyan Chang Songcheng Xu Chenglong Wang Yingfeng Luo Tong Xiao Jingbo Zhu LRM 79 34 0 01 Apr 2024
Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data Xiao Liu Zirui Wu Xueqing Wu Pan Lu Kai-Wei Chang Yansong Feng ELM LRM 55 35 0 27 Feb 2024
Graph-enhanced Large Language Models in Asynchronous Plan Reasoning Fangru Lin Emanuele La Malfa Valentin Hofmann Elle Michelle Yang Anthony Cohn J. Pierrehumbert LRM 92 18 0 05 Feb 2024
Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistency Baizhou Huang Hugo Caselles-Dupré Weizhu Chen Xiaojun Wan Mohamed Chetouani LRM 50 29 0 29 Sep 2023
To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis Fuzhao Xue Yao Fu Wangchunshu Zhou Zangwei Zheng Yang You 101 81 0 22 May 2023
AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts Tongshuang Wu Michael Terry Carrie J. Cai LLMAG AI4CE LRM 61 452 0 04 Oct 2021
MPNet: Masked and Permuted Pre-training for Language Understanding Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 94 1,105 0 20 Apr 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 449 4,662 0 23 Jan 2020
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 636 11,979 0 27 Aug 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 951 93,936 0 11 Oct 2018
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction Leland McInnes John Healy James Melville 113 9,312 0 09 Feb 2018
Character-level Convolutional Networks for Text Classification Xiang Zhang Jiaqi Zhao Yann LeCun 190 6,077 0 04 Sep 2015