Fantastic Semantics and Where to Find Them: Investigating Which Layers
of Generative LLMs Reflect Lexical Semantics

Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics

3 March 2024

Maosong Sun

Papers citing "Fantastic Semantics and Where to Find Them: Investigating Which Layers of Generative LLMs Reflect Lexical Semantics"

13 / 13 papers shown

Title
Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering Zifeng Cheng Zhonghui Wang Yuchen Fu Zhiwei Jiang Yafeng Yin Cong Wang Qing Gu 10 0 0 19 May 2025
GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment Jiwei Tang Zhicheng Zhang Shunlong Wu Jingheng Ye Lichen Bai ... Tingwei Lu Jiaqi Chen Lin Hai Hai-Tao Zheng Hong-Gee Kim 0 0 0 18 May 2025
SEAL: Steerable Reasoning Calibration of Large Language Models for Free Runjin Chen Zhenyu (Allen) Zhang Junyuan Hong Souvik Kundu Zhangyang Wang OffRL LRM 52 2 0 07 Apr 2025
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering Zhanghao Hu Hanqi Yan Qingling Zhu Zhenyi Shen Yulan He Lin Gui RALM 41 0 0 03 Mar 2025
Sparse Auto-Encoder Interprets Linguistic Features in Large Language Models Yi Jing Zijun Yao Lingxu Ran Hongzhu Guo Xiaozhi Wang Lei Hou Juanzi Li 59 0 0 27 Feb 2025
The Representation and Recall of Interwoven Structured Knowledge in LLMs: A Geometric and Layered Analysis Ge Lei Samuel J. Cooper KELM 49 0 0 15 Feb 2025
Emergent effects of scaling on the functional hierarchies within large language models Paul C. Bogdan 87 0 0 13 Jan 2025
Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs Yuchen Fu Zifeng Cheng Zhiwei Jiang Zhonghui Wang Yafeng Yin Zhengliang Li Qing Gu LLMAG 77 0 0 16 Dec 2024
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small Kevin Wang Alexandre Variengien Arthur Conmy Buck Shlegeris Jacob Steinhardt 212 496 0 01 Nov 2022
In-context Learning and Induction Heads Catherine Olsson Nelson Elhage Neel Nanda Nicholas Joseph Nova Dassarma ... Tom B. Brown Jack Clark Jared Kaplan Sam McCandlish C. Olah 250 460 0 24 Sep 2022
Scalar Adjective Identification and Multilingual Ranking Aina Garí Soler Marianna Apidianaki 25 6 0 03 May 2021
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 417 2,588 0 03 Sep 2019