Position Engineering: Boosting Large Language Models through Positional
Information Manipulation

Position Engineering: Boosting Large Language Models through Positional Information Manipulation

17 April 2024

Huiqiang Jiang

Yuqing Yang

Lili Qiu

Papers citing "Position Engineering: Boosting Large Language Models through Positional Information Manipulation"

6 / 6 papers shown

Title
CoRAG: Collaborative Retrieval-Augmented Generation Aashiq Muhamed Mona Diab Virginia Smith 35 0 0 02 Apr 2025
Path Pooling: Train-Free Structure Enhancement for Efficient Knowledge Graph Retrieval-Augmented Generation Han Wang Yuan Feng Xike Xie S.Kevin Zhou 48 0 0 07 Mar 2025
Attention Instruction: Amplifying Attention in the Middle via Prompting Meiru Zhang Zaiqiao Meng Nigel Collier 51 4 0 24 Jun 2024
Mitigate Position Bias in Large Language Models via Scaling a Single Dimension Yijiong Yu Huiqiang Jiang Xufang Luo Qianhui Wu Chin-Yew Lin Dongsheng Li Yuqing Yang Yongfeng Huang L. Qiu 48 9 0 04 Jun 2024
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,077 0 24 May 2022
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 253 695 0 27 Aug 2021